[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:22:02.749950 30223 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.131.254:45817
I20260709 12:22:02.751452 30223 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:22:02.752478 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:02.769546 30232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.769809 30229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.770373 30230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:03.961279 30231 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:22:03.961789 30223 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:22:03.965560 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:03.965794 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:03.966056 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599723966032 us; error 0 us; skew 500 ppm
I20260709 12:22:03.966914 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:03.973483 30223 webserver.cc:533] Webserver started at http://127.29.131.254:42303/ using document root <none> and password file <none>
I20260709 12:22:03.974363 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:03.974603 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:03.975064 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:03.980872 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/master-0-root/instance:
uuid: "0abd17b4d0c4461f997286298b3b8bcd"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-n640"
I20260709 12:22:03.988580 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:22:03.993731 30238 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:03.994829 30223 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:22:03.995203 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/master-0-root
uuid: "0abd17b4d0c4461f997286298b3b8bcd"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-n640"
I20260709 12:22:03.995584 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:04.061970 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:04.063604 30223 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:22:04.064077 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:04.137069 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.254:45817
I20260709 12:22:04.137177 30289 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.254:45817 every 8 connection(s)
I20260709 12:22:04.144865 30290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.166188 30290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd: Bootstrap starting.
I20260709 12:22:04.172116 30290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:04.173969 30290 log.cc:826] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd: Log is configured to *not* fsync() on all Append() calls
I20260709 12:22:04.178438 30290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd: No bootstrap required, opened a new log
I20260709 12:22:04.199826 30290 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abd17b4d0c4461f997286298b3b8bcd" member_type: VOTER }
I20260709 12:22:04.200352 30290 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:04.200569 30290 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0abd17b4d0c4461f997286298b3b8bcd, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.201483 30290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abd17b4d0c4461f997286298b3b8bcd" member_type: VOTER }
I20260709 12:22:04.201970 30290 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:04.202224 30290 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:04.202517 30290 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.206497 30290 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abd17b4d0c4461f997286298b3b8bcd" member_type: VOTER }
I20260709 12:22:04.207180 30290 leader_election.cc:304] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0abd17b4d0c4461f997286298b3b8bcd; no voters: 
I20260709 12:22:04.208877 30290 leader_election.cc:290] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:04.209273 30293 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:04.211618 30293 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 1 LEADER]: Becoming Leader. State: Replica: 0abd17b4d0c4461f997286298b3b8bcd, State: Running, Role: LEADER
I20260709 12:22:04.212679 30293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abd17b4d0c4461f997286298b3b8bcd" member_type: VOTER }
I20260709 12:22:04.213675 30290 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:04.224808 30295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0abd17b4d0c4461f997286298b3b8bcd. Latest consensus state: current_term: 1 leader_uuid: "0abd17b4d0c4461f997286298b3b8bcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abd17b4d0c4461f997286298b3b8bcd" member_type: VOTER } }
I20260709 12:22:04.224665 30294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0abd17b4d0c4461f997286298b3b8bcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abd17b4d0c4461f997286298b3b8bcd" member_type: VOTER } }
I20260709 12:22:04.225579 30295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:04.225631 30294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:04.229321 30301 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:04.241379 30301 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:04.243618 30223 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:04.257769 30301 catalog_manager.cc:1383] Generated new cluster ID: 5f1cfb4b62d1492eaceb2ed7f270b472
I20260709 12:22:04.258060 30301 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:04.299696 30301 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:04.301333 30301 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:04.317903 30301 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd: Generated new TSK 0
I20260709 12:22:04.318862 30301 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:04.375494 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:04.385478 30312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:04.386399 30313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.392284 30223 server_base.cc:1061] running on GCE node
W20260709 12:22:04.393745 30315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.394766 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:04.394991 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:04.395183 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599724395160 us; error 0 us; skew 500 ppm
I20260709 12:22:04.395857 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:04.400306 30223 webserver.cc:533] Webserver started at http://127.29.131.193:32843/ using document root <none> and password file <none>
I20260709 12:22:04.400887 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:04.401118 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:04.401408 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:04.402537 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-0-root/instance:
uuid: "29cc21419db14e998c13bc337993ee3a"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-n640"
I20260709 12:22:04.408383 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:22:04.413009 30320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.413945 30223 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:22:04.414316 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "29cc21419db14e998c13bc337993ee3a"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-n640"
I20260709 12:22:04.414721 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:04.433545 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:04.435429 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:04.438309 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:04.444046 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:04.444362 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.444698 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:04.444936 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.537166 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:34001
I20260709 12:22:04.537200 30382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:34001 every 8 connection(s)
I20260709 12:22:04.545562 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:04.559388 30387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:04.561921 30388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.569249 30383 heartbeater.cc:344] Connected to a master server at 127.29.131.254:45817
I20260709 12:22:04.569769 30383 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:04.570398 30223 server_base.cc:1061] running on GCE node
W20260709 12:22:04.571058 30390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.571195 30383 heartbeater.cc:507] Master 127.29.131.254:45817 requested a full tablet report, sending...
I20260709 12:22:04.572392 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:04.572736 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:04.572997 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599724572977 us; error 0 us; skew 500 ppm
I20260709 12:22:04.573815 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:04.574707 30255 ts_manager.cc:194] Registered new tserver with Master: 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001)
I20260709 12:22:04.576983 30223 webserver.cc:533] Webserver started at http://127.29.131.194:41309/ using document root <none> and password file <none>
I20260709 12:22:04.577382 30255 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58866
I20260709 12:22:04.577644 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:04.577919 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:04.578264 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:04.579691 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-1-root/instance:
uuid: "d2c98bc202df4635baac4d52387620a5"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-n640"
I20260709 12:22:04.586138 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:22:04.591650 30395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.592499 30223 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:22:04.592813 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-1-root
uuid: "d2c98bc202df4635baac4d52387620a5"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-n640"
I20260709 12:22:04.593164 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:04.608698 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:04.610351 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:04.612979 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:04.617023 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:04.617369 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:22:04.617664 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:04.617868 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.705109 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.194:38717
I20260709 12:22:04.705380 30457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.194:38717 every 8 connection(s)
I20260709 12:22:04.714320 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:04.723863 30461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.729959 30458 heartbeater.cc:344] Connected to a master server at 127.29.131.254:45817
I20260709 12:22:04.730770 30458 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:04.732065 30458 heartbeater.cc:507] Master 127.29.131.254:45817 requested a full tablet report, sending...
W20260709 12:22:04.732896 30462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.735675 30255 ts_manager.cc:194] Registered new tserver with Master: d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:04.736081 30223 server_base.cc:1061] running on GCE node
W20260709 12:22:04.737103 30464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.737224 30255 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58874
I20260709 12:22:04.738299 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:04.738523 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:04.738715 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599724738697 us; error 0 us; skew 500 ppm
I20260709 12:22:04.739354 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:04.742062 30223 webserver.cc:533] Webserver started at http://127.29.131.195:37325/ using document root <none> and password file <none>
I20260709 12:22:04.742547 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:04.742764 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:04.743094 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:04.744282 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-2-root/instance:
uuid: "cc52c3053f72413aa6ae449985724403"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-n640"
I20260709 12:22:04.748931 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:04.752833 30469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.753669 30223 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:22:04.753961 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-2-root
uuid: "cc52c3053f72413aa6ae449985724403"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-n640"
I20260709 12:22:04.754285 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599722576063-30223-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:04.777766 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:04.778956 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:04.781605 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:04.784857 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:04.785084 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.785320 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:04.785506 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.880573 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.195:37549
I20260709 12:22:04.880664 30531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.195:37549 every 8 connection(s)
I20260709 12:22:04.900559 30532 heartbeater.cc:344] Connected to a master server at 127.29.131.254:45817
I20260709 12:22:04.900942 30532 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:04.901743 30532 heartbeater.cc:507] Master 127.29.131.254:45817 requested a full tablet report, sending...
I20260709 12:22:04.903844 30255 ts_manager.cc:194] Registered new tserver with Master: cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:04.904597 30223 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016660886s
I20260709 12:22:04.905398 30255 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58876
I20260709 12:22:04.954713 30255 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58888:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:04.958444 30255 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:05.061689 30496 tablet_service.cc:1511] Processing CreateTablet for tablet b59240ea650c439eba226913c6312bf8 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:05.063175 30497 tablet_service.cc:1511] Processing CreateTablet for tablet 746f11f09ab84d68afd5bc9439698732 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:05.063623 30496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59240ea650c439eba226913c6312bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.068325 30497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746f11f09ab84d68afd5bc9439698732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.072649 30493 tablet_service.cc:1511] Processing CreateTablet for tablet da6ecdbf6db1474690c5e0be60b955da (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:05.066730 30495 tablet_service.cc:1511] Processing CreateTablet for tablet defacb680fba447cacf93d2801f18eb1 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:05.075533 30491 tablet_service.cc:1511] Processing CreateTablet for tablet 50e034430956467f93416ac8d3d1b356 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:05.069060 30494 tablet_service.cc:1511] Processing CreateTablet for tablet 68abcbb9921e4440ad16d1f418ed71f9 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:05.070752 30492 tablet_service.cc:1511] Processing CreateTablet for tablet 49ed7fcd62e745338ed5097acd244127 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:05.076081 30493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6ecdbf6db1474690c5e0be60b955da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.081225 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68abcbb9921e4440ad16d1f418ed71f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.080842 30490 tablet_service.cc:1511] Processing CreateTablet for tablet 5262935333334c13a0fb8740514abfae (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:05.092168 30491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e034430956467f93416ac8d3d1b356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.094249 30495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defacb680fba447cacf93d2801f18eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.096203 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ed7fcd62e745338ed5097acd244127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.102928 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5262935333334c13a0fb8740514abfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.105147 30489 tablet_service.cc:1511] Processing CreateTablet for tablet d064970d90a949dabc49765e15177f87 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:05.107941 30489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d064970d90a949dabc49765e15177f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.115468 30423 tablet_service.cc:1511] Processing CreateTablet for tablet 746f11f09ab84d68afd5bc9439698732 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:05.122051 30422 tablet_service.cc:1511] Processing CreateTablet for tablet b59240ea650c439eba226913c6312bf8 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:05.122782 30421 tablet_service.cc:1511] Processing CreateTablet for tablet defacb680fba447cacf93d2801f18eb1 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:05.125089 30423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746f11f09ab84d68afd5bc9439698732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.125551 30420 tablet_service.cc:1511] Processing CreateTablet for tablet 68abcbb9921e4440ad16d1f418ed71f9 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:05.134181 30421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defacb680fba447cacf93d2801f18eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.133685 30419 tablet_service.cc:1511] Processing CreateTablet for tablet da6ecdbf6db1474690c5e0be60b955da (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:05.140201 30417 tablet_service.cc:1511] Processing CreateTablet for tablet 50e034430956467f93416ac8d3d1b356 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:05.141268 30418 tablet_service.cc:1511] Processing CreateTablet for tablet 49ed7fcd62e745338ed5097acd244127 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:05.143386 30416 tablet_service.cc:1511] Processing CreateTablet for tablet 5262935333334c13a0fb8740514abfae (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:05.147101 30422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59240ea650c439eba226913c6312bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.147925 30416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5262935333334c13a0fb8740514abfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.149462 30418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ed7fcd62e745338ed5097acd244127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.163050 30420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68abcbb9921e4440ad16d1f418ed71f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.168382 30346 tablet_service.cc:1511] Processing CreateTablet for tablet defacb680fba447cacf93d2801f18eb1 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:05.170034 30346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defacb680fba447cacf93d2801f18eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.177476 30415 tablet_service.cc:1511] Processing CreateTablet for tablet d064970d90a949dabc49765e15177f87 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:05.187371 30347 tablet_service.cc:1511] Processing CreateTablet for tablet b59240ea650c439eba226913c6312bf8 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:05.190384 30348 tablet_service.cc:1511] Processing CreateTablet for tablet 746f11f09ab84d68afd5bc9439698732 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:05.192421 30348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746f11f09ab84d68afd5bc9439698732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.193996 30417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e034430956467f93416ac8d3d1b356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.195077 30345 tablet_service.cc:1511] Processing CreateTablet for tablet 68abcbb9921e4440ad16d1f418ed71f9 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:05.202468 30343 tablet_service.cc:1511] Processing CreateTablet for tablet 49ed7fcd62e745338ed5097acd244127 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:05.203852 30347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59240ea650c439eba226913c6312bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.209652 30344 tablet_service.cc:1511] Processing CreateTablet for tablet da6ecdbf6db1474690c5e0be60b955da (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:05.214485 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d064970d90a949dabc49765e15177f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.206593 30342 tablet_service.cc:1511] Processing CreateTablet for tablet 50e034430956467f93416ac8d3d1b356 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:05.226743 30419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6ecdbf6db1474690c5e0be60b955da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.220983 30341 tablet_service.cc:1511] Processing CreateTablet for tablet 5262935333334c13a0fb8740514abfae (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:05.221868 30340 tablet_service.cc:1511] Processing CreateTablet for tablet d064970d90a949dabc49765e15177f87 (DEFAULT_TABLE table=test-workload [id=132949f8243f449f82dd240fe185f433]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 12:22:05.239596 30303 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:05.242380 30345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68abcbb9921e4440ad16d1f418ed71f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.248802 30340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d064970d90a949dabc49765e15177f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.251188 30341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5262935333334c13a0fb8740514abfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.273763 30344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6ecdbf6db1474690c5e0be60b955da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.276988 30342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e034430956467f93416ac8d3d1b356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.290911 30343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ed7fcd62e745338ed5097acd244127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.311550 30549 tablet_bootstrap.cc:492] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
I20260709 12:22:05.347551 30550 tablet_bootstrap.cc:492] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:05.358047 30551 tablet_bootstrap.cc:492] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
I20260709 12:22:05.386866 30549 tablet_bootstrap.cc:654] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.393575 30550 tablet_bootstrap.cc:654] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.401578 30551 tablet_bootstrap.cc:654] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.401643 30549 tablet_bootstrap.cc:492] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:05.402189 30549 ts_tablet_manager.cc:1403] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.008s
I20260709 12:22:05.404739 30550 tablet_bootstrap.cc:492] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:05.405169 30550 ts_tablet_manager.cc:1403] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.004s
I20260709 12:22:05.405436 30549 raft_consensus.cc:359] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.406313 30549 raft_consensus.cc:385] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.406667 30549 raft_consensus.cc:740] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.407490 30549 consensus_queue.cc:260] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.408267 30550 raft_consensus.cc:359] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.409044 30550 raft_consensus.cc:385] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.409379 30550 raft_consensus.cc:740] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.410413 30550 consensus_queue.cc:260] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.413494 30551 tablet_bootstrap.cc:492] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.413968 30551 ts_tablet_manager.cc:1403] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.000s
I20260709 12:22:05.417397 30551 raft_consensus.cc:359] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.418120 30551 raft_consensus.cc:385] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.418406 30551 raft_consensus.cc:740] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.419130 30551 consensus_queue.cc:260] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.424921 30532 heartbeater.cc:499] Master 127.29.131.254:45817 was elected leader, sending a full tablet report...
I20260709 12:22:05.425446 30549 ts_tablet_manager.cc:1434] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.015s
I20260709 12:22:05.426275 30550 ts_tablet_manager.cc:1434] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.021s	user 0.013s	sys 0.009s
I20260709 12:22:05.426641 30549 tablet_bootstrap.cc:492] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
I20260709 12:22:05.427222 30550 tablet_bootstrap.cc:492] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:05.429630 30458 heartbeater.cc:499] Master 127.29.131.254:45817 was elected leader, sending a full tablet report...
I20260709 12:22:05.433823 30549 tablet_bootstrap.cc:654] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.434662 30550 tablet_bootstrap.cc:654] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.439975 30555 raft_consensus.cc:493] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.440493 30555 raft_consensus.cc:515] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.446419 30549 tablet_bootstrap.cc:492] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:05.446944 30549 ts_tablet_manager.cc:1403] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:22:05.447054 30555 leader_election.cc:290] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:05.449352 30383 heartbeater.cc:499] Master 127.29.131.254:45817 was elected leader, sending a full tablet report...
I20260709 12:22:05.450137 30549 raft_consensus.cc:359] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.450886 30549 raft_consensus.cc:385] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.450947 30551 ts_tablet_manager.cc:1434] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.037s	user 0.016s	sys 0.000s
I20260709 12:22:05.451261 30549 raft_consensus.cc:740] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.452224 30551 tablet_bootstrap.cc:492] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
I20260709 12:22:05.452108 30549 consensus_queue.cc:260] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.460038 30551 tablet_bootstrap.cc:654] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.464236 30549 ts_tablet_manager.cc:1434] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260709 12:22:05.465078 30459 tablet.cc:2406] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:05.467578 30550 tablet_bootstrap.cc:492] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:05.468129 30550 ts_tablet_manager.cc:1403] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.003s
I20260709 12:22:05.470388 30549 tablet_bootstrap.cc:492] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
I20260709 12:22:05.471843 30550 raft_consensus.cc:359] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.472565 30550 raft_consensus.cc:385] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.472851 30550 raft_consensus.cc:740] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.473536 30550 consensus_queue.cc:260] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.484975 30550 ts_tablet_manager.cc:1434] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:22:05.487499 30550 tablet_bootstrap.cc:492] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:05.489115 30549 tablet_bootstrap.cc:654] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.490864 30551 tablet_bootstrap.cc:492] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.491448 30551 ts_tablet_manager.cc:1403] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.012s
I20260709 12:22:05.497895 30556 raft_consensus.cc:493] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.497817 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:05.498512 30556 raft_consensus.cc:515] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
W20260709 12:22:05.500296 30472 leader_election.cc:343] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.502389 30550 tablet_bootstrap.cc:654] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.504324 30556 leader_election.cc:290] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.503557 30551 raft_consensus.cc:359] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.505211 30551 raft_consensus.cc:385] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.505601 30551 raft_consensus.cc:740] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.506620 30551 consensus_queue.cc:260] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.509186 30551 ts_tablet_manager.cc:1434] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.006s
I20260709 12:22:05.510226 30551 tablet_bootstrap.cc:492] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
I20260709 12:22:05.518483 30551 tablet_bootstrap.cc:654] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.530129 30551 tablet_bootstrap.cc:492] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.530699 30551 ts_tablet_manager.cc:1403] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.016s
I20260709 12:22:05.534204 30551 raft_consensus.cc:359] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.535120 30551 raft_consensus.cc:385] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.535512 30551 raft_consensus.cc:740] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.536481 30551 consensus_queue.cc:260] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.537364 30555 raft_consensus.cc:493] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.537961 30555 raft_consensus.cc:515] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.539582 30551 ts_tablet_manager.cc:1434] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:22:05.540681 30551 tablet_bootstrap.cc:492] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
I20260709 12:22:05.541688 30555 leader_election.cc:290] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:05.542387 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
W20260709 12:22:05.544111 30472 leader_election.cc:343] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.548761 30557 raft_consensus.cc:493] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.549224 30557 raft_consensus.cc:515] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.551858 30557 leader_election.cc:290] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.564683 30551 tablet_bootstrap.cc:654] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.577998 30550 tablet_bootstrap.cc:492] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:05.580030 30550 ts_tablet_manager.cc:1403] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.023s
I20260709 12:22:05.583588 30550 raft_consensus.cc:359] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.584429 30550 raft_consensus.cc:385] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.584816 30550 raft_consensus.cc:740] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.590200 30550 consensus_queue.cc:260] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.597530 30549 tablet_bootstrap.cc:492] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:05.598013 30549 ts_tablet_manager.cc:1403] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.035s
I20260709 12:22:05.600150 30551 tablet_bootstrap.cc:492] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.600622 30551 ts_tablet_manager.cc:1403] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.004s
I20260709 12:22:05.605476 30551 raft_consensus.cc:359] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.606218 30551 raft_consensus.cc:385] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.606523 30551 raft_consensus.cc:740] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.609989 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:05.607590 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:05.610776 30432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:05.615118 30550 ts_tablet_manager.cc:1434] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:22:05.616261 30550 tablet_bootstrap.cc:492] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:05.611874 30549 raft_consensus.cc:359] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.617556 30549 raft_consensus.cc:385] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.617846 30549 raft_consensus.cc:740] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.611243 30551 consensus_queue.cc:260] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.621411 30549 consensus_queue.cc:260] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.624138 30549 ts_tablet_manager.cc:1434] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:22:05.627079 30551 ts_tablet_manager.cc:1434] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 12:22:05.629843 30551 tablet_bootstrap.cc:492] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
W20260709 12:22:05.630959 30398 leader_election.cc:343] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.638756 30551 tablet_bootstrap.cc:654] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.640909 30557 raft_consensus.cc:493] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.640293 30549 tablet_bootstrap.cc:492] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
I20260709 12:22:05.642423 30557 raft_consensus.cc:515] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.642508 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:05.644469 30507 raft_consensus.cc:2468] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 0.
W20260709 12:22:05.644968 30472 leader_election.cc:343] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.645434 30557 leader_election.cc:290] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:05.645434 30472 leader_election.cc:304] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:05.646160 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:05.646847 30555 raft_consensus.cc:2749] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:05.647079 30433 raft_consensus.cc:2468] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 0.
W20260709 12:22:05.647254 30472 leader_election.cc:343] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.647691 30472 leader_election.cc:304] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:05.648388 30555 raft_consensus.cc:2749] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:05.646139 30398 leader_election.cc:304] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5; no voters: 29cc21419db14e998c13bc337993ee3a
I20260709 12:22:05.649637 30556 raft_consensus.cc:2804] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.650014 30556 raft_consensus.cc:493] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.650348 30556 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.650780 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:05.652338 30323 leader_election.cc:304] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:05.654297 30557 raft_consensus.cc:2804] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.654675 30557 raft_consensus.cc:493] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.654592 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:05.655158 30557 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.656455 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:05.658653 30556 raft_consensus.cc:515] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.660655 30556 leader_election.cc:290] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.661782 30557 raft_consensus.cc:515] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.664968 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:05.665118 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:05.664968 30557 leader_election.cc:290] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.665557 30507 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.666106 30557 raft_consensus.cc:493] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.666522 30557 raft_consensus.cc:515] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.668386 30557 leader_election.cc:290] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
W20260709 12:22:05.669116 30398 leader_election.cc:343] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.675976 30551 tablet_bootstrap.cc:492] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.676476 30551 ts_tablet_manager.cc:1403] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.007s
I20260709 12:22:05.680101 30551 raft_consensus.cc:359] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.680922 30551 raft_consensus.cc:385] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.681237 30551 raft_consensus.cc:740] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.682122 30551 consensus_queue.cc:260] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.687646 30551 ts_tablet_manager.cc:1434] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:22:05.688683 30551 tablet_bootstrap.cc:492] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
I20260709 12:22:05.697553 30507 raft_consensus.cc:2468] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 1.
I20260709 12:22:05.699002 30398 leader_election.cc:304] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5; no voters: 29cc21419db14e998c13bc337993ee3a
W20260709 12:22:05.699676 30323 leader_election.cc:343] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.700131 30551 tablet_bootstrap.cc:654] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.701359 30550 tablet_bootstrap.cc:654] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.701152 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:05.701785 30433 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.703397 30556 raft_consensus.cc:2804] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:05.709149 30556 raft_consensus.cc:697] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:05.709796 30433 raft_consensus.cc:2468] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 1.
I20260709 12:22:05.711280 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:05.682997 30549 tablet_bootstrap.cc:654] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.712173 30432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d064970d90a949dabc49765e15177f87" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:05.713583 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d064970d90a949dabc49765e15177f87" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
W20260709 12:22:05.714233 30323 leader_election.cc:343] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.716912 30323 leader_election.cc:304] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a; no voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:05.717832 30574 raft_consensus.cc:2749] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:05.718503 30551 tablet_bootstrap.cc:492] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.719025 30551 ts_tablet_manager.cc:1403] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.017s
I20260709 12:22:05.710042 30556 consensus_queue.cc:237] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
W20260709 12:22:05.719117 30323 leader_election.cc:343] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:05.720160 30323 leader_election.cc:343] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:05.720880 30323 leader_election.cc:343] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.721662 30323 leader_election.cc:304] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: cc52c3053f72413aa6ae449985724403
I20260709 12:22:05.722429 30574 raft_consensus.cc:2804] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:05.722997 30574 raft_consensus.cc:697] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:05.722551 30551 raft_consensus.cc:359] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.723848 30574 consensus_queue.cc:237] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.724375 30551 raft_consensus.cc:385] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.714370 30550 tablet_bootstrap.cc:492] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:05.724783 30551 raft_consensus.cc:740] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.725337 30550 ts_tablet_manager.cc:1403] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.109s	user 0.007s	sys 0.007s
I20260709 12:22:05.725973 30551 consensus_queue.cc:260] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.728439 30550 raft_consensus.cc:359] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
W20260709 12:22:05.729097 30323 leader_election.cc:343] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.729122 30551 ts_tablet_manager.cc:1434] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:22:05.729679 30323 leader_election.cc:304] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a; no voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:05.730492 30557 raft_consensus.cc:2749] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:05.731271 30551 tablet_bootstrap.cc:492] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
I20260709 12:22:05.729139 30550 raft_consensus.cc:385] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.735127 30550 raft_consensus.cc:740] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.736128 30550 consensus_queue.cc:260] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.738986 30549 tablet_bootstrap.cc:492] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:05.739550 30549 ts_tablet_manager.cc:1403] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.002s
I20260709 12:22:05.740038 30551 tablet_bootstrap.cc:654] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.742529 30549 raft_consensus.cc:359] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.747476 30550 ts_tablet_manager.cc:1434] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:22:05.746830 30253 catalog_manager.cc:5697] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 1 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.748399 30549 raft_consensus.cc:385] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.748732 30550 tablet_bootstrap.cc:492] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:05.748766 30549 raft_consensus.cc:740] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.750747 30549 consensus_queue.cc:260] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.753861 30549 ts_tablet_manager.cc:1434] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:22:05.754878 30549 tablet_bootstrap.cc:492] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
I20260709 12:22:05.756691 30550 tablet_bootstrap.cc:654] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.762142 30549 tablet_bootstrap.cc:654] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.769807 30550 tablet_bootstrap.cc:492] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:05.761701 30251 catalog_manager.cc:5697] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.770382 30550 ts_tablet_manager.cc:1403] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:22:05.772850 30549 tablet_bootstrap.cc:492] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:05.773313 30549 ts_tablet_manager.cc:1403] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:22:05.773857 30550 raft_consensus.cc:359] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.774643 30550 raft_consensus.cc:385] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.774932 30550 raft_consensus.cc:740] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.775676 30550 consensus_queue.cc:260] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.776211 30549 raft_consensus.cc:359] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.777274 30549 raft_consensus.cc:385] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.777555 30549 raft_consensus.cc:740] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.777853 30550 ts_tablet_manager.cc:1434] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:22:05.778818 30550 tablet_bootstrap.cc:492] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:05.778348 30549 consensus_queue.cc:260] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.780887 30549 ts_tablet_manager.cc:1434] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:22:05.781816 30549 tablet_bootstrap.cc:492] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
I20260709 12:22:05.785567 30550 tablet_bootstrap.cc:654] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.788287 30549 tablet_bootstrap.cc:654] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.789137 30551 tablet_bootstrap.cc:492] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.789656 30551 ts_tablet_manager.cc:1403] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.010s
I20260709 12:22:05.792779 30551 raft_consensus.cc:359] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.793578 30551 raft_consensus.cc:385] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.793911 30551 raft_consensus.cc:740] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.794708 30551 consensus_queue.cc:260] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.797504 30551 ts_tablet_manager.cc:1434] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 12:22:05.798517 30551 tablet_bootstrap.cc:492] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
I20260709 12:22:05.803139 30550 tablet_bootstrap.cc:492] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:05.803632 30550 ts_tablet_manager.cc:1403] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 12:22:05.803949 30549 tablet_bootstrap.cc:492] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:05.804425 30549 ts_tablet_manager.cc:1403] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.010s
I20260709 12:22:05.805990 30551 tablet_bootstrap.cc:654] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.806617 30550 raft_consensus.cc:359] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.807351 30550 raft_consensus.cc:385] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.807646 30550 raft_consensus.cc:740] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.808810 30550 consensus_queue.cc:260] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.809237 30549 raft_consensus.cc:359] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.809924 30549 raft_consensus.cc:385] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.810300 30549 raft_consensus.cc:740] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.811084 30549 consensus_queue.cc:260] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.811578 30550 ts_tablet_manager.cc:1434] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:05.812628 30550 tablet_bootstrap.cc:492] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:05.813548 30549 ts_tablet_manager.cc:1434] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:05.814610 30549 tablet_bootstrap.cc:492] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
I20260709 12:22:05.818586 30551 tablet_bootstrap.cc:492] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.819062 30551 ts_tablet_manager.cc:1403] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 12:22:05.819691 30550 tablet_bootstrap.cc:654] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.821265 30549 tablet_bootstrap.cc:654] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.822255 30555 raft_consensus.cc:493] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.821894 30551 raft_consensus.cc:359] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.822949 30551 raft_consensus.cc:385] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.822768 30555 raft_consensus.cc:515] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.823333 30551 raft_consensus.cc:740] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.824373 30574 raft_consensus.cc:493] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.824211 30551 consensus_queue.cc:260] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.824813 30574 raft_consensus.cc:515] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.825176 30555 leader_election.cc:290] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:05.826911 30551 ts_tablet_manager.cc:1434] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:05.826987 30574 leader_election.cc:290] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.828018 30551 tablet_bootstrap.cc:492] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a: Bootstrap starting.
I20260709 12:22:05.831935 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d064970d90a949dabc49765e15177f87" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:05.832628 30358 raft_consensus.cc:2468] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 0.
I20260709 12:22:05.833645 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:05.834251 30433 raft_consensus.cc:2468] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 0.
I20260709 12:22:05.834903 30549 tablet_bootstrap.cc:492] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:05.835150 30551 tablet_bootstrap.cc:654] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.835369 30549 ts_tablet_manager.cc:1403] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:22:05.835290 30432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d064970d90a949dabc49765e15177f87" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:05.836846 30472 leader_election.cc:304] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:05.837587 30555 raft_consensus.cc:2804] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.837919 30555 raft_consensus.cc:493] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.838259 30555 raft_consensus.cc:3060] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.838219 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:05.839951 30323 leader_election.cc:304] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
W20260709 12:22:05.841286 30472 leader_election.cc:343] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:05.842308 30323 leader_election.cc:343] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.843204 30574 raft_consensus.cc:2804] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.843578 30574 raft_consensus.cc:493] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.843917 30574 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.845206 30555 raft_consensus.cc:515] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.847628 30551 tablet_bootstrap.cc:492] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a: No bootstrap required, opened a new log
I20260709 12:22:05.848063 30551 ts_tablet_manager.cc:1403] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 12:22:05.848147 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d064970d90a949dabc49765e15177f87" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:05.848775 30358 raft_consensus.cc:3060] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.848671 30549 raft_consensus.cc:359] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.849390 30549 raft_consensus.cc:385] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.849710 30549 raft_consensus.cc:740] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.850517 30549 consensus_queue.cc:260] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.851048 30556 raft_consensus.cc:493] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.851329 30551 raft_consensus.cc:359] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.851492 30556 raft_consensus.cc:515] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.852069 30551 raft_consensus.cc:385] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.852384 30551 raft_consensus.cc:740] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.852663 30555 leader_election.cc:290] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:05.853116 30551 consensus_queue.cc:260] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.853716 30556 leader_election.cc:290] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549), 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001)
I20260709 12:22:05.855525 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:05.855717 30551 ts_tablet_manager.cc:1434] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:05.856135 30506 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 0.
I20260709 12:22:05.858158 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:05.859062 30398 leader_election.cc:304] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:05.859417 30357 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 0.
I20260709 12:22:05.860194 30556 raft_consensus.cc:2804] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.860450 30549 ts_tablet_manager.cc:1434] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 12:22:05.860643 30556 raft_consensus.cc:493] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.861052 30556 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.859851 30432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d064970d90a949dabc49765e15177f87" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:05.861444 30549 tablet_bootstrap.cc:492] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
W20260709 12:22:05.862649 30472 leader_election.cc:343] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.868779 30556 raft_consensus.cc:515] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.871702 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:05.873534 30550 tablet_bootstrap.cc:492] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:05.874114 30550 ts_tablet_manager.cc:1403] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.001s
I20260709 12:22:05.874300 30506 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.873605 30574 raft_consensus.cc:515] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.879853 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:05.880421 30357 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.878672 30556 leader_election.cc:290] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Requested vote from peers cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549), 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001)
I20260709 12:22:05.877956 30358 raft_consensus.cc:2468] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 1.
I20260709 12:22:05.881597 30432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:05.885361 30432 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.885857 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403"
W20260709 12:22:05.888564 30323 leader_election.cc:343] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.884567 30574 leader_election.cc:290] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.890849 30472 leader_election.cc:304] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: d2c98bc202df4635baac4d52387620a5
I20260709 12:22:05.892652 30593 raft_consensus.cc:2804] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:05.894275 30549 tablet_bootstrap.cc:654] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.895365 30593 raft_consensus.cc:697] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 1 LEADER]: Becoming Leader. State: Replica: cc52c3053f72413aa6ae449985724403, State: Running, Role: LEADER
I20260709 12:22:05.895658 30550 raft_consensus.cc:359] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.896306 30593 consensus_queue.cc:237] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.896595 30550 raft_consensus.cc:385] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.899725 30550 raft_consensus.cc:740] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.898545 30432 raft_consensus.cc:2468] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 1.
I20260709 12:22:05.900648 30550 consensus_queue.cc:260] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.901909 30357 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 1.
I20260709 12:22:05.902531 30323 leader_election.cc:304] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: cc52c3053f72413aa6ae449985724403
I20260709 12:22:05.904328 30574 raft_consensus.cc:2804] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:05.904618 30398 leader_election.cc:304] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:05.904907 30574 raft_consensus.cc:697] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:05.905625 30556 raft_consensus.cc:2804] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:05.905752 30574 consensus_queue.cc:237] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.906280 30556 raft_consensus.cc:697] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:05.908941 30556 consensus_queue.cc:237] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:05.913406 30576 raft_consensus.cc:493] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.914011 30576 raft_consensus.cc:515] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.914760 30550 ts_tablet_manager.cc:1434] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 12:22:05.917375 30506 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 1.
I20260709 12:22:05.918187 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5262935333334c13a0fb8740514abfae" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:05.918860 30357 raft_consensus.cc:2468] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 0.
I20260709 12:22:05.919291 30576 leader_election.cc:290] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.920141 30576 raft_consensus.cc:493] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.920537 30576 raft_consensus.cc:515] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.922003 30576 leader_election.cc:290] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.924846 30549 tablet_bootstrap.cc:492] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:05.924978 30398 leader_election.cc:304] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:05.925549 30549 ts_tablet_manager.cc:1403] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.001s
I20260709 12:22:05.926483 30598 raft_consensus.cc:2804] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.926882 30598 raft_consensus.cc:493] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.927275 30598 raft_consensus.cc:3060] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.927629 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:05.928007 30550 tablet_bootstrap.cc:492] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:05.928751 30507 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 0.
I20260709 12:22:05.931159 30549 raft_consensus.cc:359] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.932371 30549 raft_consensus.cc:385] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.932868 30549 raft_consensus.cc:740] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.933636 30549 consensus_queue.cc:260] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.935737 30398 leader_election.cc:304] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:05.935997 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:05.936149 30549 ts_tablet_manager.cc:1434] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:05.936611 30357 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 0.
I20260709 12:22:05.936669 30556 raft_consensus.cc:2804] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.937397 30549 tablet_bootstrap.cc:492] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403: Bootstrap starting.
I20260709 12:22:05.937191 30556 raft_consensus.cc:493] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.938189 30556 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.937692 30251 catalog_manager.cc:5697] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 1 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.939965 30253 catalog_manager.cc:5697] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.940744 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5262935333334c13a0fb8740514abfae" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:05.941365 30506 raft_consensus.cc:2468] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 0.
I20260709 12:22:05.944665 30549 tablet_bootstrap.cc:654] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.945612 30556 raft_consensus.cc:515] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.946202 30598 raft_consensus.cc:515] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.948295 30598 leader_election.cc:290] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.950417 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5262935333334c13a0fb8740514abfae" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:05.950965 30357 raft_consensus.cc:3060] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.951391 30550 tablet_bootstrap.cc:654] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.957523 30556 leader_election.cc:290] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.961452 30557 raft_consensus.cc:493] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.961930 30557 raft_consensus.cc:515] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.967317 30550 tablet_bootstrap.cc:492] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:05.967983 30550 ts_tablet_manager.cc:1403] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.005s
I20260709 12:22:05.968693 30253 catalog_manager.cc:5697] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc52c3053f72413aa6ae449985724403 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "cc52c3053f72413aa6ae449985724403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:05.970106 30557 leader_election.cc:290] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:05.972822 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e034430956467f93416ac8d3d1b356" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:05.973750 30506 raft_consensus.cc:2468] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 0.
I20260709 12:22:05.975461 30323 leader_election.cc:304] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:05.976732 30557 raft_consensus.cc:2804] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.977262 30557 raft_consensus.cc:493] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.977736 30557 raft_consensus.cc:3060] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.978160 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5262935333334c13a0fb8740514abfae" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:05.978736 30507 raft_consensus.cc:3060] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.985082 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:05.985862 30358 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.989171 30507 raft_consensus.cc:2468] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 1.
I20260709 12:22:05.990559 30432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e034430956467f93416ac8d3d1b356" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:05.991658 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:05.993369 30506 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.995496 30556 raft_consensus.cc:493] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.996243 30556 raft_consensus.cc:515] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:05.999862 30556 leader_election.cc:290] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
W20260709 12:22:06.002029 30323 leader_election.cc:343] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.002920 30356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d064970d90a949dabc49765e15177f87" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:06.003930 30358 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 1.
I20260709 12:22:06.007956 30356 raft_consensus.cc:2393] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2c98bc202df4635baac4d52387620a5 in current term 1: Already voted for candidate cc52c3053f72413aa6ae449985724403 in this term.
I20260709 12:22:06.004565 30398 leader_election.cc:304] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:06.004590 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d064970d90a949dabc49765e15177f87" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:06.009157 30574 raft_consensus.cc:493] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.005779 30549 tablet_bootstrap.cc:492] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403: No bootstrap required, opened a new log
I20260709 12:22:06.007179 30357 raft_consensus.cc:2468] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 1.
I20260709 12:22:06.009603 30574 raft_consensus.cc:515] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.010947 30556 raft_consensus.cc:2804] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.011538 30556 raft_consensus.cc:697] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:06.010748 30398 leader_election.cc:304] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:06.012411 30598 raft_consensus.cc:2804] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.012503 30556 consensus_queue.cc:237] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.012979 30598 raft_consensus.cc:697] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:06.013720 30574 leader_election.cc:290] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.013916 30598 consensus_queue.cc:237] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.010782 30549 ts_tablet_manager.cc:1403] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403: Time spent bootstrapping tablet: real 0.074s	user 0.028s	sys 0.023s
I20260709 12:22:06.016927 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:06.017757 30507 raft_consensus.cc:2393] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29cc21419db14e998c13bc337993ee3a in current term 1: Already voted for candidate d2c98bc202df4635baac4d52387620a5 in this term.
I20260709 12:22:06.018131 30550 raft_consensus.cc:359] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.018743 30550 raft_consensus.cc:385] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.018464 30549 raft_consensus.cc:359] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.018998 30550 raft_consensus.cc:740] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.019155 30549 raft_consensus.cc:385] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.019534 30549 raft_consensus.cc:740] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.019721 30550 consensus_queue.cc:260] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.020309 30549 consensus_queue.cc:260] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.022647 30549 ts_tablet_manager.cc:1434] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:06.024664 30506 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 1.
I20260709 12:22:06.025563 30398 leader_election.cc:304] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c98bc202df4635baac4d52387620a5; no voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403
I20260709 12:22:06.029628 30576 raft_consensus.cc:3060] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.016454 30557 raft_consensus.cc:515] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.036774 30557 leader_election.cc:290] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.037526 30550 ts_tablet_manager.cc:1434] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.004s
I20260709 12:22:06.038360 30550 tablet_bootstrap.cc:492] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5: Bootstrap starting.
I20260709 12:22:06.038589 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e034430956467f93416ac8d3d1b356" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:06.039466 30507 raft_consensus.cc:3060] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.043864 30550 tablet_bootstrap.cc:654] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.062357 30550 tablet_bootstrap.cc:492] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5: No bootstrap required, opened a new log
I20260709 12:22:06.062814 30550 ts_tablet_manager.cc:1403] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.013s
I20260709 12:22:06.065418 30550 raft_consensus.cc:359] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.066064 30550 raft_consensus.cc:385] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.066313 30550 raft_consensus.cc:740] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.066956 30550 consensus_queue.cc:260] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.081872 30550 ts_tablet_manager.cc:1434] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.003s
W20260709 12:22:06.071700 30398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37549, user_credentials={real_user=slave}} blocked reactor thread for 46265.2us
I20260709 12:22:06.074465 30605 raft_consensus.cc:493] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.071143 30507 raft_consensus.cc:2468] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 1.
I20260709 12:22:06.091524 30605 raft_consensus.cc:515] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.057073 30576 raft_consensus.cc:2749] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:06.092696 30323 leader_election.cc:304] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:06.094056 30557 raft_consensus.cc:2804] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.094364 30605 leader_election.cc:290] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.094745 30557 raft_consensus.cc:697] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:06.096490 30557 consensus_queue.cc:237] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.103005 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e034430956467f93416ac8d3d1b356" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:06.103628 30433 raft_consensus.cc:3060] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.104990 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e034430956467f93416ac8d3d1b356" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:06.105672 30432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:06.105907 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e034430956467f93416ac8d3d1b356" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:06.106803 30507 raft_consensus.cc:2393] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2c98bc202df4635baac4d52387620a5 in current term 1: Already voted for candidate 29cc21419db14e998c13bc337993ee3a in this term.
I20260709 12:22:06.108351 30323 leader_election.cc:304] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a; no voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:06.108740 30398 leader_election.cc:304] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c98bc202df4635baac4d52387620a5; no voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403
I20260709 12:22:06.109586 30557 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.110189 30433 raft_consensus.cc:2468] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 1.
I20260709 12:22:06.109706 30253 catalog_manager.cc:5697] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 1 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.110703 30556 raft_consensus.cc:2749] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:06.114251 30251 catalog_manager.cc:5697] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.117203 30557 raft_consensus.cc:2749] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:06.126091 30507 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.129951 30251 catalog_manager.cc:5697] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.135458 30557 consensus_queue.cc:1048] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.165673 30574 consensus_queue.cc:1048] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.193172 30574 raft_consensus.cc:493] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.193692 30574 raft_consensus.cc:515] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.195802 30574 leader_election.cc:290] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.197122 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403" is_pre_election: true
I20260709 12:22:06.196768 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:06.198292 30433 raft_consensus.cc:2468] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 0.
I20260709 12:22:06.198256 30507 raft_consensus.cc:2468] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 0.
I20260709 12:22:06.199602 30323 leader_election.cc:304] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:06.200301 30574 raft_consensus.cc:2804] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:06.200660 30574 raft_consensus.cc:493] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.200973 30574 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.207316 30574 raft_consensus.cc:515] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.209281 30574 leader_election.cc:290] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.210166 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:06.210505 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:06.210871 30433 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.211054 30507 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.217867 30433 raft_consensus.cc:2468] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 1.
I20260709 12:22:06.217867 30507 raft_consensus.cc:2468] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 1.
I20260709 12:22:06.219098 30323 leader_election.cc:304] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:06.219534 30593 raft_consensus.cc:493] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.219926 30574 raft_consensus.cc:2804] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.219983 30593 raft_consensus.cc:515] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.220505 30574 raft_consensus.cc:697] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:06.221973 30593 leader_election.cc:290] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:06.222335 30574 consensus_queue.cc:237] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.222744 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:06.223150 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:06.224272 30433 raft_consensus.cc:2393] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc52c3053f72413aa6ae449985724403 in current term 1: Already voted for candidate 29cc21419db14e998c13bc337993ee3a in this term.
I20260709 12:22:06.225122 30472 leader_election.cc:304] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:06.226039 30593 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.231393 30251 catalog_manager.cc:5697] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 1 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.232535 30593 raft_consensus.cc:2749] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:06.237115 30556 consensus_queue.cc:1048] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.250777 30598 consensus_queue.cc:1048] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.316642 30574 consensus_queue.cc:1048] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.318544 30593 consensus_queue.cc:1048] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.336282 30574 consensus_queue.cc:1048] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.349907 30555 consensus_queue.cc:1048] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.444272 30598 consensus_queue.cc:1048] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.456561 30606 consensus_queue.cc:1048] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.466740 30556 consensus_queue.cc:1048] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.478645 30556 consensus_queue.cc:1048] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.505285 30432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:57020
I20260709 12:22:06.505940 30432 raft_consensus.cc:606] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Received request to transfer leadership to TS 29cc21419db14e998c13bc337993ee3a
I20260709 12:22:06.511083 30432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59240ea650c439eba226913c6312bf8"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:57020
I20260709 12:22:06.511698 30432 raft_consensus.cc:606] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Received request to transfer leadership to TS 29cc21419db14e998c13bc337993ee3a
I20260709 12:22:06.519053 30432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:57020
I20260709 12:22:06.519606 30432 raft_consensus.cc:606] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Received request to transfer leadership to TS 29cc21419db14e998c13bc337993ee3a
I20260709 12:22:06.532483 30357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
mode: GRACEFUL
new_leader_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:50318
I20260709 12:22:06.533001 30357 raft_consensus.cc:606] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Received request to transfer leadership to TS d2c98bc202df4635baac4d52387620a5
I20260709 12:22:06.538879 30357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
mode: GRACEFUL
new_leader_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:50318
I20260709 12:22:06.539402 30357 raft_consensus.cc:606] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Received request to transfer leadership to TS d2c98bc202df4635baac4d52387620a5
I20260709 12:22:06.544265 30357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e034430956467f93416ac8d3d1b356"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
mode: GRACEFUL
new_leader_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:50318
I20260709 12:22:06.544785 30357 raft_consensus.cc:606] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Received request to transfer leadership to TS d2c98bc202df4635baac4d52387620a5
I20260709 12:22:06.570051 30574 consensus_queue.cc:1048] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.570297 30606 consensus_queue.cc:1048] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.581192 30619 raft_consensus.cc:993] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a: : Instructing follower d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:06.581661 30619 raft_consensus.cc:1081] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Signalling peer d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:06.588641 30619 consensus_queue.cc:1048] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.588994 30576 consensus_queue.cc:1048] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.590157 30433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50e034430956467f93416ac8d3d1b356"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:22:06.590754 30433 raft_consensus.cc:493] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:06.591125 30433 raft_consensus.cc:3060] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.606946 30433 raft_consensus.cc:515] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.609017 30432 raft_consensus.cc:1240] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Rejecting Update request from peer 29cc21419db14e998c13bc337993ee3a for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.614485 30619 consensus_queue.cc:1059] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.615339 30619 raft_consensus.cc:3055] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.615736 30619 raft_consensus.cc:740] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:06.616937 30619 consensus_queue.cc:260] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.617870 30619 raft_consensus.cc:3060] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.626186 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e034430956467f93416ac8d3d1b356" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:06.628443 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e034430956467f93416ac8d3d1b356" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:06.631570 30433 leader_election.cc:290] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 2 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.643610 30357 raft_consensus.cc:2468] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 2.
I20260709 12:22:06.647034 30398 leader_election.cc:304] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: cc52c3053f72413aa6ae449985724403
I20260709 12:22:06.647898 30576 raft_consensus.cc:2804] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.648378 30576 raft_consensus.cc:697] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:06.649212 30576 consensus_queue.cc:237] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.657408 30255 catalog_manager.cc:5697] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 1 to 2, leader changed from 29cc21419db14e998c13bc337993ee3a (127.29.131.193) to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.673197 30598 raft_consensus.cc:993] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: : Instructing follower 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:06.673633 30576 raft_consensus.cc:1081] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Signalling peer 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:06.675158 30357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:50316
I20260709 12:22:06.675666 30357 raft_consensus.cc:493] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:06.675977 30357 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.680045 30357 raft_consensus.cc:515] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.681571 30357 leader_election.cc:290] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 2 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.682503 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:06.682813 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:06.683075 30433 raft_consensus.cc:3055] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.683466 30433 raft_consensus.cc:740] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:06.684235 30433 consensus_queue.cc:260] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.685097 30433 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.683422 30506 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.690515 30433 raft_consensus.cc:2468] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 2.
I20260709 12:22:06.691766 30323 leader_election.cc:304] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:06.692567 30619 raft_consensus.cc:2804] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.693035 30619 raft_consensus.cc:697] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:06.693382 30506 raft_consensus.cc:2468] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 2.
I20260709 12:22:06.693830 30619 consensus_queue.cc:237] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.701407 30255 catalog_manager.cc:5697] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 1 to 2, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 2 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.708736 30619 consensus_queue.cc:1048] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.715400 30618 raft_consensus.cc:993] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a: : Instructing follower d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:06.715847 30618 raft_consensus.cc:1081] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Signalling peer d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:06.718851 30431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:22:06.719962 30431 raft_consensus.cc:493] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:06.720355 30431 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.723726 30618 consensus_queue.cc:1048] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.727174 30431 raft_consensus.cc:515] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.737855 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:06.738451 30357 raft_consensus.cc:3055] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.738771 30357 raft_consensus.cc:740] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:06.739615 30357 consensus_queue.cc:260] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.740690 30357 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.746883 30357 raft_consensus.cc:2468] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 2.
I20260709 12:22:06.748787 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:06.749372 30506 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.749292 30398 leader_election.cc:304] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:06.748227 30431 leader_election.cc:290] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 2 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.750154 30576 raft_consensus.cc:2804] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.750638 30576 raft_consensus.cc:697] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:06.751498 30576 consensus_queue.cc:237] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.758780 30255 catalog_manager.cc:5697] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 1 to 2, leader changed from 29cc21419db14e998c13bc337993ee3a (127.29.131.193) to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.761044 30506 raft_consensus.cc:2468] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 2.
I20260709 12:22:06.919055 30574 raft_consensus.cc:993] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a: : Instructing follower d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:06.919611 30618 raft_consensus.cc:1081] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Signalling peer d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:06.921233 30431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:22:06.921722 30431 raft_consensus.cc:493] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:06.922192 30431 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.928200 30431 raft_consensus.cc:515] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.930109 30431 leader_election.cc:290] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 2 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.931205 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:06.931485 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:06.931882 30357 raft_consensus.cc:3055] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.932116 30506 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.932252 30357 raft_consensus.cc:740] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:06.933147 30357 consensus_queue.cc:260] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.934619 30357 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.938823 30506 raft_consensus.cc:2468] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 2.
I20260709 12:22:06.939913 30398 leader_election.cc:304] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:06.940582 30598 raft_consensus.cc:2804] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.941044 30598 raft_consensus.cc:697] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:06.941902 30598 consensus_queue.cc:237] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.945739 30357 raft_consensus.cc:2468] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 2.
I20260709 12:22:06.949318 30255 catalog_manager.cc:5697] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 1 to 2, leader changed from 29cc21419db14e998c13bc337993ee3a (127.29.131.193) to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.979939 30605 raft_consensus.cc:993] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5: : Instructing follower 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:06.980696 30598 raft_consensus.cc:1081] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Signalling peer 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:06.982466 30357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59240ea650c439eba226913c6312bf8"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:50316
I20260709 12:22:06.983018 30357 raft_consensus.cc:493] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:06.983395 30357 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.990302 30357 raft_consensus.cc:515] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.992424 30357 leader_election.cc:290] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 2 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:06.993572 30431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:06.993804 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:06.994415 30506 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.994390 30431 raft_consensus.cc:3055] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.995155 30431 raft_consensus.cc:740] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:06.996258 30431 consensus_queue.cc:260] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:06.997663 30431 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.003077 30506 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 2.
I20260709 12:22:07.004431 30323 leader_election.cc:304] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:07.005259 30618 raft_consensus.cc:2804] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:07.005735 30618 raft_consensus.cc:697] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:07.006490 30618 consensus_queue.cc:237] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:07.007519 30431 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 2.
I20260709 12:22:07.016362 30255 catalog_manager.cc:5697] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 1 to 2, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 2 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.081079 30576 raft_consensus.cc:993] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5: : Instructing follower 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:07.081624 30598 raft_consensus.cc:1081] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Signalling peer 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:07.083614 30357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:50316
I20260709 12:22:07.084463 30357 raft_consensus.cc:493] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:07.085063 30357 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.092654 30357 raft_consensus.cc:515] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:07.094790 30357 leader_election.cc:290] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 2 election: Requested vote from peers cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:07.096153 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:07.096439 30431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:07.096797 30506 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.097009 30431 raft_consensus.cc:3055] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:07.097376 30431 raft_consensus.cc:740] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:07.098222 30431 consensus_queue.cc:260] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:07.099555 30431 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.103912 30506 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 2.
I20260709 12:22:07.105491 30323 leader_election.cc:304] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:07.107342 30618 raft_consensus.cc:2804] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:07.106840 30431 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 2.
I20260709 12:22:07.108050 30618 raft_consensus.cc:697] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:07.109187 30618 consensus_queue.cc:237] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:07.117529 30255 catalog_manager.cc:5697] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 1 to 2, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 2 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.155409 30357 raft_consensus.cc:1275] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.156890 30598 consensus_queue.cc:1048] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.167754 30506 raft_consensus.cc:1275] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.169278 30598 consensus_queue.cc:1048] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:07.175964 30507 raft_consensus.cc:3060] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.183048 30507 raft_consensus.cc:1275] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.184510 30598 consensus_queue.cc:1048] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.193274 30357 raft_consensus.cc:1275] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.194857 30605 consensus_queue.cc:1048] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:07.248164 30431 raft_consensus.cc:1275] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.249747 30618 consensus_queue.cc:1048] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.258844 30507 raft_consensus.cc:1275] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.260500 30557 consensus_queue.cc:1048] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.392002 30507 raft_consensus.cc:1275] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.393373 30598 consensus_queue.cc:1048] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.401575 30357 raft_consensus.cc:1275] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.403323 30605 consensus_queue.cc:1048] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.418812 30431 raft_consensus.cc:1275] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.420023 30557 consensus_queue.cc:1048] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.427470 30507 raft_consensus.cc:1275] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.429420 30618 consensus_queue.cc:1048] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.666738 30507 raft_consensus.cc:1275] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.668094 30574 consensus_queue.cc:1048] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.676268 30431 raft_consensus.cc:1275] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.677798 30618 consensus_queue.cc:1048] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:09.641534 30223 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:22:09.642333 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:09.662328 30431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "cc52c3053f72413aa6ae449985724403"
 from {username='slave'} at 127.0.0.1:57024
I20260709 12:22:09.662782 30431 raft_consensus.cc:606] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Received request to transfer leadership to TS cc52c3053f72413aa6ae449985724403
I20260709 12:22:09.672737 30357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59240ea650c439eba226913c6312bf8"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
mode: GRACEFUL
new_leader_uuid: "cc52c3053f72413aa6ae449985724403"
 from {username='slave'} at 127.0.0.1:50326
I20260709 12:22:09.673205 30357 raft_consensus.cc:606] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Received request to transfer leadership to TS cc52c3053f72413aa6ae449985724403
I20260709 12:22:09.674175 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:09.674564 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:09.883446 30646 raft_consensus.cc:993] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5: : Instructing follower cc52c3053f72413aa6ae449985724403 to start an election
I20260709 12:22:09.883924 30605 raft_consensus.cc:1081] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Signalling peer cc52c3053f72413aa6ae449985724403 to start an election
I20260709 12:22:09.885159 30647 raft_consensus.cc:993] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a: : Instructing follower cc52c3053f72413aa6ae449985724403 to start an election
I20260709 12:22:09.885669 30642 raft_consensus.cc:1081] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Signalling peer cc52c3053f72413aa6ae449985724403 to start an election
I20260709 12:22:09.885670 30507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127"
dest_uuid: "cc52c3053f72413aa6ae449985724403"
 from {username='slave'} at 127.0.0.1:57814
I20260709 12:22:09.886345 30507 raft_consensus.cc:493] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:09.886731 30507 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.887441 30506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59240ea650c439eba226913c6312bf8"
dest_uuid: "cc52c3053f72413aa6ae449985724403"
 from {username='slave'} at 127.0.0.1:57824
I20260709 12:22:09.887904 30506 raft_consensus.cc:493] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:09.888265 30506 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.891592 30507 raft_consensus.cc:515] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:09.892434 30506 raft_consensus.cc:515] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:09.893293 30507 leader_election.cc:290] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:09.893944 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:09.894534 30357 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.894340 30431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:09.894965 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:09.895077 30431 raft_consensus.cc:3055] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:09.895471 30431 raft_consensus.cc:740] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:09.895530 30358 raft_consensus.cc:3055] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:09.895931 30358 raft_consensus.cc:740] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:09.894330 30506 leader_election.cc:290] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:09.896368 30431 consensus_queue.cc:260] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:09.896767 30358 consensus_queue.cc:260] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:09.897421 30431 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.895845 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:09.897914 30358 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.898320 30433 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.900411 30357 raft_consensus.cc:2468] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 3.
I20260709 12:22:09.901610 30472 leader_election.cc:304] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:09.902493 30555 raft_consensus.cc:2804] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:09.904112 30431 raft_consensus.cc:2468] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 3.
I20260709 12:22:09.904672 30433 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 3.
I20260709 12:22:09.904711 30358 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 3.
I20260709 12:22:09.906191 30472 leader_election.cc:304] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:09.906348 30555 raft_consensus.cc:697] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Becoming Leader. State: Replica: cc52c3053f72413aa6ae449985724403, State: Running, Role: LEADER
I20260709 12:22:09.907269 30555 consensus_queue.cc:237] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:09.907793 30648 raft_consensus.cc:2804] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:09.908272 30648 raft_consensus.cc:697] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Becoming Leader. State: Replica: cc52c3053f72413aa6ae449985724403, State: Running, Role: LEADER
I20260709 12:22:09.909099 30648 consensus_queue.cc:237] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:09.918850 30255 catalog_manager.cc:5697] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 reported cstate change: term changed from 2 to 3, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to cc52c3053f72413aa6ae449985724403 (127.29.131.195). New cstate: current_term: 3 leader_uuid: "cc52c3053f72413aa6ae449985724403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:09.920038 30255 catalog_manager.cc:5697] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 reported cstate change: term changed from 2 to 3, leader changed from 29cc21419db14e998c13bc337993ee3a (127.29.131.193) to cc52c3053f72413aa6ae449985724403 (127.29.131.195). New cstate: current_term: 3 leader_uuid: "cc52c3053f72413aa6ae449985724403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:10.312959 30358 raft_consensus.cc:1275] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Refusing update from remote peer cc52c3053f72413aa6ae449985724403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:10.314062 30648 consensus_queue.cc:1048] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:10.323483 30433 raft_consensus.cc:1275] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Refusing update from remote peer cc52c3053f72413aa6ae449985724403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:10.325276 30648 consensus_queue.cc:1048] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:10.372064 30358 raft_consensus.cc:1275] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Refusing update from remote peer cc52c3053f72413aa6ae449985724403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:10.373319 30648 consensus_queue.cc:1048] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:10.381994 30433 raft_consensus.cc:1275] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Refusing update from remote peer cc52c3053f72413aa6ae449985724403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:10.386260 30555 consensus_queue.cc:1048] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:22:10.531873 30379 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 30226
W20260709 12:22:10.532687 30379 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 30289
W20260709 12:22:10.534235 30379 debug-util.cc:398] Leaking SignalData structure 0x7b08001fbf60 after lost signal to thread 30531
I20260709 12:22:10.675565 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:10.680672 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:10.681036 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:11.681943 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:11.686916 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:11.687335 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:12.688292 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:12.694128 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:12.694541 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:13.695755 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:13.700573 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:13.700886 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:14.701751 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:14.706667 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:14.706991 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:15.707916 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:15.713024 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:15.713337 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:16.714264 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.719962 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:16.720374 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:17.721304 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:17.726009 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:17.726413 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:18.727519 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:18.732568 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:18.732965 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:19.914492 30223 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:22:19.919117 30358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
mode: GRACEFUL
new_leader_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:50318
I20260709 12:22:19.919800 30358 raft_consensus.cc:606] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Received request to transfer leadership to TS d2c98bc202df4635baac4d52387620a5
I20260709 12:22:19.935460 30507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59240ea650c439eba226913c6312bf8"
dest_uuid: "cc52c3053f72413aa6ae449985724403"
mode: GRACEFUL
new_leader_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:42694
I20260709 12:22:19.935931 30507 raft_consensus.cc:606] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Received request to transfer leadership to TS d2c98bc202df4635baac4d52387620a5
I20260709 12:22:19.940593 30358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
mode: GRACEFUL
new_leader_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:50318
I20260709 12:22:19.941040 30358 raft_consensus.cc:606] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Received request to transfer leadership to TS d2c98bc202df4635baac4d52387620a5
I20260709 12:22:19.944299 30642 raft_consensus.cc:993] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a: : Instructing follower d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:19.944802 30676 raft_consensus.cc:1081] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Signalling peer d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:19.946063 30358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
mode: GRACEFUL
new_leader_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:50318
I20260709 12:22:19.946512 30433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:22:19.946586 30358 raft_consensus.cc:606] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Received request to transfer leadership to TS d2c98bc202df4635baac4d52387620a5
I20260709 12:22:19.947022 30433 raft_consensus.cc:493] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.947499 30433 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.953902 30433 raft_consensus.cc:515] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:19.954535 30507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127"
dest_uuid: "cc52c3053f72413aa6ae449985724403"
mode: GRACEFUL
new_leader_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:42694
I20260709 12:22:19.955057 30507 raft_consensus.cc:606] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Received request to transfer leadership to TS d2c98bc202df4635baac4d52387620a5
I20260709 12:22:19.955983 30433 leader_election.cc:290] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 2 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:19.956604 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:19.957369 30358 raft_consensus.cc:3055] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:19.957440 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:19.957974 30507 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.957893 30358 raft_consensus.cc:740] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:19.958953 30358 consensus_queue.cc:260] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:19.960253 30358 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.964433 30507 raft_consensus.cc:2468] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 2.
I20260709 12:22:19.965727 30398 leader_election.cc:304] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:19.966420 30358 raft_consensus.cc:2468] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 2.
I20260709 12:22:19.966531 30605 raft_consensus.cc:2804] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:19.969396 30605 raft_consensus.cc:697] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:19.970345 30605 consensus_queue.cc:237] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:19.980644 30255 catalog_manager.cc:5697] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 1 to 2, leader changed from 29cc21419db14e998c13bc337993ee3a (127.29.131.193) to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.031327 30642 raft_consensus.cc:993] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a: : Instructing follower d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:20.031872 30676 raft_consensus.cc:1081] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Signalling peer d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:20.033279 30433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:22:20.033656 30433 raft_consensus.cc:493] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.033879 30433 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.037627 30433 raft_consensus.cc:515] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:20.038937 30433 leader_election.cc:290] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 3 election: Requested vote from peers cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549), 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001)
I20260709 12:22:20.039799 30507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:20.040107 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:20.040560 30507 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.040664 30358 raft_consensus.cc:3055] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:20.040995 30358 raft_consensus.cc:740] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:20.041602 30358 consensus_queue.cc:260] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:20.042367 30358 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.046134 30358 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 3.
I20260709 12:22:20.046154 30507 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 3.
I20260709 12:22:20.047152 30398 leader_election.cc:304] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc52c3053f72413aa6ae449985724403, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:20.047735 30605 raft_consensus.cc:2804] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:20.048069 30605 raft_consensus.cc:697] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:20.048693 30605 consensus_queue.cc:237] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:20.054755 30255 catalog_manager.cc:5697] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 2 to 3, leader changed from 29cc21419db14e998c13bc337993ee3a (127.29.131.193) to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 3 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.161743 30642 raft_consensus.cc:993] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a: : Instructing follower d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:20.162267 30676 raft_consensus.cc:1081] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Signalling peer d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:20.162844 30684 raft_consensus.cc:993] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403: : Instructing follower d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:20.163362 30669 raft_consensus.cc:1081] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Signalling peer d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:20.163817 30431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:22:20.164289 30431 raft_consensus.cc:493] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.164696 30431 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.164801 30433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59240ea650c439eba226913c6312bf8"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:57004
I20260709 12:22:20.165318 30433 raft_consensus.cc:493] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.165663 30433 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.171486 30433 raft_consensus.cc:515] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.171454 30431 raft_consensus.cc:515] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.173627 30431 leader_election.cc:290] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 3 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:20.174224 30433 leader_election.cc:290] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 4 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:20.174283 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:20.174886 30358 raft_consensus.cc:3055] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:20.175164 30358 raft_consensus.cc:740] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:20.175323 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:20.175410 30357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:20.176074 30357 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.176017 30506 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.175931 30358 consensus_queue.cc:260] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.177124 30358 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.179656 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59240ea650c439eba226913c6312bf8" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:20.180243 30505 raft_consensus.cc:3055] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:20.180578 30505 raft_consensus.cc:740] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Running, Role: LEADER
I20260709 12:22:20.181443 30505 consensus_queue.cc:260] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.182963 30358 raft_consensus.cc:2468] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 3.
I20260709 12:22:20.183037 30357 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 4.
I20260709 12:22:20.183043 30505 raft_consensus.cc:3060] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.183696 30506 raft_consensus.cc:2468] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 3.
I20260709 12:22:20.184000 30398 leader_election.cc:304] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:20.184816 30605 raft_consensus.cc:2804] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:20.185305 30398 leader_election.cc:304] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:20.185285 30605 raft_consensus.cc:697] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:20.187569 30677 raft_consensus.cc:2804] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:20.187106 30605 consensus_queue.cc:237] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.191166 30505 raft_consensus.cc:2468] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 4.
I20260709 12:22:20.192543 30677 raft_consensus.cc:697] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 4 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:20.193849 30677 consensus_queue.cc:237] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.197594 30255 catalog_manager.cc:5697] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 2 to 3, leader changed from 29cc21419db14e998c13bc337993ee3a (127.29.131.193) to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 3 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.208643 30255 catalog_manager.cc:5697] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 3 to 4, leader changed from cc52c3053f72413aa6ae449985724403 (127.29.131.195) to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 4 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:20.316259 30528 debug-util.cc:398] Leaking SignalData structure 0x7b080016d060 after lost signal to thread 30226
W20260709 12:22:20.317188 30528 debug-util.cc:398] Leaking SignalData structure 0x7b080016d740 after lost signal to thread 30289
W20260709 12:22:20.317955 30528 debug-util.cc:398] Leaking SignalData structure 0x7b0800200bc0 after lost signal to thread 30382
W20260709 12:22:20.318673 30528 debug-util.cc:398] Leaking SignalData structure 0x7b08002003a0 after lost signal to thread 30457
W20260709 12:22:20.319371 30528 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4de0 after lost signal to thread 30531
I20260709 12:22:20.414366 30505 raft_consensus.cc:1275] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.415740 30677 consensus_queue.cc:1048] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:20.440842 30358 raft_consensus.cc:1275] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.442163 30685 consensus_queue.cc:1048] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:20.460863 30684 raft_consensus.cc:993] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403: : Instructing follower d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:20.461324 30669 raft_consensus.cc:1081] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Signalling peer d2c98bc202df4635baac4d52387620a5 to start an election
I20260709 12:22:20.463007 30433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
 from {username='slave'} at 127.0.0.1:57004
I20260709 12:22:20.463496 30433 raft_consensus.cc:493] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.463810 30433 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.467669 30433 raft_consensus.cc:515] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.469101 30433 leader_election.cc:290] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 4 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:20.469759 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:20.470352 30358 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.470222 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ed7fcd62e745338ed5097acd244127" candidate_uuid: "d2c98bc202df4635baac4d52387620a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:20.470927 30505 raft_consensus.cc:3055] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:20.471349 30505 raft_consensus.cc:740] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc52c3053f72413aa6ae449985724403, State: Running, Role: LEADER
I20260709 12:22:20.472275 30505 consensus_queue.cc:260] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.473738 30505 raft_consensus.cc:3060] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.474412 30358 raft_consensus.cc:2468] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 4.
I20260709 12:22:20.475315 30398 leader_election.cc:304] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5; no voters: 
I20260709 12:22:20.475925 30685 raft_consensus.cc:2804] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:20.476327 30685 raft_consensus.cc:697] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 4 LEADER]: Becoming Leader. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:20.477080 30685 consensus_queue.cc:237] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:20.481876 30505 raft_consensus.cc:2468] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c98bc202df4635baac4d52387620a5 in term 4.
I20260709 12:22:20.484368 30254 catalog_manager.cc:5697] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 reported cstate change: term changed from 3 to 4, leader changed from cc52c3053f72413aa6ae449985724403 (127.29.131.195) to d2c98bc202df4635baac4d52387620a5 (127.29.131.194). New cstate: current_term: 4 leader_uuid: "d2c98bc202df4635baac4d52387620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.522132 30358 raft_consensus.cc:1275] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:20.523301 30685 consensus_queue.cc:1048] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:20.533954 30505 raft_consensus.cc:1275] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:20.535322 30677 consensus_queue.cc:1048] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:20.631094 30358 raft_consensus.cc:1275] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:20.632584 30677 consensus_queue.cc:1048] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:20.649397 30505 raft_consensus.cc:1275] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:20.650429 30507 raft_consensus.cc:1275] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:20.653180 30605 consensus_queue.cc:1048] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:20.653853 30685 consensus_queue.cc:1048] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:20.669364 30358 raft_consensus.cc:1275] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:20.671963 30605 consensus_queue.cc:1048] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:20.996838 30506 raft_consensus.cc:1275] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:20.998003 30605 consensus_queue.cc:1048] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.008522 30358 raft_consensus.cc:1275] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Refusing update from remote peer d2c98bc202df4635baac4d52387620a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.011245 30685 consensus_queue.cc:1048] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:22.998378 30223 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:22:22.999172 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:23.006120 30433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5262935333334c13a0fb8740514abfae"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:57024
I20260709 12:22:23.006731 30433 raft_consensus.cc:606] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Received request to transfer leadership to TS 29cc21419db14e998c13bc337993ee3a
I20260709 12:22:23.009338 30433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:57024
I20260709 12:22:23.009704 30433 raft_consensus.cc:606] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Received request to transfer leadership to TS 29cc21419db14e998c13bc337993ee3a
I20260709 12:22:23.011996 30433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "cc52c3053f72413aa6ae449985724403"
 from {username='slave'} at 127.0.0.1:57024
I20260709 12:22:23.012364 30433 raft_consensus.cc:606] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Received request to transfer leadership to TS cc52c3053f72413aa6ae449985724403
I20260709 12:22:23.014338 30433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:57024
I20260709 12:22:23.014784 30433 raft_consensus.cc:606] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Received request to transfer leadership to TS 29cc21419db14e998c13bc337993ee3a
I20260709 12:22:23.017087 30433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1"
dest_uuid: "d2c98bc202df4635baac4d52387620a5"
mode: GRACEFUL
new_leader_uuid: "cc52c3053f72413aa6ae449985724403"
 from {username='slave'} at 127.0.0.1:57024
I20260709 12:22:23.017534 30433 raft_consensus.cc:606] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Received request to transfer leadership to TS cc52c3053f72413aa6ae449985724403
I20260709 12:22:23.018486 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:23.018965 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:23.244612 30705 raft_consensus.cc:993] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5: : Instructing follower 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:23.245110 30685 raft_consensus.cc:1081] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Signalling peer 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:23.246541 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5262935333334c13a0fb8740514abfae"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:50316
I20260709 12:22:23.246996 30358 raft_consensus.cc:493] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.247372 30358 raft_consensus.cc:3060] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.252048 30358 raft_consensus.cc:515] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.254012 30358 leader_election.cc:290] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 2 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:23.254971 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5262935333334c13a0fb8740514abfae" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:23.255486 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5262935333334c13a0fb8740514abfae" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:23.255708 30433 raft_consensus.cc:3055] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:23.256068 30506 raft_consensus.cc:3060] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.256052 30433 raft_consensus.cc:740] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:23.256907 30433 consensus_queue.cc:260] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.257867 30433 raft_consensus.cc:3060] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.260545 30506 raft_consensus.cc:2468] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 2.
I20260709 12:22:23.261655 30323 leader_election.cc:304] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:23.262336 30433 raft_consensus.cc:2468] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 2.
I20260709 12:22:23.263311 30706 raft_consensus.cc:2804] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:23.264191 30706 raft_consensus.cc:697] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:23.264904 30706 consensus_queue.cc:237] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.272257 30253 catalog_manager.cc:5697] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 1 to 2, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 2 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.365517 30705 raft_consensus.cc:993] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5: : Instructing follower 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:23.365972 30685 raft_consensus.cc:1081] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Signalling peer 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:23.367396 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:50316
I20260709 12:22:23.367841 30358 raft_consensus.cc:493] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.368098 30358 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.372464 30358 raft_consensus.cc:515] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.373988 30358 leader_election.cc:290] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 3 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:23.374800 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:23.374971 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:23.375357 30433 raft_consensus.cc:3055] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:23.375408 30506 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.375748 30433 raft_consensus.cc:740] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:23.376478 30433 consensus_queue.cc:260] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.377550 30433 raft_consensus.cc:3060] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.381181 30506 raft_consensus.cc:2468] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 3.
I20260709 12:22:23.382110 30323 leader_election.cc:304] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:23.382797 30706 raft_consensus.cc:2804] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:23.383335 30706 raft_consensus.cc:697] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 3 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:23.383380 30433 raft_consensus.cc:2468] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 3.
I20260709 12:22:23.384327 30706 consensus_queue.cc:237] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.391506 30253 catalog_manager.cc:5697] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 2 to 3, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 3 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.400242 30705 raft_consensus.cc:993] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: : Instructing follower 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:23.400660 30685 raft_consensus.cc:1081] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Signalling peer 29cc21419db14e998c13bc337993ee3a to start an election
I20260709 12:22:23.401856 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9"
dest_uuid: "29cc21419db14e998c13bc337993ee3a"
 from {username='slave'} at 127.0.0.1:50316
I20260709 12:22:23.402248 30358 raft_consensus.cc:493] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.402518 30358 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.407218 30358 raft_consensus.cc:515] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.409041 30358 leader_election.cc:290] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 4 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), cc52c3053f72413aa6ae449985724403 (127.29.131.195:37549)
I20260709 12:22:23.409643 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:23.410002 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68abcbb9921e4440ad16d1f418ed71f9" candidate_uuid: "29cc21419db14e998c13bc337993ee3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc52c3053f72413aa6ae449985724403"
I20260709 12:22:23.410223 30433 raft_consensus.cc:3055] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:23.410607 30433 raft_consensus.cc:740] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:23.410637 30506 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.411386 30433 consensus_queue.cc:260] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.412220 30433 raft_consensus.cc:3060] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.415122 30506 raft_consensus.cc:2468] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 4.
I20260709 12:22:23.416394 30323 leader_election.cc:304] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:23.416589 30433 raft_consensus.cc:2468] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cc21419db14e998c13bc337993ee3a in term 4.
I20260709 12:22:23.417140 30706 raft_consensus.cc:2804] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:23.417629 30706 raft_consensus.cc:697] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 4 LEADER]: Becoming Leader. State: Replica: 29cc21419db14e998c13bc337993ee3a, State: Running, Role: LEADER
I20260709 12:22:23.418493 30706 consensus_queue.cc:237] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.426018 30253 catalog_manager.cc:5697] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a reported cstate change: term changed from 3 to 4, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to 29cc21419db14e998c13bc337993ee3a (127.29.131.193). New cstate: current_term: 4 leader_uuid: "29cc21419db14e998c13bc337993ee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.463805 30705 raft_consensus.cc:993] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5: : Instructing follower cc52c3053f72413aa6ae449985724403 to start an election
I20260709 12:22:23.464241 30685 raft_consensus.cc:1081] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Signalling peer cc52c3053f72413aa6ae449985724403 to start an election
I20260709 12:22:23.465764 30506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1"
dest_uuid: "cc52c3053f72413aa6ae449985724403"
 from {username='slave'} at 127.0.0.1:57814
I20260709 12:22:23.466275 30506 raft_consensus.cc:493] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.466567 30506 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.470472 30506 raft_consensus.cc:515] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.472519 30506 leader_election.cc:290] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 election: Requested vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:23.473439 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:23.473536 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defacb680fba447cacf93d2801f18eb1" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:23.473855 30433 raft_consensus.cc:3055] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:23.474047 30358 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.474140 30433 raft_consensus.cc:740] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:23.474782 30433 consensus_queue.cc:260] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.475579 30433 raft_consensus.cc:3060] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.477960 30358 raft_consensus.cc:2468] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 3.
I20260709 12:22:23.479017 30472 leader_election.cc:304] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:23.479391 30433 raft_consensus.cc:2468] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 3.
I20260709 12:22:23.479801 30703 raft_consensus.cc:2804] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:23.480911 30703 raft_consensus.cc:697] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Becoming Leader. State: Replica: cc52c3053f72413aa6ae449985724403, State: Running, Role: LEADER
I20260709 12:22:23.481714 30703 consensus_queue.cc:237] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:23.488749 30253 catalog_manager.cc:5697] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 reported cstate change: term changed from 2 to 3, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to cc52c3053f72413aa6ae449985724403 (127.29.131.195). New cstate: current_term: 3 leader_uuid: "cc52c3053f72413aa6ae449985724403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:23.542847 30705 raft_consensus.cc:993] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5: : Instructing follower cc52c3053f72413aa6ae449985724403 to start an election
I20260709 12:22:23.543332 30685 raft_consensus.cc:1081] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Signalling peer cc52c3053f72413aa6ae449985724403 to start an election
I20260709 12:22:23.544677 30506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732"
dest_uuid: "cc52c3053f72413aa6ae449985724403"
 from {username='slave'} at 127.0.0.1:57814
I20260709 12:22:23.545143 30506 raft_consensus.cc:493] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.545437 30506 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.549577 30506 raft_consensus.cc:515] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:23.550971 30506 leader_election.cc:290] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 4 election: Requested vote from peers d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717), 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001)
I20260709 12:22:23.551805 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d2c98bc202df4635baac4d52387620a5"
I20260709 12:22:23.552275 30433 raft_consensus.cc:3055] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:23.552210 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746f11f09ab84d68afd5bc9439698732" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "29cc21419db14e998c13bc337993ee3a"
I20260709 12:22:23.552635 30433 raft_consensus.cc:740] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d2c98bc202df4635baac4d52387620a5, State: Running, Role: LEADER
I20260709 12:22:23.552904 30358 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.553383 30433 consensus_queue.cc:260] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:23.554275 30433 raft_consensus.cc:3060] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.557323 30358 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 4.
I20260709 12:22:23.558269 30433 raft_consensus.cc:2468] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc52c3053f72413aa6ae449985724403 in term 4.
I20260709 12:22:23.558297 30472 leader_election.cc:304] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cc21419db14e998c13bc337993ee3a, cc52c3053f72413aa6ae449985724403; no voters: 
I20260709 12:22:23.559224 30703 raft_consensus.cc:2804] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:23.559679 30703 raft_consensus.cc:697] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 4 LEADER]: Becoming Leader. State: Replica: cc52c3053f72413aa6ae449985724403, State: Running, Role: LEADER
I20260709 12:22:23.560417 30703 consensus_queue.cc:237] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } }
I20260709 12:22:23.567282 30253 catalog_manager.cc:5697] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 reported cstate change: term changed from 3 to 4, leader changed from d2c98bc202df4635baac4d52387620a5 (127.29.131.194) to cc52c3053f72413aa6ae449985724403 (127.29.131.195). New cstate: current_term: 4 leader_uuid: "cc52c3053f72413aa6ae449985724403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.821290 30506 raft_consensus.cc:1275] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:23.822583 30706 consensus_queue.cc:1048] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:23.835736 30433 raft_consensus.cc:1275] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:23.837385 30720 consensus_queue.cc:1048] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:23.852396 30433 raft_consensus.cc:1275] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:23.853623 30720 consensus_queue.cc:1048] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:23.861572 30506 raft_consensus.cc:1275] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:23.863384 30707 consensus_queue.cc:1048] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:23.866933 30433 raft_consensus.cc:1275] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:23.868168 30707 consensus_queue.cc:1048] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:23.874292 30506 raft_consensus.cc:1275] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Refusing update from remote peer 29cc21419db14e998c13bc337993ee3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:23.876297 30720 consensus_queue.cc:1048] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:24.008971 30358 raft_consensus.cc:1275] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Refusing update from remote peer cc52c3053f72413aa6ae449985724403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:24.010612 30703 consensus_queue.cc:1048] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:24.020231 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:24.022409 30433 raft_consensus.cc:1275] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Refusing update from remote peer cc52c3053f72413aa6ae449985724403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:24.024212 30715 consensus_queue.cc:1048] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:24.027848 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:24.028446 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:24.117435 30358 raft_consensus.cc:1275] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Refusing update from remote peer cc52c3053f72413aa6ae449985724403: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:24.118572 30703 consensus_queue.cc:1048] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:24.127298 30433 raft_consensus.cc:1275] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Refusing update from remote peer cc52c3053f72413aa6ae449985724403: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:24.128527 30729 consensus_queue.cc:1048] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:25.029615 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:25.034838 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:25.035216 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:26.036592 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.043627 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:26.044106 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:27.045187 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:27.050382 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:27.050801 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:28.051781 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:28.056644 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:28.057070 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.058164 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.063014 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:29.063452 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:30.064400 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.069554 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:30.069990 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:31.070982 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:31.076274 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:31.076704 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:32.077760 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:32.083823 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:32.084235 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:33.495185 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:38717, user_credentials={real_user=slave}} blocked reactor thread for 154905us
I20260709 12:22:33.530435 30744 raft_consensus.cc:493] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29cc21419db14e998c13bc337993ee3a)
I20260709 12:22:33.531566 30744 raft_consensus.cc:515] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:33.553386 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29cc21419db14e998c13bc337993ee3a" is_pre_election: true
I20260709 12:22:33.553707 30744 leader_election.cc:290] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
I20260709 12:22:33.555711 30433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6ecdbf6db1474690c5e0be60b955da" candidate_uuid: "cc52c3053f72413aa6ae449985724403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2c98bc202df4635baac4d52387620a5" is_pre_election: true
I20260709 12:22:33.557739 30472 leader_election.cc:304] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:33.558485 30744 raft_consensus.cc:2749] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:34.072633 30223 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:22:34.073189 30223 tablet_server.cc:179] TabletServer@127.29.131.193:0 shutting down...
I20260709 12:22:34.095109 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:34.095947 30223 tablet_replica.cc:333] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.096748 30223 raft_consensus.cc:2243] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:34.097648 30223 raft_consensus.cc:2272] T 5262935333334c13a0fb8740514abfae P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.100107 30223 tablet_replica.cc:333] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.100636 30223 raft_consensus.cc:2243] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:34.101393 30223 raft_consensus.cc:2272] T 68abcbb9921e4440ad16d1f418ed71f9 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.102975 30223 tablet_replica.cc:333] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.103686 30223 raft_consensus.cc:2243] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.104200 30223 raft_consensus.cc:2272] T 50e034430956467f93416ac8d3d1b356 P 29cc21419db14e998c13bc337993ee3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.105846 30223 tablet_replica.cc:333] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.106385 30223 raft_consensus.cc:2243] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.106796 30223 raft_consensus.cc:2272] T 49ed7fcd62e745338ed5097acd244127 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.108408 30223 tablet_replica.cc:333] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.108884 30223 raft_consensus.cc:2243] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.109324 30223 raft_consensus.cc:2272] T b59240ea650c439eba226913c6312bf8 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.110852 30223 tablet_replica.cc:333] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.111366 30223 raft_consensus.cc:2243] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:34.112067 30223 raft_consensus.cc:2272] T da6ecdbf6db1474690c5e0be60b955da P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.114084 30223 tablet_replica.cc:333] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.114548 30223 raft_consensus.cc:2243] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.114921 30223 raft_consensus.cc:2272] T d064970d90a949dabc49765e15177f87 P 29cc21419db14e998c13bc337993ee3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.116631 30223 tablet_replica.cc:333] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.117097 30223 raft_consensus.cc:2243] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.117537 30223 raft_consensus.cc:2272] T defacb680fba447cacf93d2801f18eb1 P 29cc21419db14e998c13bc337993ee3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.119058 30223 tablet_replica.cc:333] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a: stopping tablet replica
I20260709 12:22:34.119524 30223 raft_consensus.cc:2243] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.119935 30223 raft_consensus.cc:2272] T 746f11f09ab84d68afd5bc9439698732 P 29cc21419db14e998c13bc337993ee3a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.225751 30223 tablet_server.cc:196] TabletServer@127.29.131.193:0 shutdown complete.
W20260709 12:22:34.229202 30454 debug-util.cc:398] Leaking SignalData structure 0x7b080012d060 after lost signal to thread 30226
W20260709 12:22:34.230122 30454 debug-util.cc:398] Leaking SignalData structure 0x7b080012d740 after lost signal to thread 30289
W20260709 12:22:34.231055 30454 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc3e0 after lost signal to thread 30382
W20260709 12:22:34.231961 30454 debug-util.cc:398] Leaking SignalData structure 0x7b08001243e0 after lost signal to thread 30457
W20260709 12:22:34.232719 30454 debug-util.cc:398] Leaking SignalData structure 0x7b08001e14e0 after lost signal to thread 30531
I20260709 12:22:34.246891 30223 tablet_server.cc:179] TabletServer@127.29.131.194:0 shutting down...
I20260709 12:22:34.285179 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:34.286121 30223 tablet_replica.cc:333] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.287061 30223 raft_consensus.cc:2243] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.287767 30223 raft_consensus.cc:2272] T 5262935333334c13a0fb8740514abfae P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.290575 30223 tablet_replica.cc:333] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.291404 30223 raft_consensus.cc:2243] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.291961 30223 raft_consensus.cc:2272] T 746f11f09ab84d68afd5bc9439698732 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.294384 30223 tablet_replica.cc:333] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.295186 30223 raft_consensus.cc:2243] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.295789 30223 raft_consensus.cc:2272] T da6ecdbf6db1474690c5e0be60b955da P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.298319 30223 tablet_replica.cc:333] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.299024 30223 raft_consensus.cc:2243] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.299551 30223 raft_consensus.cc:2272] T d064970d90a949dabc49765e15177f87 P d2c98bc202df4635baac4d52387620a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.301914 30223 tablet_replica.cc:333] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.302603 30223 raft_consensus.cc:2243] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.303188 30223 raft_consensus.cc:2272] T defacb680fba447cacf93d2801f18eb1 P d2c98bc202df4635baac4d52387620a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.305689 30223 tablet_replica.cc:333] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.306394 30223 raft_consensus.cc:2243] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:34.307480 30223 raft_consensus.cc:2272] T 50e034430956467f93416ac8d3d1b356 P d2c98bc202df4635baac4d52387620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.309998 30223 tablet_replica.cc:333] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.310716 30223 raft_consensus.cc:2243] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:34.311928 30223 raft_consensus.cc:2272] T 49ed7fcd62e745338ed5097acd244127 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.314383 30223 tablet_replica.cc:333] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.315073 30223 raft_consensus.cc:2243] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:34.316215 30223 raft_consensus.cc:2272] T b59240ea650c439eba226913c6312bf8 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.318687 30223 tablet_replica.cc:333] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5: stopping tablet replica
I20260709 12:22:34.319394 30223 raft_consensus.cc:2243] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.319948 30223 raft_consensus.cc:2272] T 68abcbb9921e4440ad16d1f418ed71f9 P d2c98bc202df4635baac4d52387620a5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:34.390887 30472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111)
W20260709 12:22:34.394555 30472 consensus_peers.cc:597] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 -> Peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Couldn't send request to peer d2c98bc202df4635baac4d52387620a5. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:34.476853 30472 consensus_peers.cc:597] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 -> Peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Couldn't send request to peer 29cc21419db14e998c13bc337993ee3a. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:34.490752 30472 consensus_peers.cc:597] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 -> Peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Couldn't send request to peer d2c98bc202df4635baac4d52387620a5. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:34.521034 30472 consensus_peers.cc:597] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 -> Peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Couldn't send request to peer 29cc21419db14e998c13bc337993ee3a. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:34.596002 30472 consensus_peers.cc:597] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 -> Peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Couldn't send request to peer d2c98bc202df4635baac4d52387620a5. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:34.687911 30472 consensus_peers.cc:597] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 -> Peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Couldn't send request to peer 29cc21419db14e998c13bc337993ee3a. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:35.352913 30223 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30454)
I20260709 12:22:35.385123 30753 raft_consensus.cc:493] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2c98bc202df4635baac4d52387620a5)
I20260709 12:22:35.385655 30753 raft_consensus.cc:515] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:35.387475 30753 leader_election.cc:290] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
W20260709 12:22:35.392139 30472 leader_election.cc:336] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111)
W20260709 12:22:35.392781 30472 leader_election.cc:336] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111)
I20260709 12:22:35.393069 30472 leader_election.cc:304] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:35.393656 30753 raft_consensus.cc:2749] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.422585 30753 raft_consensus.cc:493] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2c98bc202df4635baac4d52387620a5)
I20260709 12:22:35.423043 30753 raft_consensus.cc:515] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:35.424703 30753 leader_election.cc:290] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
W20260709 12:22:35.428695 30472 leader_election.cc:336] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111)
W20260709 12:22:35.429384 30472 leader_election.cc:336] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111)
I20260709 12:22:35.429832 30472 leader_election.cc:304] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:35.430514 30753 raft_consensus.cc:2749] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.501021 30753 raft_consensus.cc:493] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29cc21419db14e998c13bc337993ee3a)
I20260709 12:22:35.501672 30753 raft_consensus.cc:515] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:35.503400 30753 leader_election.cc:290] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
W20260709 12:22:35.507288 30472 leader_election.cc:336] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111)
W20260709 12:22:35.507979 30472 leader_election.cc:336] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111)
I20260709 12:22:35.508370 30472 leader_election.cc:304] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:35.509096 30753 raft_consensus.cc:2749] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.532994 30753 raft_consensus.cc:493] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 29cc21419db14e998c13bc337993ee3a)
I20260709 12:22:35.533469 30753 raft_consensus.cc:515] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:35.535209 30753 leader_election.cc:290] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
W20260709 12:22:35.538921 30472 leader_election.cc:336] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111)
W20260709 12:22:35.539638 30472 leader_election.cc:336] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111)
I20260709 12:22:35.540068 30472 leader_election.cc:304] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:35.540763 30753 raft_consensus.cc:2749] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.567292 30753 raft_consensus.cc:493] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29cc21419db14e998c13bc337993ee3a)
I20260709 12:22:35.567745 30753 raft_consensus.cc:515] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:35.569471 30753 leader_election.cc:290] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
W20260709 12:22:35.573787 30472 leader_election.cc:336] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111)
W20260709 12:22:35.574551 30472 leader_election.cc:336] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111)
I20260709 12:22:35.574852 30472 leader_election.cc:304] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:35.575460 30753 raft_consensus.cc:2749] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:35.606930 30753 raft_consensus.cc:493] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d2c98bc202df4635baac4d52387620a5)
I20260709 12:22:35.607450 30753 raft_consensus.cc:515] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cc21419db14e998c13bc337993ee3a" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 34001 } } peers { permanent_uuid: "d2c98bc202df4635baac4d52387620a5" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 38717 } } peers { permanent_uuid: "cc52c3053f72413aa6ae449985724403" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37549 } }
I20260709 12:22:35.609524 30753 leader_election.cc:290] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001), d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717)
W20260709 12:22:35.614908 30472 leader_election.cc:336] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111)
W20260709 12:22:35.615615 30472 leader_election.cc:336] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2c98bc202df4635baac4d52387620a5 (127.29.131.194:38717): Network error: Client connection negotiation failed: client connection to 127.29.131.194:38717: connect: Connection refused (error 111)
I20260709 12:22:35.616015 30472 leader_election.cc:304] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc52c3053f72413aa6ae449985724403; no voters: 29cc21419db14e998c13bc337993ee3a, d2c98bc202df4635baac4d52387620a5
I20260709 12:22:35.616822 30753 raft_consensus.cc:2749] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:36.353459 30223 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30454)
I20260709 12:22:36.640617 30223 tablet_server.cc:196] TabletServer@127.29.131.194:0 shutdown complete.
I20260709 12:22:36.659130 30223 tablet_server.cc:179] TabletServer@127.29.131.195:0 shutting down...
W20260709 12:22:36.684933 30472 consensus_peers.cc:597] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 -> Peer 29cc21419db14e998c13bc337993ee3a (127.29.131.193:34001): Couldn't send request to peer 29cc21419db14e998c13bc337993ee3a. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:34001: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:36.687103 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:36.687875 30223 tablet_replica.cc:333] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.688726 30223 raft_consensus.cc:2243] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:36.689431 30223 raft_consensus.cc:2272] T 746f11f09ab84d68afd5bc9439698732 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.691807 30223 tablet_replica.cc:333] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.692517 30223 raft_consensus.cc:2243] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:36.693100 30223 raft_consensus.cc:2272] T 5262935333334c13a0fb8740514abfae P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.694832 30223 tablet_replica.cc:333] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.695393 30223 raft_consensus.cc:2243] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:36.695848 30223 raft_consensus.cc:2272] T 68abcbb9921e4440ad16d1f418ed71f9 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.697369 30223 tablet_replica.cc:333] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.697846 30223 raft_consensus.cc:2243] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:36.698257 30223 raft_consensus.cc:2272] T 49ed7fcd62e745338ed5097acd244127 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.699733 30223 tablet_replica.cc:333] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.700172 30223 raft_consensus.cc:2243] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:36.700542 30223 raft_consensus.cc:2272] T 50e034430956467f93416ac8d3d1b356 P cc52c3053f72413aa6ae449985724403 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.702240 30223 tablet_replica.cc:333] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.702672 30223 raft_consensus.cc:2243] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:36.703052 30223 raft_consensus.cc:2272] T b59240ea650c439eba226913c6312bf8 P cc52c3053f72413aa6ae449985724403 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.704751 30223 tablet_replica.cc:333] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.705201 30223 raft_consensus.cc:2243] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:36.705906 30223 raft_consensus.cc:2272] T defacb680fba447cacf93d2801f18eb1 P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.707391 30223 tablet_replica.cc:333] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.707806 30223 raft_consensus.cc:2243] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:36.708467 30223 raft_consensus.cc:2272] T d064970d90a949dabc49765e15177f87 P cc52c3053f72413aa6ae449985724403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.710105 30223 tablet_replica.cc:333] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403: stopping tablet replica
I20260709 12:22:36.710551 30223 raft_consensus.cc:2243] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:36.710940 30223 raft_consensus.cc:2272] T da6ecdbf6db1474690c5e0be60b955da P cc52c3053f72413aa6ae449985724403 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:36.955610 30528 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4f40 after lost signal to thread 30226
W20260709 12:22:36.956343 30528 debug-util.cc:398] Leaking SignalData structure 0x7b0800200100 after lost signal to thread 30289
W20260709 12:22:36.957086 30528 debug-util.cc:398] Leaking SignalData structure 0x7b080016d120 after lost signal to thread 30531
I20260709 12:22:37.243427 30223 tablet_server.cc:196] TabletServer@127.29.131.195:0 shutdown complete.
I20260709 12:22:37.260340 30223 master.cc:562] Master@127.29.131.254:45817 shutting down...
I20260709 12:22:37.394392 30223 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.395020 30223 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.395396 30223 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0abd17b4d0c4461f997286298b3b8bcd: stopping tablet replica
I20260709 12:22:37.414665 30223 master.cc:584] Master@127.29.131.254:45817 shutdown complete.
29cc21419db14e998c13bc337993ee3a  4
cc52c3053f72413aa6ae449985724403  1
d2c98bc202df4635baac4d52387620a5  4
29cc21419db14e998c13bc337993ee3a  3
cc52c3053f72413aa6ae449985724403  3
d2c98bc202df4635baac4d52387620a5  3
29cc21419db14e998c13bc337993ee3a  0
cc52c3053f72413aa6ae449985724403  1
d2c98bc202df4635baac4d52387620a5  8
29cc21419db14e998c13bc337993ee3a  3
cc52c3053f72413aa6ae449985724403  3
d2c98bc202df4635baac4d52387620a5  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (34710 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:22:37.457520 30223 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.131.254:43641
I20260709 12:22:37.458681 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:37.464282 30756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:37.464291 30755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:37.466035 30758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:37.466827 30223 server_base.cc:1061] running on GCE node
I20260709 12:22:37.467869 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:37.468062 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:37.468236 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599757468205 us; error 0 us; skew 500 ppm
I20260709 12:22:37.468751 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:37.471037 30223 webserver.cc:533] Webserver started at http://127.29.131.254:44765/ using document root <none> and password file <none>
I20260709 12:22:37.471545 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:37.471736 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:37.472008 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:37.473114 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/master-0-root/instance:
uuid: "a6fdd4767e924392ae08ac137c3ab5ed"
format_stamp: "Formatted at 2026-07-09 12:22:37 on dist-test-slave-n640"
I20260709 12:22:37.477559 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:37.480860 30763 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.481570 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:22:37.481837 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/master-0-root
uuid: "a6fdd4767e924392ae08ac137c3ab5ed"
format_stamp: "Formatted at 2026-07-09 12:22:37 on dist-test-slave-n640"
I20260709 12:22:37.482115 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:37.499480 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:37.500713 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:37.539562 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.254:43641
I20260709 12:22:37.539618 30814 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.254:43641 every 8 connection(s)
I20260709 12:22:37.543591 30815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:37.552822 30815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed: Bootstrap starting.
I20260709 12:22:37.557438 30815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.561491 30815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed: No bootstrap required, opened a new log
I20260709 12:22:37.563635 30815 raft_consensus.cc:359] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6fdd4767e924392ae08ac137c3ab5ed" member_type: VOTER }
I20260709 12:22:37.564019 30815 raft_consensus.cc:385] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.564256 30815 raft_consensus.cc:740] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6fdd4767e924392ae08ac137c3ab5ed, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.564877 30815 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6fdd4767e924392ae08ac137c3ab5ed" member_type: VOTER }
I20260709 12:22:37.565335 30815 raft_consensus.cc:399] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:37.565563 30815 raft_consensus.cc:493] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:37.565864 30815 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.569780 30815 raft_consensus.cc:515] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6fdd4767e924392ae08ac137c3ab5ed" member_type: VOTER }
I20260709 12:22:37.570271 30815 leader_election.cc:304] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6fdd4767e924392ae08ac137c3ab5ed; no voters: 
I20260709 12:22:37.571429 30815 leader_election.cc:290] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:37.571797 30818 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.573066 30818 raft_consensus.cc:697] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 1 LEADER]: Becoming Leader. State: Replica: a6fdd4767e924392ae08ac137c3ab5ed, State: Running, Role: LEADER
I20260709 12:22:37.573740 30818 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6fdd4767e924392ae08ac137c3ab5ed" member_type: VOTER }
I20260709 12:22:37.574414 30815 sys_catalog.cc:565] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:37.578370 30819 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6fdd4767e924392ae08ac137c3ab5ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6fdd4767e924392ae08ac137c3ab5ed" member_type: VOTER } }
I20260709 12:22:37.578474 30820 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6fdd4767e924392ae08ac137c3ab5ed. Latest consensus state: current_term: 1 leader_uuid: "a6fdd4767e924392ae08ac137c3ab5ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6fdd4767e924392ae08ac137c3ab5ed" member_type: VOTER } }
I20260709 12:22:37.579192 30819 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:37.579368 30820 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:37.584431 30825 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:37.589298 30825 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:37.591010 30223 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:37.597810 30825 catalog_manager.cc:1383] Generated new cluster ID: 5c89d87f54cc4b3aac31c483e14b5547
I20260709 12:22:37.598114 30825 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:37.653035 30825 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:37.654237 30825 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:37.674006 30825 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed: Generated new TSK 0
I20260709 12:22:37.674599 30825 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:37.721567 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:37.727288 30836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:37.728978 30837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:37.729739 30839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:37.730002 30223 server_base.cc:1061] running on GCE node
I20260709 12:22:37.730983 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:37.731276 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:37.731465 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599757731447 us; error 0 us; skew 500 ppm
I20260709 12:22:37.732138 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:37.734310 30223 webserver.cc:533] Webserver started at http://127.29.131.193:33473/ using document root <none> and password file <none>
I20260709 12:22:37.734751 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:37.734905 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:37.735109 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:37.736228 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-0-root/instance:
uuid: "e11cf9c16d534db5a321ab416db473ad"
format_stamp: "Formatted at 2026-07-09 12:22:37 on dist-test-slave-n640"
I20260709 12:22:37.740486 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:37.743845 30844 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.744692 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:37.744939 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "e11cf9c16d534db5a321ab416db473ad"
format_stamp: "Formatted at 2026-07-09 12:22:37 on dist-test-slave-n640"
I20260709 12:22:37.745186 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:37.765010 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:37.766206 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:37.767640 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:37.769852 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:37.770021 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.770325 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:37.770498 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.810725 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:37675
I20260709 12:22:37.810822 30906 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:37675 every 8 connection(s)
I20260709 12:22:37.815760 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:37.823132 30911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:37.824286 30912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:37.827157 30914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:37.827294 30223 server_base.cc:1061] running on GCE node
I20260709 12:22:37.829289 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:37.829542 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:37.829739 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599757829722 us; error 0 us; skew 500 ppm
I20260709 12:22:37.830437 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:37.830543 30907 heartbeater.cc:344] Connected to a master server at 127.29.131.254:43641
I20260709 12:22:37.830979 30907 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:37.831893 30907 heartbeater.cc:507] Master 127.29.131.254:43641 requested a full tablet report, sending...
I20260709 12:22:37.833141 30223 webserver.cc:533] Webserver started at http://127.29.131.194:36713/ using document root <none> and password file <none>
I20260709 12:22:37.833770 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:37.834014 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:37.834195 30780 ts_manager.cc:194] Registered new tserver with Master: e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675)
I20260709 12:22:37.834363 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:37.835927 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-1-root/instance:
uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
format_stamp: "Formatted at 2026-07-09 12:22:37 on dist-test-slave-n640"
I20260709 12:22:37.836635 30780 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43580
I20260709 12:22:37.840775 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:37.843953 30919 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.844650 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:37.844929 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-1-root
uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
format_stamp: "Formatted at 2026-07-09 12:22:37 on dist-test-slave-n640"
I20260709 12:22:37.845216 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:37.856879 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:37.858022 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:37.859972 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:37.862145 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:37.862361 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.862615 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:37.862785 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.901971 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.194:39485
I20260709 12:22:37.902077 30981 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.194:39485 every 8 connection(s)
I20260709 12:22:37.906606 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:37.912992 30985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:37.914574 30986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:37.916842 30223 server_base.cc:1061] running on GCE node
W20260709 12:22:37.917004 30988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:37.918072 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:22:37.918236 30982 heartbeater.cc:344] Connected to a master server at 127.29.131.254:43641
W20260709 12:22:37.918339 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:37.918567 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599757918550 us; error 0 us; skew 500 ppm
I20260709 12:22:37.918637 30982 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:37.919343 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:37.919516 30982 heartbeater.cc:507] Master 127.29.131.254:43641 requested a full tablet report, sending...
I20260709 12:22:37.921845 30223 webserver.cc:533] Webserver started at http://127.29.131.195:43887/ using document root <none> and password file <none>
I20260709 12:22:37.921979 30780 ts_manager.cc:194] Registered new tserver with Master: 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:37.922422 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:37.922663 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:37.922925 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:37.923516 30780 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43582
I20260709 12:22:37.924177 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-2-root/instance:
uuid: "eda02608ab584ab888fd554b9d697d71"
format_stamp: "Formatted at 2026-07-09 12:22:37 on dist-test-slave-n640"
I20260709 12:22:37.928818 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:22:37.931913 30993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.932765 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:37.933086 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-2-root
uuid: "eda02608ab584ab888fd554b9d697d71"
format_stamp: "Formatted at 2026-07-09 12:22:37 on dist-test-slave-n640"
I20260709 12:22:37.933357 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599722576063-30223-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:37.961578 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:37.962761 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:37.964258 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:37.966454 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:37.966638 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:37.966920 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:37.967101 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:38.007351 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.195:39493
I20260709 12:22:38.007421 31055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.195:39493 every 8 connection(s)
I20260709 12:22:38.020743 31056 heartbeater.cc:344] Connected to a master server at 127.29.131.254:43641
I20260709 12:22:38.021072 31056 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:38.021713 31056 heartbeater.cc:507] Master 127.29.131.254:43641 requested a full tablet report, sending...
I20260709 12:22:38.023571 30780 ts_manager.cc:194] Registered new tserver with Master: eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.023752 30223 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013298329s
I20260709 12:22:38.024891 30780 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43598
I20260709 12:22:38.049503 30780 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43608:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:38.052348 30780 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:38.120992 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 12746b6fa6b94e65911c7262fa8d29e2 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:38.122928 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12746b6fa6b94e65911c7262fa8d29e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.129843 31020 tablet_service.cc:1511] Processing CreateTablet for tablet 0b05a0e44528465d808ebafdf0fbe0f2 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:38.131644 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b05a0e44528465d808ebafdf0fbe0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.141636 31019 tablet_service.cc:1511] Processing CreateTablet for tablet 9df879844456449b854d8d0d0fe966ee (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:38.142253 31018 tablet_service.cc:1511] Processing CreateTablet for tablet 2230ffbd279a42dc8d921472d6bf9c81 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:38.143041 31019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df879844456449b854d8d0d0fe966ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.143759 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2230ffbd279a42dc8d921472d6bf9c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.148512 30872 tablet_service.cc:1511] Processing CreateTablet for tablet 12746b6fa6b94e65911c7262fa8d29e2 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:38.149842 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12746b6fa6b94e65911c7262fa8d29e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.156343 31071 tablet_bootstrap.cc:492] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.158306 31020 tablet_service.cc:1511] Processing CreateTablet for tablet 8abe322f03d3449e9bce7ac8b011f547 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:38.159636 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abe322f03d3449e9bce7ac8b011f547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.159319 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 379cbcd9ddc44752a35f8c3465a8865b (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:38.159453 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 34ef0ed31f5e474599bbc2c62c0c90ca (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:38.160655 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379cbcd9ddc44752a35f8c3465a8865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.163779 31016 tablet_service.cc:1511] Processing CreateTablet for tablet 1009dd6b42cb4235b81c6a0e8597b3dc (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:38.165549 30871 tablet_service.cc:1511] Processing CreateTablet for tablet 0b05a0e44528465d808ebafdf0fbe0f2 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:38.166249 31014 tablet_service.cc:1511] Processing CreateTablet for tablet 7885d480186746da9a317e07d3dcde66 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:38.166903 30871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b05a0e44528465d808ebafdf0fbe0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.168452 30868 tablet_service.cc:1511] Processing CreateTablet for tablet 34ef0ed31f5e474599bbc2c62c0c90ca (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:38.169035 30944 tablet_service.cc:1511] Processing CreateTablet for tablet 2230ffbd279a42dc8d921472d6bf9c81 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:38.169812 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ef0ed31f5e474599bbc2c62c0c90ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.169543 30869 tablet_service.cc:1511] Processing CreateTablet for tablet 2230ffbd279a42dc8d921472d6bf9c81 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:38.170408 30944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2230ffbd279a42dc8d921472d6bf9c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.170858 30869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2230ffbd279a42dc8d921472d6bf9c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.172034 31015 tablet_service.cc:1511] Processing CreateTablet for tablet f33b148046cc4e1babf52f7f3e0dd87d (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:38.172503 30947 tablet_service.cc:1511] Processing CreateTablet for tablet 12746b6fa6b94e65911c7262fa8d29e2 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:38.168452 30870 tablet_service.cc:1511] Processing CreateTablet for tablet 9df879844456449b854d8d0d0fe966ee (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:38.173815 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12746b6fa6b94e65911c7262fa8d29e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.174430 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df879844456449b854d8d0d0fe966ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.176457 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 0b05a0e44528465d808ebafdf0fbe0f2 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:38.177685 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b05a0e44528465d808ebafdf0fbe0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.179549 30867 tablet_service.cc:1511] Processing CreateTablet for tablet 8abe322f03d3449e9bce7ac8b011f547 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:38.178927 31016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1009dd6b42cb4235b81c6a0e8597b3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.180605 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33b148046cc4e1babf52f7f3e0dd87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.180822 30867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abe322f03d3449e9bce7ac8b011f547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.183614 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7885d480186746da9a317e07d3dcde66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.179582 30945 tablet_service.cc:1511] Processing CreateTablet for tablet 9df879844456449b854d8d0d0fe966ee (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:38.184633 30945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df879844456449b854d8d0d0fe966ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.184839 30943 tablet_service.cc:1511] Processing CreateTablet for tablet 34ef0ed31f5e474599bbc2c62c0c90ca (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:38.186077 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ef0ed31f5e474599bbc2c62c0c90ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.199532 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ef0ed31f5e474599bbc2c62c0c90ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.209173 30942 tablet_service.cc:1511] Processing CreateTablet for tablet 8abe322f03d3449e9bce7ac8b011f547 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:38.210611 30942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abe322f03d3449e9bce7ac8b011f547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.217089 30941 tablet_service.cc:1511] Processing CreateTablet for tablet 379cbcd9ddc44752a35f8c3465a8865b (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:38.218506 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379cbcd9ddc44752a35f8c3465a8865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.218550 30938 tablet_service.cc:1511] Processing CreateTablet for tablet 7885d480186746da9a317e07d3dcde66 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:38.220023 30938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7885d480186746da9a317e07d3dcde66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.220422 30940 tablet_service.cc:1511] Processing CreateTablet for tablet 1009dd6b42cb4235b81c6a0e8597b3dc (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:38.223156 30940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1009dd6b42cb4235b81c6a0e8597b3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.225260 30939 tablet_service.cc:1511] Processing CreateTablet for tablet f33b148046cc4e1babf52f7f3e0dd87d (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:38.225832 30870 tablet_service.cc:1511] Processing CreateTablet for tablet 379cbcd9ddc44752a35f8c3465a8865b (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:38.227865 30866 tablet_service.cc:1511] Processing CreateTablet for tablet f33b148046cc4e1babf52f7f3e0dd87d (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:38.229875 30869 tablet_service.cc:1511] Processing CreateTablet for tablet 1009dd6b42cb4235b81c6a0e8597b3dc (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:38.222855 30865 tablet_service.cc:1511] Processing CreateTablet for tablet 7885d480186746da9a317e07d3dcde66 (DEFAULT_TABLE table=test-workload [id=fbd7e512089c4650814703188c59b8ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:38.226956 31071 tablet_bootstrap.cc:654] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.228276 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379cbcd9ddc44752a35f8c3465a8865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.235200 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7885d480186746da9a317e07d3dcde66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.235832 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33b148046cc4e1babf52f7f3e0dd87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.226619 30939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33b148046cc4e1babf52f7f3e0dd87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.245815 30869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1009dd6b42cb4235b81c6a0e8597b3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.315290 31072 tablet_bootstrap.cc:492] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.325317 31071 tablet_bootstrap.cc:492] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.325910 31071 ts_tablet_manager.cc:1403] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.171s	user 0.009s	sys 0.039s
I20260709 12:22:38.327157 31072 tablet_bootstrap.cc:654] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.337464 31073 tablet_bootstrap.cc:492] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.338208 31071 raft_consensus.cc:359] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.341059 31071 raft_consensus.cc:385] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.341444 31071 raft_consensus.cc:740] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.342218 31071 consensus_queue.cc:260] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.349309 31073 tablet_bootstrap.cc:654] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.356549 31072 tablet_bootstrap.cc:492] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.357163 31072 ts_tablet_manager.cc:1403] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.004s
I20260709 12:22:38.359347 31073 tablet_bootstrap.cc:492] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:38.359900 31056 heartbeater.cc:499] Master 127.29.131.254:43641 was elected leader, sending a full tablet report...
I20260709 12:22:38.360219 31071 ts_tablet_manager.cc:1434] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.005s
I20260709 12:22:38.360088 31072 raft_consensus.cc:359] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:38.360841 31072 raft_consensus.cc:385] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.361009 31071 tablet_bootstrap.cc:492] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.361162 31072 raft_consensus.cc:740] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.361912 31072 consensus_queue.cc:260] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:38.364243 31073 ts_tablet_manager.cc:1403] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 12:22:38.364897 31072 ts_tablet_manager.cc:1434] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:22:38.365654 30907 heartbeater.cc:499] Master 127.29.131.254:43641 was elected leader, sending a full tablet report...
I20260709 12:22:38.365914 31072 tablet_bootstrap.cc:492] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.366605 31071 tablet_bootstrap.cc:654] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.372793 31072 tablet_bootstrap.cc:654] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.375975 31073 raft_consensus.cc:359] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:38.377159 31073 raft_consensus.cc:385] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.377597 31073 raft_consensus.cc:740] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.378777 31073 consensus_queue.cc:260] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:38.385162 31072 tablet_bootstrap.cc:492] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.385864 31072 ts_tablet_manager.cc:1403] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:22:38.389755 31072 raft_consensus.cc:359] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.390974 31072 raft_consensus.cc:385] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.391499 31072 raft_consensus.cc:740] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.393059 30982 heartbeater.cc:499] Master 127.29.131.254:43641 was elected leader, sending a full tablet report...
I20260709 12:22:38.393569 31072 consensus_queue.cc:260] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.395993 31072 ts_tablet_manager.cc:1434] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:38.396973 31072 tablet_bootstrap.cc:492] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.398053 31073 ts_tablet_manager.cc:1434] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.033s	user 0.012s	sys 0.007s
I20260709 12:22:38.399096 31073 tablet_bootstrap.cc:492] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.403537 31072 tablet_bootstrap.cc:654] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.404976 31081 raft_consensus.cc:493] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.405467 31081 raft_consensus.cc:515] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
W20260709 12:22:38.412686 30983 tablet.cc:2406] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:38.418628 31072 tablet_bootstrap.cc:492] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.419251 31072 ts_tablet_manager.cc:1403] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.007s
I20260709 12:22:38.423302 31081 leader_election.cc:290] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493), e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675)
I20260709 12:22:38.422986 31072 raft_consensus.cc:359] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.424276 31072 raft_consensus.cc:385] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.425751 31073 tablet_bootstrap.cc:654] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.424741 31072 raft_consensus.cc:740] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.432017 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12746b6fa6b94e65911c7262fa8d29e2" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:38.432855 31072 consensus_queue.cc:260] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
W20260709 12:22:38.434278 30921 leader_election.cc:343] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.436272 31072 ts_tablet_manager.cc:1434] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:22:38.437650 31072 tablet_bootstrap.cc:492] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.445909 31072 tablet_bootstrap.cc:654] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.459183 31072 tablet_bootstrap.cc:492] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.459964 31072 ts_tablet_manager.cc:1403] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.009s
I20260709 12:22:38.461971 31071 tablet_bootstrap.cc:492] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.462540 31071 ts_tablet_manager.cc:1403] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.102s	user 0.036s	sys 0.065s
I20260709 12:22:38.463635 31072 raft_consensus.cc:359] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.464797 31072 raft_consensus.cc:385] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.465241 31072 raft_consensus.cc:740] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.465346 31071 raft_consensus.cc:359] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:38.466158 31071 raft_consensus.cc:385] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.466514 31071 raft_consensus.cc:740] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.466504 31072 consensus_queue.cc:260] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.467705 31071 consensus_queue.cc:260] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:38.469877 31071 ts_tablet_manager.cc:1434] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:22:38.470099 31072 ts_tablet_manager.cc:1434] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:38.470832 31071 tablet_bootstrap.cc:492] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.471369 31072 tablet_bootstrap.cc:492] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.477691 31071 tablet_bootstrap.cc:654] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.480142 31072 tablet_bootstrap.cc:654] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.489420 31071 tablet_bootstrap.cc:492] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.489979 31071 ts_tablet_manager.cc:1403] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.005s
I20260709 12:22:38.493090 31072 tablet_bootstrap.cc:492] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.492803 31071 raft_consensus.cc:359] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.493733 31071 raft_consensus.cc:385] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.493839 31072 ts_tablet_manager.cc:1403] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:22:38.494102 31071 raft_consensus.cc:740] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.495164 31071 consensus_queue.cc:260] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.497727 31072 raft_consensus.cc:359] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.498894 31072 raft_consensus.cc:385] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.499221 31071 ts_tablet_manager.cc:1434] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:22:38.499365 31072 raft_consensus.cc:740] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.500315 31071 tablet_bootstrap.cc:492] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.500530 31072 consensus_queue.cc:260] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.504065 31072 ts_tablet_manager.cc:1434] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:22:38.505373 31072 tablet_bootstrap.cc:492] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.507053 31071 tablet_bootstrap.cc:654] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.513909 31072 tablet_bootstrap.cc:654] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.520102 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12746b6fa6b94e65911c7262fa8d29e2" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:38.521093 30882 raft_consensus.cc:2468] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 0.
I20260709 12:22:38.524006 30923 leader_election.cc:304] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: eda02608ab584ab888fd554b9d697d71
I20260709 12:22:38.524854 31081 raft_consensus.cc:2804] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.525306 31072 tablet_bootstrap.cc:492] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.525229 31081 raft_consensus.cc:493] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.525707 31081 raft_consensus.cc:3060] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.525802 31072 ts_tablet_manager.cc:1403] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 12:22:38.526731 31071 tablet_bootstrap.cc:492] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.527171 31071 ts_tablet_manager.cc:1403] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.002s
I20260709 12:22:38.528976 31072 raft_consensus.cc:359] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.529661 31072 raft_consensus.cc:385] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.529973 31072 raft_consensus.cc:740] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.529978 31071 raft_consensus.cc:359] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.530788 31071 raft_consensus.cc:385] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.530992 31071 raft_consensus.cc:740] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.530920 31072 consensus_queue.cc:260] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.532016 31071 consensus_queue.cc:260] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.533399 31073 tablet_bootstrap.cc:492] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:38.533079 31081 raft_consensus.cc:515] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:38.533917 31073 ts_tablet_manager.cc:1403] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.135s	user 0.040s	sys 0.061s
I20260709 12:22:38.536936 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12746b6fa6b94e65911c7262fa8d29e2" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:38.536876 31073 raft_consensus.cc:359] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.537616 31031 raft_consensus.cc:3060] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.538378 31072 ts_tablet_manager.cc:1434] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:22:38.538980 31081 leader_election.cc:290] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 election: Requested vote from peers eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493), e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675)
I20260709 12:22:38.537662 31073 raft_consensus.cc:385] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.539579 31072 tablet_bootstrap.cc:492] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.539623 31073 raft_consensus.cc:740] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.540095 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12746b6fa6b94e65911c7262fa8d29e2" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:38.540618 30882 raft_consensus.cc:3060] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.540652 31073 consensus_queue.cc:260] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.542797 31071 ts_tablet_manager.cc:1434] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:22:38.544234 31073 ts_tablet_manager.cc:1434] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:22:38.545181 31071 tablet_bootstrap.cc:492] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.546844 31072 tablet_bootstrap.cc:654] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.548811 31073 tablet_bootstrap.cc:492] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.555358 31031 raft_consensus.cc:2468] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 1.
I20260709 12:22:38.556143 31071 tablet_bootstrap.cc:654] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.557976 30921 leader_election.cc:304] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.559134 31081 raft_consensus.cc:2804] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.559682 31081 raft_consensus.cc:697] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Becoming Leader. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:38.560514 31081 consensus_queue.cc:237] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:38.562247 31073 tablet_bootstrap.cc:654] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.562981 30882 raft_consensus.cc:2468] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 1.
I20260709 12:22:38.567207 31078 raft_consensus.cc:493] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.567705 31078 raft_consensus.cc:515] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.569718 31072 tablet_bootstrap.cc:492] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.570307 31072 ts_tablet_manager.cc:1403] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.000s
I20260709 12:22:38.572751 31078 leader_election.cc:290] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.574139 31072 raft_consensus.cc:359] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.575155 31072 raft_consensus.cc:385] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.575678 31072 raft_consensus.cc:740] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.576684 31072 consensus_queue.cc:260] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.579923 31072 ts_tablet_manager.cc:1434] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 12:22:38.581079 31072 tablet_bootstrap.cc:492] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.582751 31078 raft_consensus.cc:493] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.585053 31078 raft_consensus.cc:515] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
W20260709 12:22:38.586577 30828 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:38.589975 31078 leader_election.cc:290] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
W20260709 12:22:38.614639 30921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:39493, user_credentials={real_user=slave}} blocked reactor thread for 56760us
I20260709 12:22:38.593454 31072 tablet_bootstrap.cc:654] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.624701 30777 catalog_manager.cc:5697] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.631088 31075 raft_consensus.cc:493] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.631788 31075 raft_consensus.cc:515] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.632980 31073 tablet_bootstrap.cc:492] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:38.633471 31073 ts_tablet_manager.cc:1403] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.038s
I20260709 12:22:38.641698 31075 leader_election.cc:290] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:38.650070 31071 tablet_bootstrap.cc:492] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.650100 31096 raft_consensus.cc:493] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.653227 31072 tablet_bootstrap.cc:492] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.653770 31072 ts_tablet_manager.cc:1403] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.007s
I20260709 12:22:38.653154 31096 raft_consensus.cc:515] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.655915 31096 leader_election.cc:290] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.643818 31073 raft_consensus.cc:359] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.656265 31072 raft_consensus.cc:359] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.656699 31073 raft_consensus.cc:385] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.657090 31072 raft_consensus.cc:385] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.657423 31071 ts_tablet_manager.cc:1403] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.032s
I20260709 12:22:38.657456 31072 raft_consensus.cc:740] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.658533 31072 consensus_queue.cc:260] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.659895 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:38.660480 30882 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 0.
I20260709 12:22:38.660883 31071 raft_consensus.cc:359] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.661756 31071 raft_consensus.cc:385] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.662114 31071 raft_consensus.cc:740] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.662189 30997 leader_election.cc:304] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.662966 31071 consensus_queue.cc:260] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.663305 31075 raft_consensus.cc:2804] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.663663 31072 ts_tablet_manager.cc:1434] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:22:38.663901 31075 raft_consensus.cc:493] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.664603 31072 tablet_bootstrap.cc:492] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.664534 31075 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.657110 31073 raft_consensus.cc:740] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.672482 31075 raft_consensus.cc:515] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.672853 31073 consensus_queue.cc:260] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.675307 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:38.675872 30882 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.677807 31073 ts_tablet_manager.cc:1434] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.005s
I20260709 12:22:38.679049 31073 tablet_bootstrap.cc:492] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.681186 30882 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 1.
I20260709 12:22:38.683457 30997 leader_election.cc:304] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.685040 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
I20260709 12:22:38.687253 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
I20260709 12:22:38.689000 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
W20260709 12:22:38.690553 30846 leader_election.cc:343] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.682122 31075 leader_election.cc:290] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
W20260709 12:22:38.691687 30846 leader_election.cc:343] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:38.692809 30846 leader_election.cc:343] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.694023 31104 raft_consensus.cc:2804] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.694942 31071 ts_tablet_manager.cc:1434] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.037s	user 0.020s	sys 0.015s
I20260709 12:22:38.695039 31104 raft_consensus.cc:697] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:38.695984 31071 tablet_bootstrap.cc:492] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.696681 31072 tablet_bootstrap.cc:654] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.696826 31104 consensus_queue.cc:237] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.694582 31075 raft_consensus.cc:493] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.700351 31075 raft_consensus.cc:515] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.702652 31071 tablet_bootstrap.cc:654] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.703727 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:38.704569 30882 raft_consensus.cc:2468] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 0.
I20260709 12:22:38.705062 31073 tablet_bootstrap.cc:654] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.706050 30997 leader_election.cc:304] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.707600 31106 raft_consensus.cc:2804] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.708194 31072 tablet_bootstrap.cc:492] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.708854 31072 ts_tablet_manager.cc:1403] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 12:22:38.709220 31075 leader_election.cc:290] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:38.708138 31106 raft_consensus.cc:493] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.713013 31096 raft_consensus.cc:493] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.713611 31096 raft_consensus.cc:515] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.715544 31071 tablet_bootstrap.cc:492] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.716022 31071 ts_tablet_manager.cc:1403] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.002s
I20260709 12:22:38.716162 31096 leader_election.cc:290] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.716538 31106 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.717464 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
W20260709 12:22:38.719013 30846 leader_election.cc:343] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.719889 31072 raft_consensus.cc:359] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.720731 31072 raft_consensus.cc:385] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.721077 31072 raft_consensus.cc:740] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.719281 31071 raft_consensus.cc:359] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.722245 31071 raft_consensus.cc:385] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.722527 31071 raft_consensus.cc:740] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.723318 31071 consensus_queue.cc:260] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.725477 31071 ts_tablet_manager.cc:1434] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:38.726377 31071 tablet_bootstrap.cc:492] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.728008 31081 raft_consensus.cc:493] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.728468 31081 raft_consensus.cc:515] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.730680 31081 leader_election.cc:290] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.732985 31072 consensus_queue.cc:260] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.735380 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:38.735718 31071 tablet_bootstrap.cc:654] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.735735 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:38.736045 31031 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 0.
I20260709 12:22:38.736442 30882 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 0.
I20260709 12:22:38.738583 30923 leader_election.cc:304] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:38.739771 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:38.740334 31072 ts_tablet_manager.cc:1434] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:22:38.741256 31072 tablet_bootstrap.cc:492] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad: Bootstrap starting.
I20260709 12:22:38.741160 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:38.742286 31073 tablet_bootstrap.cc:492] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:38.742766 31073 ts_tablet_manager.cc:1403] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.005s
I20260709 12:22:38.742560 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:38.739610 31106 raft_consensus.cc:515] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
W20260709 12:22:38.745187 30846 leader_election.cc:343] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.745741 30846 leader_election.cc:304] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad; no voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71
I20260709 12:22:38.746690 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
I20260709 12:22:38.747411 30955 raft_consensus.cc:2468] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 0.
I20260709 12:22:38.748124 31096 raft_consensus.cc:2749] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.748531 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:38.749747 31072 tablet_bootstrap.cc:654] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.749825 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
I20260709 12:22:38.751523 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:38.752110 31031 raft_consensus.cc:2468] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 0.
I20260709 12:22:38.752892 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:38.753273 31106 leader_election.cc:290] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:38.753432 30882 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.754604 30846 leader_election.cc:304] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad; no voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71
W20260709 12:22:38.756206 30846 leader_election.cc:343] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.752404 31081 raft_consensus.cc:2804] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.756628 30846 leader_election.cc:304] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad; no voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71
I20260709 12:22:38.756925 31081 raft_consensus.cc:493] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.757268 31081 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.757346 31078 raft_consensus.cc:2749] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.757994 31078 raft_consensus.cc:2749] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:38.760469 30995 leader_election.cc:343] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:38.761408 30995 leader_election.cc:343] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.762336 30846 leader_election.cc:304] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:38.762494 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:38.763053 30957 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.763181 31096 raft_consensus.cc:2804] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.764125 31096 raft_consensus.cc:493] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.764567 31096 raft_consensus.cc:3060] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.773800 31107 raft_consensus.cc:493] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.774487 31107 raft_consensus.cc:515] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.778950 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:38.779898 30881 raft_consensus.cc:2468] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 0.
I20260709 12:22:38.781394 31107 leader_election.cc:290] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:38.782759 30997 leader_election.cc:304] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.784698 31107 raft_consensus.cc:2804] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.785354 31107 raft_consensus.cc:493] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.785848 31107 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.786321 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
W20260709 12:22:38.788245 30995 leader_election.cc:343] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.792789 31096 raft_consensus.cc:515] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.794238 31072 tablet_bootstrap.cc:492] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad: No bootstrap required, opened a new log
I20260709 12:22:38.791494 30957 raft_consensus.cc:2468] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 1.
I20260709 12:22:38.805186 30995 leader_election.cc:304] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.805512 31071 tablet_bootstrap.cc:492] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.796325 30882 raft_consensus.cc:2468] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 1.
I20260709 12:22:38.806097 31104 raft_consensus.cc:2804] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.806782 31072 ts_tablet_manager.cc:1403] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.012s
I20260709 12:22:38.800506 30779 catalog_manager.cc:5697] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.806013 31071 ts_tablet_manager.cc:1403] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.080s	user 0.040s	sys 0.024s
I20260709 12:22:38.806195 31081 raft_consensus.cc:515] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.807334 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
W20260709 12:22:38.808705 30846 leader_election.cc:343] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.806675 31104 raft_consensus.cc:697] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:38.809728 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:38.809772 31104 consensus_queue.cc:237] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.813512 30882 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.813856 31072 raft_consensus.cc:359] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.814487 31072 raft_consensus.cc:385] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.814728 31072 raft_consensus.cc:740] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.797267 31073 raft_consensus.cc:359] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.815440 31073 raft_consensus.cc:385] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.815477 31072 consensus_queue.cc:260] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.811928 31096 leader_election.cc:290] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.811877 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:38.810504 31071 raft_consensus.cc:359] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.816730 31031 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.816884 31071 raft_consensus.cc:385] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.817297 31071 raft_consensus.cc:740] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.813048 31081 leader_election.cc:290] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.815878 31073 raft_consensus.cc:740] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.812642 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:38.818568 31071 consensus_queue.cc:260] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.818770 31073 consensus_queue.cc:260] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.819474 31028 raft_consensus.cc:3060] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.820921 31071 ts_tablet_manager.cc:1434] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:22:38.802433 31107 raft_consensus.cc:515] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.821861 31071 tablet_bootstrap.cc:492] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.823760 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:38.824450 30881 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.825824 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
W20260709 12:22:38.827149 30995 leader_election.cc:343] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.823837 31107 leader_election.cc:290] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:38.830884 30882 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 1.
I20260709 12:22:38.831933 30923 leader_election.cc:304] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:38.832326 31071 tablet_bootstrap.cc:654] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.832235 31028 raft_consensus.cc:2468] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 1.
I20260709 12:22:38.820921 31073 ts_tablet_manager.cc:1434] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 12:22:38.834697 31073 tablet_bootstrap.cc:492] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.832866 31091 raft_consensus.cc:2804] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.836460 31091 raft_consensus.cc:697] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Becoming Leader. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:38.837314 31091 consensus_queue.cc:237] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.832506 31031 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 1.
I20260709 12:22:38.833469 30846 leader_election.cc:304] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:38.843348 31096 raft_consensus.cc:2804] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.844466 31096 raft_consensus.cc:697] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:38.845395 31073 tablet_bootstrap.cc:654] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.845456 31096 consensus_queue.cc:237] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.849496 31072 ts_tablet_manager.cc:1434] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.001s
I20260709 12:22:38.854262 30881 raft_consensus.cc:2468] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 1.
I20260709 12:22:38.858351 30997 leader_election.cc:304] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:38.859778 31107 raft_consensus.cc:2804] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.860384 31107 raft_consensus.cc:697] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:38.861498 31107 consensus_queue.cc:237] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.862390 31071 tablet_bootstrap.cc:492] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.869836 31071 ts_tablet_manager.cc:1403] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.016s
I20260709 12:22:38.871675 30779 catalog_manager.cc:5697] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.872485 31071 raft_consensus.cc:359] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.873172 31071 raft_consensus.cc:385] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.873487 31071 raft_consensus.cc:740] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.874181 31071 consensus_queue.cc:260] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.876291 31071 ts_tablet_manager.cc:1434] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:38.877137 31071 tablet_bootstrap.cc:492] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.876744 30777 catalog_manager.cc:5697] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.882956 31071 tablet_bootstrap.cc:654] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.894042 31071 tablet_bootstrap.cc:492] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.894555 31071 ts_tablet_manager.cc:1403] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:22:38.895079 31107 raft_consensus.cc:493] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.895641 31107 raft_consensus.cc:515] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.896191 31073 tablet_bootstrap.cc:492] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:38.896706 31073 ts_tablet_manager.cc:1403] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.013s
I20260709 12:22:38.897282 31071 raft_consensus.cc:359] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.896912 30777 catalog_manager.cc:5697] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 1 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.898005 31071 raft_consensus.cc:385] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.898337 31071 raft_consensus.cc:740] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.898504 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:38.899143 30881 raft_consensus.cc:2468] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 0.
I20260709 12:22:38.899246 31071 consensus_queue.cc:260] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.899576 31073 raft_consensus.cc:359] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.900306 31073 raft_consensus.cc:385] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.900466 30997 leader_election.cc:304] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.901809 31071 ts_tablet_manager.cc:1434] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:38.901976 31073 raft_consensus.cc:740] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.902335 31104 raft_consensus.cc:2804] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.902737 31104 raft_consensus.cc:493] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.902138 30779 catalog_manager.cc:5697] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.903097 31104 raft_consensus.cc:3060] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.902961 31073 consensus_queue.cc:260] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.905233 31107 leader_election.cc:290] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:38.905483 31091 raft_consensus.cc:493] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.905954 31091 raft_consensus.cc:515] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.906667 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
I20260709 12:22:38.907141 30956 raft_consensus.cc:2468] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 0.
I20260709 12:22:38.908126 31091 leader_election.cc:290] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.910888 31071 tablet_bootstrap.cc:492] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71: Bootstrap starting.
I20260709 12:22:38.911525 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:38.911576 31104 raft_consensus.cc:515] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.912201 30881 raft_consensus.cc:2468] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 0.
I20260709 12:22:38.913506 30923 leader_election.cc:304] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:38.914302 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:38.909929 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:38.914912 30881 raft_consensus.cc:3060] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.915195 31031 raft_consensus.cc:2393] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f97dc9c5128456e97d2ba86d4f959d3 in current term 1: Already voted for candidate eda02608ab584ab888fd554b9d697d71 in this term.
I20260709 12:22:38.916823 31071 tablet_bootstrap.cc:654] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.910074 31073 ts_tablet_manager.cc:1434] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 12:22:38.920734 31073 tablet_bootstrap.cc:492] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.922570 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:38.923297 31104 leader_election.cc:290] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:38.924501 30881 raft_consensus.cc:2468] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 1.
I20260709 12:22:38.925701 30997 leader_election.cc:304] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.926642 31104 raft_consensus.cc:2804] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.927357 31104 raft_consensus.cc:697] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:38.928323 31104 consensus_queue.cc:237] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.929819 31073 tablet_bootstrap.cc:654] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.914427 31091 raft_consensus.cc:2804] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.933068 31091 raft_consensus.cc:493] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.933531 31091 raft_consensus.cc:3060] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.936000 31071 tablet_bootstrap.cc:492] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71: No bootstrap required, opened a new log
I20260709 12:22:38.936427 31071 ts_tablet_manager.cc:1403] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.006s
I20260709 12:22:38.939752 31073 tablet_bootstrap.cc:492] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:38.940317 31073 ts_tablet_manager.cc:1403] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:22:38.943192 31091 raft_consensus.cc:515] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.943679 31073 raft_consensus.cc:359] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.944500 30956 raft_consensus.cc:2393] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eda02608ab584ab888fd554b9d697d71 in current term 1: Already voted for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in this term.
I20260709 12:22:38.944468 31073 raft_consensus.cc:385] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.944872 31073 raft_consensus.cc:740] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.945637 31073 consensus_queue.cc:260] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.947371 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:38.947577 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:38.948143 30881 raft_consensus.cc:2393] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f97dc9c5128456e97d2ba86d4f959d3 in current term 1: Already voted for candidate eda02608ab584ab888fd554b9d697d71 in this term.
I20260709 12:22:38.949796 30923 leader_election.cc:304] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3; no voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71
I20260709 12:22:38.950039 31073 ts_tablet_manager.cc:1434] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:38.949503 30779 catalog_manager.cc:5697] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.950673 31081 raft_consensus.cc:2749] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.951035 31073 tablet_bootstrap.cc:492] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.939263 31071 raft_consensus.cc:359] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.952942 31071 raft_consensus.cc:385] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.953294 31071 raft_consensus.cc:740] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.954041 31071 consensus_queue.cc:260] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.956430 31071 ts_tablet_manager.cc:1434] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:22:38.957535 31091 leader_election.cc:290] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.957787 31073 tablet_bootstrap.cc:654] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.964129 31096 raft_consensus.cc:493] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.964680 31096 raft_consensus.cc:515] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.965811 31073 tablet_bootstrap.cc:492] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:38.966303 31073 ts_tablet_manager.cc:1403] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:22:38.966883 31096 leader_election.cc:290] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.967978 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7885d480186746da9a317e07d3dcde66" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:38.967950 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7885d480186746da9a317e07d3dcde66" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
I20260709 12:22:38.968693 31031 raft_consensus.cc:2468] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 0.
I20260709 12:22:38.969080 31073 raft_consensus.cc:359] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
W20260709 12:22:38.969381 30846 leader_election.cc:343] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.969812 31073 raft_consensus.cc:385] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.970095 31073 raft_consensus.cc:740] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.970177 30846 leader_election.cc:304] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:38.970898 31096 raft_consensus.cc:2804] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.970753 31073 consensus_queue.cc:260] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.971271 31096 raft_consensus.cc:493] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.971616 31096 raft_consensus.cc:3060] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.973068 31073 ts_tablet_manager.cc:1434] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:38.974077 31073 tablet_bootstrap.cc:492] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.978682 31096 raft_consensus.cc:515] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.980911 31096 leader_election.cc:290] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:38.981154 31073 tablet_bootstrap.cc:654] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.981976 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7885d480186746da9a317e07d3dcde66" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:38.982601 31031 raft_consensus.cc:3060] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.986147 31073 tablet_bootstrap.cc:492] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:38.986621 31073 ts_tablet_manager.cc:1403] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:22:38.987574 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7885d480186746da9a317e07d3dcde66" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:38.988073 30956 raft_consensus.cc:3060] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.989392 31031 raft_consensus.cc:2468] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 1.
I20260709 12:22:38.989195 31073 raft_consensus.cc:359] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.989861 31073 raft_consensus.cc:385] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.990207 31073 raft_consensus.cc:740] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.990535 30846 leader_election.cc:304] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:38.991014 31073 consensus_queue.cc:260] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.991318 31096 raft_consensus.cc:2804] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.992534 31096 raft_consensus.cc:697] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:38.992884 31073 ts_tablet_manager.cc:1434] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:22:38.993822 31073 tablet_bootstrap.cc:492] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:38.993410 31096 consensus_queue.cc:237] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:38.994071 30956 raft_consensus.cc:2468] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 1.
I20260709 12:22:38.999754 31073 tablet_bootstrap.cc:654] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.002303 30780 catalog_manager.cc:5697] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 1 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.004278 31073 tablet_bootstrap.cc:492] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:39.004654 31073 ts_tablet_manager.cc:1403] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:22:39.007001 31073 raft_consensus.cc:359] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.007658 31073 raft_consensus.cc:385] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.007861 31073 raft_consensus.cc:740] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.008455 31073 consensus_queue.cc:260] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.010434 31073 ts_tablet_manager.cc:1434] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:39.011312 31073 tablet_bootstrap.cc:492] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3: Bootstrap starting.
I20260709 12:22:39.015470 31073 tablet_bootstrap.cc:654] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.019711 31073 tablet_bootstrap.cc:492] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3: No bootstrap required, opened a new log
I20260709 12:22:39.020125 31073 ts_tablet_manager.cc:1403] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent bootstrapping tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:22:39.021739 31073 raft_consensus.cc:359] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.022159 31073 raft_consensus.cc:385] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.022331 31073 raft_consensus.cc:740] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.022780 31073 consensus_queue.cc:260] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.024196 31073 ts_tablet_manager.cc:1434] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:22:39.075402 31091 consensus_queue.cc:1048] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.087462 31081 consensus_queue.cc:1048] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:39.131857 31104 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.140410 30956 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.147413 31131 raft_consensus.cc:493] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.147955 31131 raft_consensus.cc:515] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.148471 31106 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.150059 31131 leader_election.cc:290] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.151156 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:39.151823 31031 raft_consensus.cc:2468] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 0.
I20260709 12:22:39.151199 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:39.152586 30881 raft_consensus.cc:2468] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 0.
I20260709 12:22:39.153129 30921 leader_election.cc:304] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:39.153939 31131 raft_consensus.cc:2804] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.154314 31131 raft_consensus.cc:493] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.154733 31131 raft_consensus.cc:3060] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.162252 31131 raft_consensus.cc:515] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.164047 31131 leader_election.cc:290] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.164633 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:39.164894 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.165218 30881 raft_consensus.cc:3060] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.165407 31031 raft_consensus.cc:3060] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.170773 30881 raft_consensus.cc:2468] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 1.
I20260709 12:22:39.171795 30923 leader_election.cc:304] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:39.171927 31031 raft_consensus.cc:2468] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 1.
I20260709 12:22:39.172498 31131 raft_consensus.cc:2804] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:39.173045 31131 raft_consensus.cc:697] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Becoming Leader. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:39.173756 31131 consensus_queue.cc:237] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.180862 30780 catalog_manager.cc:5697] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.187162 31106 raft_consensus.cc:493] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.187644 31106 raft_consensus.cc:515] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.189496 31106 leader_election.cc:290] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:39.190115 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:39.190559 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" is_pre_election: true
I20260709 12:22:39.190742 30881 raft_consensus.cc:2468] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 0.
I20260709 12:22:39.191161 30956 raft_consensus.cc:2468] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 0.
I20260709 12:22:39.191761 30997 leader_election.cc:304] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:39.192444 31106 raft_consensus.cc:2804] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.192795 31106 raft_consensus.cc:493] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.193079 31106 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.197374 31106 raft_consensus.cc:515] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.198917 31106 leader_election.cc:290] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:39.199642 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:39.199872 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:39.200101 30881 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.200408 30956 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.204487 30881 raft_consensus.cc:2468] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 1.
I20260709 12:22:39.204643 30956 raft_consensus.cc:2468] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 1.
I20260709 12:22:39.205530 30997 leader_election.cc:304] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:39.206189 31106 raft_consensus.cc:2804] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:39.206678 31106 raft_consensus.cc:697] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:39.207527 31106 consensus_queue.cc:237] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.214474 30780 catalog_manager.cc:5697] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.243714 31131 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.253913 31091 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.263593 31106 consensus_queue.cc:1048] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.273216 30956 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.280356 31106 consensus_queue.cc:1048] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.320712 31106 consensus_queue.cc:1048] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.324096 31106 consensus_queue.cc:1048] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.331743 31106 consensus_queue.cc:1048] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:39.339010 31075 consensus_queue.cc:1048] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.375167 31091 raft_consensus.cc:493] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.375711 31091 raft_consensus.cc:515] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.377703 31091 leader_election.cc:290] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.378361 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cf9c16d534db5a321ab416db473ad" is_pre_election: true
I20260709 12:22:39.378862 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda02608ab584ab888fd554b9d697d71" is_pre_election: true
I20260709 12:22:39.379650 31031 raft_consensus.cc:2393] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f97dc9c5128456e97d2ba86d4f959d3 in current term 1: Already voted for candidate e11cf9c16d534db5a321ab416db473ad in this term.
I20260709 12:22:39.381027 30921 leader_election.cc:304] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3; no voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71
I20260709 12:22:39.381817 31091 raft_consensus.cc:3060] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.383486 30956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12746b6fa6b94e65911c7262fa8d29e2"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:46962
I20260709 12:22:39.384232 30956 raft_consensus.cc:606] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:39.388266 31091 raft_consensus.cc:2749] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:39.397477 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:32806
I20260709 12:22:39.398027 31031 raft_consensus.cc:606] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:39.402704 30956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:46962
I20260709 12:22:39.403192 30956 raft_consensus.cc:606] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:39.407553 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:32806
I20260709 12:22:39.408221 31031 raft_consensus.cc:606] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:39.412957 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:32806
I20260709 12:22:39.413412 31031 raft_consensus.cc:606] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:39.417567 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
mode: GRACEFUL
new_leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:32806
I20260709 12:22:39.418018 31031 raft_consensus.cc:606] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Received request to transfer leadership to TS 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:39.422252 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
mode: GRACEFUL
new_leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:32806
I20260709 12:22:39.422703 31031 raft_consensus.cc:606] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Received request to transfer leadership to TS 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:39.437927 30881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
mode: GRACEFUL
new_leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:35578
I20260709 12:22:39.438458 30881 raft_consensus.cc:606] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Received request to transfer leadership to TS 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:39.443086 30881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7885d480186746da9a317e07d3dcde66"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
mode: GRACEFUL
new_leader_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:35578
I20260709 12:22:39.443574 30881 raft_consensus.cc:606] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Received request to transfer leadership to TS eda02608ab584ab888fd554b9d697d71
I20260709 12:22:39.462549 31078 consensus_queue.cc:1048] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.463186 31096 consensus_queue.cc:1048] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.471777 31078 raft_consensus.cc:993] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad: : Instructing follower 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:39.472226 31078 raft_consensus.cc:1081] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Signalling peer 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:39.475442 30957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:46940
I20260709 12:22:39.476097 30957 raft_consensus.cc:493] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.476466 30957 raft_consensus.cc:3060] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.483485 30957 raft_consensus.cc:515] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.486101 31153 consensus_queue.cc:1048] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.486624 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:39.487205 30881 raft_consensus.cc:3055] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.487540 30881 raft_consensus.cc:740] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:39.488252 30881 consensus_queue.cc:260] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.489277 30881 raft_consensus.cc:3060] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.494413 30881 raft_consensus.cc:2468] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 2.
I20260709 12:22:39.495270 30957 leader_election.cc:290] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 2 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.495487 30923 leader_election.cc:304] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:39.496300 31091 raft_consensus.cc:2804] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.496776 31091 raft_consensus.cc:697] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Becoming Leader. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:39.497385 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33b148046cc4e1babf52f7f3e0dd87d" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.497927 31028 raft_consensus.cc:3060] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.497629 31091 consensus_queue.cc:237] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.500532 31078 raft_consensus.cc:993] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad: : Instructing follower eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:39.500965 31078 raft_consensus.cc:1081] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Signalling peer eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:39.504544 31031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7885d480186746da9a317e07d3dcde66"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:32800
I20260709 12:22:39.505139 31031 raft_consensus.cc:493] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.505580 31031 raft_consensus.cc:3060] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.508311 30779 catalog_manager.cc:5697] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 reported cstate change: term changed from 1 to 2, leader changed from e11cf9c16d534db5a321ab416db473ad (127.29.131.193) to 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.508947 31028 raft_consensus.cc:2468] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 2.
I20260709 12:22:39.510000 31153 consensus_queue.cc:1048] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.512338 31031 raft_consensus.cc:515] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.513303 31029 raft_consensus.cc:1240] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Rejecting Update request from peer e11cf9c16d534db5a321ab416db473ad for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:39.515127 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7885d480186746da9a317e07d3dcde66" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:39.515735 30881 raft_consensus.cc:3055] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.516031 30881 raft_consensus.cc:740] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:39.516757 30881 consensus_queue.cc:260] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.517539 31153 consensus_queue.cc:1059] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.518198 31031 leader_election.cc:290] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 2 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:39.519274 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7885d480186746da9a317e07d3dcde66" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:39.521648 30881 raft_consensus.cc:3060] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.528091 30881 raft_consensus.cc:2468] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 2.
I20260709 12:22:39.529074 30997 leader_election.cc:304] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:39.529879 31106 raft_consensus.cc:2804] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.530341 31106 raft_consensus.cc:697] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 2 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:39.531080 31106 consensus_queue.cc:237] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.537696 30779 catalog_manager.cc:5697] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 1 to 2, leader changed from e11cf9c16d534db5a321ab416db473ad (127.29.131.193) to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 2 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.560462 31091 consensus_queue.cc:1048] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.570236 31091 consensus_queue.cc:1048] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.625654 31075 raft_consensus.cc:993] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.626085 31106 raft_consensus.cc:1081] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.627653 30881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35574
I20260709 12:22:39.628070 30881 raft_consensus.cc:493] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.628386 30881 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.632665 30881 raft_consensus.cc:515] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.634088 30881 leader_election.cc:290] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.634934 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:39.635367 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.635555 30957 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.635938 31031 raft_consensus.cc:3055] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.636204 31031 raft_consensus.cc:740] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:39.637002 31031 consensus_queue.cc:260] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.637888 31031 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.640435 30957 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.641413 30846 leader_election.cc:304] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:39.642076 31153 raft_consensus.cc:2804] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.642365 31031 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.642483 31153 raft_consensus.cc:697] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:39.643275 31153 consensus_queue.cc:237] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.649454 30780 catalog_manager.cc:5697] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 1 to 2, leader changed from eda02608ab584ab888fd554b9d697d71 (127.29.131.195) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 2 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.660727 31081 raft_consensus.cc:993] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.661139 31091 raft_consensus.cc:1081] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.662523 30881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12746b6fa6b94e65911c7262fa8d29e2"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35566
I20260709 12:22:39.663085 30881 raft_consensus.cc:493] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.663465 30881 raft_consensus.cc:3060] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.667915 30881 raft_consensus.cc:515] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:39.669440 30881 leader_election.cc:290] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Requested vote from peers eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:39.670315 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12746b6fa6b94e65911c7262fa8d29e2" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.670471 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12746b6fa6b94e65911c7262fa8d29e2" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:39.670912 31031 raft_consensus.cc:3060] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.670996 30957 raft_consensus.cc:3055] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.671418 30957 raft_consensus.cc:740] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:39.672106 30957 consensus_queue.cc:260] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:39.672986 30957 raft_consensus.cc:3060] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.675540 31031 raft_consensus.cc:2468] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.676584 30846 leader_election.cc:304] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:39.677250 31153 raft_consensus.cc:2804] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.677671 31153 raft_consensus.cc:697] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:39.678453 31153 consensus_queue.cc:237] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } }
I20260709 12:22:39.678675 30957 raft_consensus.cc:2468] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.684140 30780 catalog_manager.cc:5697] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 1 to 2, leader changed from 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 2 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.705299 31106 consensus_queue.cc:1048] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.711338 31075 raft_consensus.cc:993] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71: : Instructing follower 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:39.711778 31104 raft_consensus.cc:1081] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Signalling peer 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:39.713429 30956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:46956
I20260709 12:22:39.713991 30956 raft_consensus.cc:493] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.714392 30956 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.717628 31104 consensus_queue.cc:1048] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.721017 30956 raft_consensus.cc:515] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.725577 30956 leader_election.cc:290] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 2 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.726549 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.727150 31031 raft_consensus.cc:3055] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.727161 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:39.727644 31031 raft_consensus.cc:740] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:39.727909 30881 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.729065 31031 consensus_queue.cc:260] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.730655 31031 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.733911 31075 raft_consensus.cc:993] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71: : Instructing follower 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:39.734316 31107 raft_consensus.cc:1081] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Signalling peer 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:39.735664 30881 raft_consensus.cc:2468] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 2.
I20260709 12:22:39.736176 30956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:46956
I20260709 12:22:39.736713 30956 raft_consensus.cc:493] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.737074 30956 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.738938 30923 leader_election.cc:304] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:39.740097 31091 raft_consensus.cc:2804] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.740676 31091 raft_consensus.cc:697] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Becoming Leader. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:39.741600 31091 consensus_queue.cc:237] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.746896 30956 raft_consensus.cc:515] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.748852 31031 raft_consensus.cc:2468] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 2.
I20260709 12:22:39.749608 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:39.750064 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.750346 30881 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.749717 30779 catalog_manager.cc:5697] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 reported cstate change: term changed from 1 to 2, leader changed from eda02608ab584ab888fd554b9d697d71 (127.29.131.195) to 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.750627 31029 raft_consensus.cc:3055] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.750988 31029 raft_consensus.cc:740] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:39.751407 30956 leader_election.cc:290] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 2 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.751785 31029 consensus_queue.cc:260] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.753023 31029 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.755532 30881 raft_consensus.cc:2468] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 2.
I20260709 12:22:39.756774 30923 leader_election.cc:304] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:39.757725 31091 raft_consensus.cc:2804] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.758174 31091 raft_consensus.cc:697] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Becoming Leader. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:39.758857 31091 consensus_queue.cc:237] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.759075 31029 raft_consensus.cc:2468] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 2.
I20260709 12:22:39.764539 30779 catalog_manager.cc:5697] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 reported cstate change: term changed from 1 to 2, leader changed from eda02608ab584ab888fd554b9d697d71 (127.29.131.195) to 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.830783 31075 raft_consensus.cc:993] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.831274 31107 raft_consensus.cc:1081] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.832623 30881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35574
I20260709 12:22:39.833261 30881 raft_consensus.cc:493] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.833649 30881 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.838220 30881 raft_consensus.cc:515] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.839736 30881 leader_election.cc:290] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.840579 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:39.840811 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.841166 30956 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.841338 31029 raft_consensus.cc:3055] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.841675 31029 raft_consensus.cc:740] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:39.842492 31029 consensus_queue.cc:260] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.843713 31029 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.847955 30956 raft_consensus.cc:2468] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.849072 30846 leader_election.cc:304] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:39.849756 31153 raft_consensus.cc:2804] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.850193 31153 raft_consensus.cc:697] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:39.850374 31029 raft_consensus.cc:2468] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.851022 31153 consensus_queue.cc:237] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.851850 31131 raft_consensus.cc:993] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.852265 31091 raft_consensus.cc:1081] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.854266 30881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35566
I20260709 12:22:39.854677 30881 raft_consensus.cc:493] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.854969 30881 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.856945 30779 catalog_manager.cc:5697] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 1 to 2, leader changed from eda02608ab584ab888fd554b9d697d71 (127.29.131.195) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 2 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.859194 30881 raft_consensus.cc:515] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.861039 30881 leader_election.cc:290] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.861997 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:39.862078 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.862675 30956 raft_consensus.cc:3055] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.862746 31029 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.863135 30956 raft_consensus.cc:740] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:39.863969 30956 consensus_queue.cc:260] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.865195 30956 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.869477 31029 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.870543 30846 leader_election.cc:304] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:39.871204 31153 raft_consensus.cc:2804] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.871668 31153 raft_consensus.cc:697] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:39.871762 30956 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.872458 31153 consensus_queue.cc:237] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.878381 30779 catalog_manager.cc:5697] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 1 to 2, leader changed from 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 2 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.946195 31075 raft_consensus.cc:993] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.946695 31075 raft_consensus.cc:1081] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:39.948168 30881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35574
I20260709 12:22:39.948609 30881 raft_consensus.cc:493] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:39.948894 30881 raft_consensus.cc:3060] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.952984 30881 raft_consensus.cc:515] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.954320 30881 leader_election.cc:290] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:39.955179 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:39.955408 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ef0ed31f5e474599bbc2c62c0c90ca" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:39.955796 30956 raft_consensus.cc:3060] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.955911 31029 raft_consensus.cc:3055] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:39.956256 31029 raft_consensus.cc:740] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:39.957062 31029 consensus_queue.cc:260] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.958250 31029 raft_consensus.cc:3060] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.962843 30956 raft_consensus.cc:2468] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.964095 30846 leader_election.cc:304] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:39.964918 31153 raft_consensus.cc:2804] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.965176 31029 raft_consensus.cc:2468] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:39.965390 31153 raft_consensus.cc:697] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:39.966306 31153 consensus_queue.cc:237] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:39.972366 30779 catalog_manager.cc:5697] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 1 to 2, leader changed from eda02608ab584ab888fd554b9d697d71 (127.29.131.195) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 2 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.034497 30956 raft_consensus.cc:3060] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.039484 30956 raft_consensus.cc:1275] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.040777 31075 consensus_queue.cc:1048] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.051194 30881 raft_consensus.cc:1275] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.051311 30882 raft_consensus.cc:1275] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.052687 31091 consensus_queue.cc:1048] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.053098 31075 consensus_queue.cc:1048] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.062564 31029 raft_consensus.cc:1275] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.066036 31131 consensus_queue.cc:1048] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.142347 31031 raft_consensus.cc:1275] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.143757 31153 consensus_queue.cc:1048] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.145941 31031 raft_consensus.cc:1275] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.147737 31131 consensus_queue.cc:1048] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.153198 30956 raft_consensus.cc:1275] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.155244 31096 consensus_queue.cc:1048] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.156832 30881 raft_consensus.cc:1275] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.158352 31131 consensus_queue.cc:1048] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.159036 31029 raft_consensus.cc:1275] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.160483 31153 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.172709 30956 raft_consensus.cc:1275] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.175221 31161 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.211534 30881 raft_consensus.cc:1275] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.212761 31131 consensus_queue.cc:1048] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.220271 31029 raft_consensus.cc:1275] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.221673 31081 consensus_queue.cc:1048] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.266116 31029 raft_consensus.cc:1275] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.267305 31161 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.274837 30956 raft_consensus.cc:1275] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.276377 31096 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.327966 30956 raft_consensus.cc:1275] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.329250 31096 consensus_queue.cc:1048] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.337013 31029 raft_consensus.cc:1275] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.338366 31153 consensus_queue.cc:1048] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.438556 30956 raft_consensus.cc:1275] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.439970 31161 consensus_queue.cc:1048] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.448428 31031 raft_consensus.cc:1275] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.450101 31096 consensus_queue.cc:1048] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:42.645804 30223 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:22:42.646740 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:42.670706 30881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
mode: GRACEFUL
new_leader_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:35590
I20260709 12:22:42.671134 30881 raft_consensus.cc:606] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Received request to transfer leadership to TS eda02608ab584ab888fd554b9d697d71
I20260709 12:22:42.673260 30881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
mode: GRACEFUL
new_leader_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:35590
I20260709 12:22:42.673619 30881 raft_consensus.cc:606] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Received request to transfer leadership to TS eda02608ab584ab888fd554b9d697d71
I20260709 12:22:42.674517 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:42.674898 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:42.894817 31096 raft_consensus.cc:993] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad: : Instructing follower eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:42.895277 31174 raft_consensus.cc:1081] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Signalling peer eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:42.896651 31029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:32800
I20260709 12:22:42.897085 31029 raft_consensus.cc:493] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:42.897343 31029 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.902237 31029 raft_consensus.cc:515] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:42.903965 31029 leader_election.cc:290] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 3 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:42.904574 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:42.904970 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:42.905118 30881 raft_consensus.cc:3055] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:42.905521 30881 raft_consensus.cc:740] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:42.905540 30955 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.906351 30881 consensus_queue.cc:260] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:42.907472 30881 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.910575 30955 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 3.
I20260709 12:22:42.911438 30881 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 3.
I20260709 12:22:42.911580 30995 leader_election.cc:304] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:42.912343 31075 raft_consensus.cc:2804] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:42.912789 31075 raft_consensus.cc:697] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:42.913532 31075 consensus_queue.cc:237] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:42.921425 30779 catalog_manager.cc:5697] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 2 to 3, leader changed from e11cf9c16d534db5a321ab416db473ad (127.29.131.193) to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 3 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.055810 31096 raft_consensus.cc:993] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad: : Instructing follower eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:43.056361 31174 raft_consensus.cc:1081] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Signalling peer eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:43.057732 31029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:32800
I20260709 12:22:43.058151 31029 raft_consensus.cc:493] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.058418 31029 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.063467 31029 raft_consensus.cc:515] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:43.064926 31029 leader_election.cc:290] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 3 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:43.065553 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:43.065881 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:43.066075 30881 raft_consensus.cc:3055] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:43.066438 30881 raft_consensus.cc:740] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:43.066447 30955 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.067178 30881 consensus_queue.cc:260] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:43.068161 30881 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.071449 30955 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 3.
I20260709 12:22:43.072135 30881 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 3.
I20260709 12:22:43.072359 30995 leader_election.cc:304] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:43.073083 31075 raft_consensus.cc:2804] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:43.073467 31075 raft_consensus.cc:697] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:43.074069 31075 consensus_queue.cc:237] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:43.083262 30779 catalog_manager.cc:5697] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 2 to 3, leader changed from e11cf9c16d534db5a321ab416db473ad (127.29.131.193) to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 3 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:43.199596 30811 debug-util.cc:398] Leaking SignalData structure 0x7b0800053560 after lost signal to thread 30226
W20260709 12:22:43.200348 30811 debug-util.cc:398] Leaking SignalData structure 0x7b0800053c40 after lost signal to thread 30814
W20260709 12:22:43.201579 30811 debug-util.cc:398] Leaking SignalData structure 0x7b08001138c0 after lost signal to thread 30981
W20260709 12:22:43.202323 30811 debug-util.cc:398] Leaking SignalData structure 0x7b0800178de0 after lost signal to thread 31055
I20260709 12:22:43.400094 30881 raft_consensus.cc:1275] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:43.401362 31075 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:43.420770 30955 raft_consensus.cc:1275] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:43.423390 31189 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:43.639912 30881 raft_consensus.cc:1275] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:43.642786 31189 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:43.645010 30955 raft_consensus.cc:1275] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:43.646806 31189 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:43.676084 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.693024 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:43.693727 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:44.694949 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:44.702637 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:44.703145 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:45.704123 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.712312 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:45.712859 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:46.713832 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.720597 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:46.721163 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:47.722127 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.730165 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:47.730767 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:48.731792 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.736964 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:48.737417 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:49.738358 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:49.743587 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:49.744019 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.745020 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.750941 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:50.751371 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.752391 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.757637 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:51.758035 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:52.787066 30223 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:22:52.796478 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:32806
I20260709 12:22:52.797010 31028 raft_consensus.cc:606] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:52.801224 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:32806
I20260709 12:22:52.801631 31028 raft_consensus.cc:606] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:52.808187 30955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:46962
I20260709 12:22:52.808601 30955 raft_consensus.cc:606] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:52.812855 30955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:46962
I20260709 12:22:52.813282 30955 raft_consensus.cc:606] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:52.817417 30955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
mode: GRACEFUL
new_leader_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:46962
I20260709 12:22:52.817816 30955 raft_consensus.cc:606] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Received request to transfer leadership to TS e11cf9c16d534db5a321ab416db473ad
I20260709 12:22:52.928562 31201 raft_consensus.cc:993] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:52.928745 31204 raft_consensus.cc:993] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:52.929172 31203 raft_consensus.cc:1081] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:52.929275 31189 raft_consensus.cc:1081] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:52.930672 30881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35566
I20260709 12:22:52.931071 30882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35574
I20260709 12:22:52.931275 30881 raft_consensus.cc:493] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:52.931589 30882 raft_consensus.cc:493] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:52.931658 30881 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.932055 30882 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:52.939200 30882 raft_consensus.cc:515] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.939255 30881 raft_consensus.cc:515] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.939946 31201 raft_consensus.cc:993] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:52.940470 31203 raft_consensus.cc:1081] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:52.941392 30881 leader_election.cc:290] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 3 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:52.942170 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:52.942775 30955 raft_consensus.cc:3055] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:52.942824 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:52.943203 30955 raft_consensus.cc:740] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:52.943377 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:52.943279 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:52.944011 30956 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:52.944056 31029 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.943497 31028 raft_consensus.cc:3055] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:52.944597 31028 raft_consensus.cc:740] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:52.944188 30955 consensus_queue.cc:260] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.945477 30955 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.945519 31028 consensus_queue.cc:260] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.946808 31028 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:52.941365 30882 leader_election.cc:290] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 4 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:52.952018 31029 raft_consensus.cc:2468] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 3.
I20260709 12:22:52.952832 30882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35566
I20260709 12:22:52.950793 30956 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 4.
I20260709 12:22:52.953187 30846 leader_election.cc:304] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:52.953452 30882 raft_consensus.cc:493] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:52.953871 30882 raft_consensus.cc:3060] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.954164 31198 raft_consensus.cc:2804] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:52.955298 31198 raft_consensus.cc:697] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 3 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:52.956193 31198 consensus_queue.cc:237] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.957988 31028 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 4.
I20260709 12:22:52.959298 30846 leader_election.cc:304] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:52.960433 30882 raft_consensus.cc:515] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.961861 31198 raft_consensus.cc:2804] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:52.963020 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:52.963575 31198 raft_consensus.cc:697] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:52.952526 30955 raft_consensus.cc:2468] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 3.
I20260709 12:22:52.963652 30956 raft_consensus.cc:3055] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:52.964195 30956 raft_consensus.cc:740] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:52.964560 31198 consensus_queue.cc:237] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.965071 30780 catalog_manager.cc:5697] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 2 to 3, leader changed from 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 3 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.965590 30956 consensus_queue.cc:260] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.966637 30956 raft_consensus.cc:3060] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.967599 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1009dd6b42cb4235b81c6a0e8597b3dc" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:52.968479 31028 raft_consensus.cc:3060] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.974869 30956 raft_consensus.cc:2468] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:52.977036 30846 leader_election.cc:304] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:52.977926 31198 raft_consensus.cc:2804] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:52.962023 30882 leader_election.cc:290] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 2 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:52.978480 31198 raft_consensus.cc:697] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:52.979668 31198 consensus_queue.cc:237] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:52.978367 31028 raft_consensus.cc:2468] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 2.
I20260709 12:22:52.993445 30780 catalog_manager.cc:5697] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 3 to 4, leader changed from eda02608ab584ab888fd554b9d697d71 (127.29.131.195) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 4 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.994580 30780 catalog_manager.cc:5697] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 1 to 2, leader changed from 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 2 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.997465 31201 raft_consensus.cc:993] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:52.997946 31203 raft_consensus.cc:1081] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:52.999792 30882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35566
I20260709 12:22:53.000227 30882 raft_consensus.cc:493] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.000530 30882 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.005569 30882 raft_consensus.cc:515] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:53.006848 30882 leader_election.cc:290] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 3 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:53.007637 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:53.007858 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abe322f03d3449e9bce7ac8b011f547" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:53.008177 30956 raft_consensus.cc:3055] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:53.008443 31028 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.008493 30956 raft_consensus.cc:740] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:53.009420 30956 consensus_queue.cc:260] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:53.010535 30956 raft_consensus.cc:3060] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.013340 31028 raft_consensus.cc:2468] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 3.
I20260709 12:22:53.014355 30846 leader_election.cc:304] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:53.015008 31198 raft_consensus.cc:2804] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:53.015362 30956 raft_consensus.cc:2468] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 3.
I20260709 12:22:53.015493 31198 raft_consensus.cc:697] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 3 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:53.016371 31198 consensus_queue.cc:237] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:53.023433 30780 catalog_manager.cc:5697] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 2 to 3, leader changed from 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 3 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.032337 31204 raft_consensus.cc:993] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71: : Instructing follower e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:53.032721 31189 raft_consensus.cc:1081] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Signalling peer e11cf9c16d534db5a321ab416db473ad to start an election
I20260709 12:22:53.033972 30882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
 from {username='slave'} at 127.0.0.1:35574
I20260709 12:22:53.034379 30882 raft_consensus.cc:493] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.034696 30882 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:53.038781 30882 raft_consensus.cc:515] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:53.040077 30882 leader_election.cc:290] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 4 election: Requested vote from peers 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:53.040807 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:53.041020 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "e11cf9c16d534db5a321ab416db473ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:53.041291 30956 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:53.041507 31029 raft_consensus.cc:3055] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:53.041796 31029 raft_consensus.cc:740] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:53.042342 31029 consensus_queue.cc:260] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:53.043170 31029 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:53.045450 30956 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 4.
I20260709 12:22:53.046334 30846 leader_election.cc:304] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, e11cf9c16d534db5a321ab416db473ad; no voters: 
I20260709 12:22:53.046984 31198 raft_consensus.cc:2804] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:53.047173 31029 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cf9c16d534db5a321ab416db473ad in term 4.
I20260709 12:22:53.047523 31198 raft_consensus.cc:697] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Becoming Leader. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:53.048426 31198 consensus_queue.cc:237] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:53.055011 30780 catalog_manager.cc:5697] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad reported cstate change: term changed from 3 to 4, leader changed from eda02608ab584ab888fd554b9d697d71 (127.29.131.195) to e11cf9c16d534db5a321ab416db473ad (127.29.131.193). New cstate: current_term: 4 leader_uuid: "e11cf9c16d534db5a321ab416db473ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.346694 30956 raft_consensus.cc:1275] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:53.347882 31198 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:53.357214 31029 raft_consensus.cc:1275] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:53.358950 31198 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:53.452464 30956 raft_consensus.cc:1275] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.453514 31198 consensus_queue.cc:1048] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.462544 31029 raft_consensus.cc:1275] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.464138 31222 consensus_queue.cc:1048] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:53.480268 30956 raft_consensus.cc:1275] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:53.481180 31222 consensus_queue.cc:1048] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.491088 31029 raft_consensus.cc:1275] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:53.492509 31198 consensus_queue.cc:1048] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.492879 30956 raft_consensus.cc:1275] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:53.494437 31198 consensus_queue.cc:1048] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.506068 31029 raft_consensus.cc:1275] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:53.507550 31198 consensus_queue.cc:1048] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.539616 30956 raft_consensus.cc:1275] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:53.540700 31198 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:53.549625 31029 raft_consensus.cc:1275] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Refusing update from remote peer e11cf9c16d534db5a321ab416db473ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:53.550828 31221 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:55.852675 30223 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:22:55.853533 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:55.862407 30882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
mode: GRACEFUL
new_leader_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:35590
I20260709 12:22:55.863046 30882 raft_consensus.cc:606] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Received request to transfer leadership to TS eda02608ab584ab888fd554b9d697d71
I20260709 12:22:55.865486 30882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
mode: GRACEFUL
new_leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:35590
I20260709 12:22:55.865901 30882 raft_consensus.cc:606] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Received request to transfer leadership to TS 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:55.867841 30882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
mode: GRACEFUL
new_leader_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:35590
I20260709 12:22:55.868244 30882 raft_consensus.cc:606] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 3 LEADER]: Received request to transfer leadership to TS eda02608ab584ab888fd554b9d697d71
I20260709 12:22:55.870111 30882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee"
dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
mode: GRACEFUL
new_leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:35590
I20260709 12:22:55.870522 30882 raft_consensus.cc:606] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Received request to transfer leadership to TS 3f97dc9c5128456e97d2ba86d4f959d3
I20260709 12:22:55.871443 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:55.871897 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:55.924093 31231 raft_consensus.cc:993] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad: : Instructing follower eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:55.924651 31232 raft_consensus.cc:1081] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 3 LEADER]: Signalling peer eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:55.926159 31029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:32800
I20260709 12:22:55.926728 31029 raft_consensus.cc:493] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.927064 31029 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.928313 31232 raft_consensus.cc:993] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad: : Instructing follower 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:55.928735 31231 raft_consensus.cc:1081] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Signalling peer 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:55.930160 30955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:46940
I20260709 12:22:55.930562 30955 raft_consensus.cc:493] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.930814 30955 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:55.932973 31029 raft_consensus.cc:515] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:55.935288 30955 raft_consensus.cc:515] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:55.935613 31029 leader_election.cc:290] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 4 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:55.935947 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:55.936405 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379cbcd9ddc44752a35f8c3465a8865b" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:55.936738 30882 raft_consensus.cc:3055] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:55.936987 30956 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.937103 30882 raft_consensus.cc:740] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:55.938292 30955 leader_election.cc:290] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 5 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:55.937996 30882 consensus_queue.cc:260] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:55.938884 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:55.939379 30882 raft_consensus.cc:3060] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.939450 30881 raft_consensus.cc:3055] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:55.939953 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2230ffbd279a42dc8d921472d6bf9c81" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:55.940380 30881 raft_consensus.cc:740] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:55.940558 31029 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:55.941180 30881 consensus_queue.cc:260] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:55.942340 30881 raft_consensus.cc:3060] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:55.943958 30956 raft_consensus.cc:2468] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 4.
I20260709 12:22:55.945513 30995 leader_election.cc:304] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:55.946204 30882 raft_consensus.cc:2468] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 4.
I20260709 12:22:55.946388 31189 raft_consensus.cc:2804] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:55.946630 31029 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 5.
I20260709 12:22:55.947988 30921 leader_election.cc:304] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:55.948275 31189 raft_consensus.cc:697] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 4 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:55.948957 31203 raft_consensus.cc:2804] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:55.949214 31189 consensus_queue.cc:237] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:55.949925 30881 raft_consensus.cc:2468] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 5.
I20260709 12:22:55.950485 31203 raft_consensus.cc:697] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 LEADER]: Becoming Leader. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:55.951481 31203 consensus_queue.cc:237] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:55.957710 30780 catalog_manager.cc:5697] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 3 to 4, leader changed from e11cf9c16d534db5a321ab416db473ad (127.29.131.193) to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 4 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.959755 30779 catalog_manager.cc:5697] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 reported cstate change: term changed from 4 to 5, leader changed from e11cf9c16d534db5a321ab416db473ad (127.29.131.193) to 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194). New cstate: current_term: 5 leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.116973 31232 raft_consensus.cc:993] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad: : Instructing follower 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:56.117395 31231 raft_consensus.cc:1081] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Signalling peer 3f97dc9c5128456e97d2ba86d4f959d3 to start an election
I20260709 12:22:56.118618 30956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee"
dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
 from {username='slave'} at 127.0.0.1:46940
I20260709 12:22:56.119021 30956 raft_consensus.cc:493] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:56.119316 30956 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:56.123749 30956 raft_consensus.cc:515] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:56.125442 30956 leader_election.cc:290] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 5 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), eda02608ab584ab888fd554b9d697d71 (127.29.131.195:39493)
I20260709 12:22:56.126212 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:56.126453 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df879844456449b854d8d0d0fe966ee" candidate_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "eda02608ab584ab888fd554b9d697d71"
I20260709 12:22:56.126763 30881 raft_consensus.cc:3055] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:56.127033 31029 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:56.127068 30881 raft_consensus.cc:740] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:56.128031 30881 consensus_queue.cc:260] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:56.129120 30881 raft_consensus.cc:3060] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:56.133240 31029 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 5.
I20260709 12:22:56.134238 30921 leader_election.cc:304] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f97dc9c5128456e97d2ba86d4f959d3, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:56.134873 31203 raft_consensus.cc:2804] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:56.134986 30881 raft_consensus.cc:2468] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f97dc9c5128456e97d2ba86d4f959d3 in term 5.
I20260709 12:22:56.135439 31203 raft_consensus.cc:697] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 LEADER]: Becoming Leader. State: Replica: 3f97dc9c5128456e97d2ba86d4f959d3, State: Running, Role: LEADER
I20260709 12:22:56.136445 31203 consensus_queue.cc:237] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:56.143505 30779 catalog_manager.cc:5697] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 reported cstate change: term changed from 4 to 5, leader changed from e11cf9c16d534db5a321ab416db473ad (127.29.131.193) to 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194). New cstate: current_term: 5 leader_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.364208 31029 raft_consensus.cc:1275] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 5 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:56.365417 31203 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:56.374996 30881 raft_consensus.cc:1275] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 5 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:56.376665 31234 consensus_queue.cc:1048] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:56.381590 30956 raft_consensus.cc:1275] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:56.383023 31189 consensus_queue.cc:1048] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:56.390729 31232 raft_consensus.cc:993] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad: : Instructing follower eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:56.393020 31232 raft_consensus.cc:1081] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Signalling peer eda02608ab584ab888fd554b9d697d71 to start an election
I20260709 12:22:56.395303 31029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2"
dest_uuid: "eda02608ab584ab888fd554b9d697d71"
 from {username='slave'} at 127.0.0.1:32800
I20260709 12:22:56.395895 31029 raft_consensus.cc:493] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:56.396255 31029 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.404075 30881 raft_consensus.cc:1275] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:56.404848 31029 raft_consensus.cc:515] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:56.405781 31189 consensus_queue.cc:1048] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:56.407354 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e11cf9c16d534db5a321ab416db473ad"
I20260709 12:22:56.407872 30881 raft_consensus.cc:3055] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:56.408183 30881 raft_consensus.cc:740] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cf9c16d534db5a321ab416db473ad, State: Running, Role: LEADER
I20260709 12:22:56.411585 30881 consensus_queue.cc:260] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:56.412768 30881 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.414628 31029 leader_election.cc:290] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 3 election: Requested vote from peers e11cf9c16d534db5a321ab416db473ad (127.29.131.193:37675), 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485)
I20260709 12:22:56.417402 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b05a0e44528465d808ebafdf0fbe0f2" candidate_uuid: "eda02608ab584ab888fd554b9d697d71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f97dc9c5128456e97d2ba86d4f959d3"
I20260709 12:22:56.417819 30956 raft_consensus.cc:3060] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.419303 30881 raft_consensus.cc:2468] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 3.
I20260709 12:22:56.420327 30997 leader_election.cc:304] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11cf9c16d534db5a321ab416db473ad, eda02608ab584ab888fd554b9d697d71; no voters: 
I20260709 12:22:56.421031 31189 raft_consensus.cc:2804] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:56.421406 31189 raft_consensus.cc:697] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Becoming Leader. State: Replica: eda02608ab584ab888fd554b9d697d71, State: Running, Role: LEADER
I20260709 12:22:56.422151 31189 consensus_queue.cc:237] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } }
I20260709 12:22:56.423077 30956 raft_consensus.cc:2468] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda02608ab584ab888fd554b9d697d71 in term 3.
I20260709 12:22:56.429050 30780 catalog_manager.cc:5697] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 reported cstate change: term changed from 2 to 3, leader changed from e11cf9c16d534db5a321ab416db473ad (127.29.131.193) to eda02608ab584ab888fd554b9d697d71 (127.29.131.195). New cstate: current_term: 3 leader_uuid: "eda02608ab584ab888fd554b9d697d71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:56.670578 30881 raft_consensus.cc:1275] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 5 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:56.671725 31248 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:56.681107 31029 raft_consensus.cc:1275] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 5 FOLLOWER]: Refusing update from remote peer 3f97dc9c5128456e97d2ba86d4f959d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:56.682323 31203 consensus_queue.cc:1048] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda02608ab584ab888fd554b9d697d71" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:56.828498 30956 raft_consensus.cc:1275] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:56.829679 31189 consensus_queue.cc:1048] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f97dc9c5128456e97d2ba86d4f959d3" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:56.838862 30881 raft_consensus.cc:1275] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Refusing update from remote peer eda02608ab584ab888fd554b9d697d71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:56.841257 31251 consensus_queue.cc:1048] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cf9c16d534db5a321ab416db473ad" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:56.872821 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:56.878193 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:56.878587 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:57.879522 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.885010 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:57.885464 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:58.886302 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:58.891651 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:58.892102 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:59.892997 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:59.898782 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:59.899221 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:00.900162 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:00.905656 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:00.906071 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:02.025279 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:02.030534 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:02.030892 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:02.366052 30903 debug-util.cc:398] Leaking SignalData structure 0x7b08001921a0 after lost signal to thread 30226
W20260709 12:23:02.366866 30903 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4420 after lost signal to thread 30814
W20260709 12:23:02.367650 30903 debug-util.cc:398] Leaking SignalData structure 0x7b080011b540 after lost signal to thread 30906
W20260709 12:23:02.368382 30903 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6540 after lost signal to thread 30981
W20260709 12:23:02.369128 30903 debug-util.cc:398] Leaking SignalData structure 0x7b08001760a0 after lost signal to thread 31055
I20260709 12:23:03.031888 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.040503 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:03.041046 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:04.042379 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:04.048267 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:04.048694 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.049835 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.055586 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:05.056078 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.086419 30223 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:23:06.087107 30223 tablet_server.cc:179] TabletServer@127.29.131.193:0 shutting down...
I20260709 12:23:06.121172 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:06.121809 30223 tablet_replica.cc:333] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.122550 30223 raft_consensus.cc:2243] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.123157 30223 raft_consensus.cc:2272] T 7885d480186746da9a317e07d3dcde66 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.125135 30223 tablet_replica.cc:333] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.125602 30223 raft_consensus.cc:2243] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.125988 30223 raft_consensus.cc:2272] T 379cbcd9ddc44752a35f8c3465a8865b P e11cf9c16d534db5a321ab416db473ad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.127799 30223 tablet_replica.cc:333] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.128350 30223 raft_consensus.cc:2243] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.129073 30223 raft_consensus.cc:2272] T 8abe322f03d3449e9bce7ac8b011f547 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.130734 30223 tablet_replica.cc:333] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.131181 30223 raft_consensus.cc:2243] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.131790 30223 raft_consensus.cc:2272] T f33b148046cc4e1babf52f7f3e0dd87d P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.133644 30223 tablet_replica.cc:333] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.134068 30223 raft_consensus.cc:2243] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.134728 30223 raft_consensus.cc:2272] T 1009dd6b42cb4235b81c6a0e8597b3dc P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.136629 30223 tablet_replica.cc:333] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.137236 30223 raft_consensus.cc:2243] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.138083 30223 raft_consensus.cc:2272] T 12746b6fa6b94e65911c7262fa8d29e2 P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.140123 30223 tablet_replica.cc:333] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.140585 30223 raft_consensus.cc:2243] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.140985 30223 raft_consensus.cc:2272] T 2230ffbd279a42dc8d921472d6bf9c81 P e11cf9c16d534db5a321ab416db473ad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.142832 30223 tablet_replica.cc:333] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.143355 30223 raft_consensus.cc:2243] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.144042 30223 raft_consensus.cc:2272] T 34ef0ed31f5e474599bbc2c62c0c90ca P e11cf9c16d534db5a321ab416db473ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.145658 30223 tablet_replica.cc:333] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.146100 30223 raft_consensus.cc:2243] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.146533 30223 raft_consensus.cc:2272] T 0b05a0e44528465d808ebafdf0fbe0f2 P e11cf9c16d534db5a321ab416db473ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.148461 30223 tablet_replica.cc:333] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad: stopping tablet replica
I20260709 12:23:06.148865 30223 raft_consensus.cc:2243] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.149243 30223 raft_consensus.cc:2272] T 9df879844456449b854d8d0d0fe966ee P e11cf9c16d534db5a321ab416db473ad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.197284 30223 tablet_server.cc:196] TabletServer@127.29.131.193:0 shutdown complete.
I20260709 12:23:06.218745 30223 tablet_server.cc:179] TabletServer@127.29.131.194:0 shutting down...
I20260709 12:23:06.244168 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:06.244959 30223 tablet_replica.cc:333] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.245932 30223 raft_consensus.cc:2243] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.246655 30223 raft_consensus.cc:2272] T 379cbcd9ddc44752a35f8c3465a8865b P 3f97dc9c5128456e97d2ba86d4f959d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.248550 30223 tablet_replica.cc:333] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.249023 30223 raft_consensus.cc:2243] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.249817 30223 raft_consensus.cc:2272] T f33b148046cc4e1babf52f7f3e0dd87d P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.251593 30223 tablet_replica.cc:333] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.252023 30223 raft_consensus.cc:2243] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.252382 30223 raft_consensus.cc:2272] T 7885d480186746da9a317e07d3dcde66 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.254056 30223 tablet_replica.cc:333] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.254496 30223 raft_consensus.cc:2243] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.254860 30223 raft_consensus.cc:2272] T 8abe322f03d3449e9bce7ac8b011f547 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.256721 30223 tablet_replica.cc:333] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.257195 30223 raft_consensus.cc:2243] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.257583 30223 raft_consensus.cc:2272] T 1009dd6b42cb4235b81c6a0e8597b3dc P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.259102 30223 tablet_replica.cc:333] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.259637 30223 raft_consensus.cc:2243] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.260063 30223 raft_consensus.cc:2272] T 12746b6fa6b94e65911c7262fa8d29e2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.261703 30223 tablet_replica.cc:333] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.262213 30223 raft_consensus.cc:2243] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.262955 30223 raft_consensus.cc:2272] T 2230ffbd279a42dc8d921472d6bf9c81 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.264662 30223 tablet_replica.cc:333] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.265149 30223 raft_consensus.cc:2243] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.265947 30223 raft_consensus.cc:2272] T 9df879844456449b854d8d0d0fe966ee P 3f97dc9c5128456e97d2ba86d4f959d3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.267838 30223 tablet_replica.cc:333] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.268313 30223 raft_consensus.cc:2243] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.268723 30223 raft_consensus.cc:2272] T 0b05a0e44528465d808ebafdf0fbe0f2 P 3f97dc9c5128456e97d2ba86d4f959d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.270323 30223 tablet_replica.cc:333] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3: stopping tablet replica
I20260709 12:23:06.270756 30223 raft_consensus.cc:2243] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.271188 30223 raft_consensus.cc:2272] T 34ef0ed31f5e474599bbc2c62c0c90ca P 3f97dc9c5128456e97d2ba86d4f959d3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:06.296159 30995 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.131.194:39485: connect: Connection refused (error 111) [suppressed 41 similar messages]
W20260709 12:23:06.299562 30995 consensus_peers.cc:597] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 -> Peer 3f97dc9c5128456e97d2ba86d4f959d3 (127.29.131.194:39485): Couldn't send request to peer 3f97dc9c5128456e97d2ba86d4f959d3. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:39485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:06.300828 30223 tablet_server.cc:196] TabletServer@127.29.131.194:0 shutdown complete.
I20260709 12:23:06.318897 30223 tablet_server.cc:179] TabletServer@127.29.131.195:0 shutting down...
I20260709 12:23:06.347725 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:06.348784 30223 tablet_replica.cc:333] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.349570 30223 raft_consensus.cc:2243] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.350193 30223 raft_consensus.cc:2272] T 8abe322f03d3449e9bce7ac8b011f547 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.352061 30223 tablet_replica.cc:333] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.352552 30223 raft_consensus.cc:2243] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.353350 30223 raft_consensus.cc:2272] T 7885d480186746da9a317e07d3dcde66 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.355015 30223 tablet_replica.cc:333] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.355700 30223 raft_consensus.cc:2243] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.356191 30223 raft_consensus.cc:2272] T f33b148046cc4e1babf52f7f3e0dd87d P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.357932 30223 tablet_replica.cc:333] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.358482 30223 raft_consensus.cc:2243] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.358891 30223 raft_consensus.cc:2272] T 1009dd6b42cb4235b81c6a0e8597b3dc P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.360500 30223 tablet_replica.cc:333] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.360975 30223 raft_consensus.cc:2243] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.361393 30223 raft_consensus.cc:2272] T 12746b6fa6b94e65911c7262fa8d29e2 P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.362954 30223 tablet_replica.cc:333] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.363507 30223 raft_consensus.cc:2243] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.363945 30223 raft_consensus.cc:2272] T 2230ffbd279a42dc8d921472d6bf9c81 P eda02608ab584ab888fd554b9d697d71 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.365609 30223 tablet_replica.cc:333] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.366175 30223 raft_consensus.cc:2243] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.366974 30223 raft_consensus.cc:2272] T 379cbcd9ddc44752a35f8c3465a8865b P eda02608ab584ab888fd554b9d697d71 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.368582 30223 tablet_replica.cc:333] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.369052 30223 raft_consensus.cc:2243] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.369535 30223 raft_consensus.cc:2272] T 9df879844456449b854d8d0d0fe966ee P eda02608ab584ab888fd554b9d697d71 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.371110 30223 tablet_replica.cc:333] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.371686 30223 raft_consensus.cc:2243] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.372112 30223 raft_consensus.cc:2272] T 34ef0ed31f5e474599bbc2c62c0c90ca P eda02608ab584ab888fd554b9d697d71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.373639 30223 tablet_replica.cc:333] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71: stopping tablet replica
I20260709 12:23:06.374073 30223 raft_consensus.cc:2243] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.374764 30223 raft_consensus.cc:2272] T 0b05a0e44528465d808ebafdf0fbe0f2 P eda02608ab584ab888fd554b9d697d71 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.402634 30223 tablet_server.cc:196] TabletServer@127.29.131.195:0 shutdown complete.
I20260709 12:23:06.423938 30223 master.cc:562] Master@127.29.131.254:43641 shutting down...
I20260709 12:23:06.446354 30223 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:06.446979 30223 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.447361 30223 tablet_replica.cc:333] T 00000000000000000000000000000000 P a6fdd4767e924392ae08ac137c3ab5ed: stopping tablet replica
I20260709 12:23:06.483407 30223 master.cc:584] Master@127.29.131.254:43641 shutdown complete.
3f97dc9c5128456e97d2ba86d4f959d3  4
e11cf9c16d534db5a321ab416db473ad  5
eda02608ab584ab888fd554b9d697d71  1
3f97dc9c5128456e97d2ba86d4f959d3  4
e11cf9c16d534db5a321ab416db473ad  3
eda02608ab584ab888fd554b9d697d71  3
3f97dc9c5128456e97d2ba86d4f959d3  1
e11cf9c16d534db5a321ab416db473ad  8
eda02608ab584ab888fd554b9d697d71  1
3f97dc9c5128456e97d2ba86d4f959d3  3
e11cf9c16d534db5a321ab416db473ad  4
eda02608ab584ab888fd554b9d697d71  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29069 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:23:06.527627 30223 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.131.254:36201
I20260709 12:23:06.528812 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:06.535351 31268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:06.535331 31269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:06.536679 31271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:06.537456 30223 server_base.cc:1061] running on GCE node
I20260709 12:23:06.538537 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:06.538717 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:06.538858 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599786538813 us; error 0 us; skew 500 ppm
I20260709 12:23:06.539461 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:06.541874 30223 webserver.cc:533] Webserver started at http://127.29.131.254:34923/ using document root <none> and password file <none>
I20260709 12:23:06.542346 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:06.542547 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:06.542833 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:06.544039 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/master-0-root/instance:
uuid: "893a35e10f7f42ceb588211d8d9ba07f"
format_stamp: "Formatted at 2026-07-09 12:23:06 on dist-test-slave-n640"
I20260709 12:23:06.548324 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:06.551528 31276 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.552191 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:06.552485 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/master-0-root
uuid: "893a35e10f7f42ceb588211d8d9ba07f"
format_stamp: "Formatted at 2026-07-09 12:23:06 on dist-test-slave-n640"
I20260709 12:23:06.552767 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:06.608538 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:06.610286 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:06.648964 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.254:36201
I20260709 12:23:06.649060 31327 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.254:36201 every 8 connection(s)
I20260709 12:23:06.652875 31328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.662307 31328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Bootstrap starting.
I20260709 12:23:06.666958 31328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.671139 31328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: No bootstrap required, opened a new log
I20260709 12:23:06.673415 31328 raft_consensus.cc:359] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893a35e10f7f42ceb588211d8d9ba07f" member_type: VOTER }
I20260709 12:23:06.673822 31328 raft_consensus.cc:385] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.674010 31328 raft_consensus.cc:740] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 893a35e10f7f42ceb588211d8d9ba07f, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.674566 31328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893a35e10f7f42ceb588211d8d9ba07f" member_type: VOTER }
I20260709 12:23:06.675001 31328 raft_consensus.cc:399] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:06.675208 31328 raft_consensus.cc:493] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:06.675498 31328 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.679315 31328 raft_consensus.cc:515] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893a35e10f7f42ceb588211d8d9ba07f" member_type: VOTER }
I20260709 12:23:06.679745 31328 leader_election.cc:304] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 893a35e10f7f42ceb588211d8d9ba07f; no voters: 
I20260709 12:23:06.680770 31328 leader_election.cc:290] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:06.681205 31331 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.682487 31331 raft_consensus.cc:697] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 1 LEADER]: Becoming Leader. State: Replica: 893a35e10f7f42ceb588211d8d9ba07f, State: Running, Role: LEADER
I20260709 12:23:06.683178 31331 consensus_queue.cc:237] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893a35e10f7f42ceb588211d8d9ba07f" member_type: VOTER }
I20260709 12:23:06.683785 31328 sys_catalog.cc:565] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:06.688300 31332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "893a35e10f7f42ceb588211d8d9ba07f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893a35e10f7f42ceb588211d8d9ba07f" member_type: VOTER } }
I20260709 12:23:06.688827 31332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:06.688495 31333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 893a35e10f7f42ceb588211d8d9ba07f. Latest consensus state: current_term: 1 leader_uuid: "893a35e10f7f42ceb588211d8d9ba07f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893a35e10f7f42ceb588211d8d9ba07f" member_type: VOTER } }
I20260709 12:23:06.689195 31333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:06.691509 31338 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:06.696439 31338 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:06.698971 30223 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:06.704835 31338 catalog_manager.cc:1383] Generated new cluster ID: 6a35ea83b19f4442b56c9c7ecd8deb19
I20260709 12:23:06.705070 31338 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:06.726617 31338 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:06.727820 31338 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:06.741168 31338 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Generated new TSK 0
I20260709 12:23:06.741766 31338 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:06.765758 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:06.772174 31349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:06.773129 31350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:06.774811 30223 server_base.cc:1061] running on GCE node
W20260709 12:23:06.774892 31352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:06.775828 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:06.776068 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:06.776245 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599786776228 us; error 0 us; skew 500 ppm
I20260709 12:23:06.776769 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:06.778903 30223 webserver.cc:533] Webserver started at http://127.29.131.193:38135/ using document root <none> and password file <none>
I20260709 12:23:06.779443 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:06.779649 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:06.779968 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:06.781054 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/instance:
uuid: "503bef451a2b424fa35e8e46b8c06f29"
format_stamp: "Formatted at 2026-07-09 12:23:06 on dist-test-slave-n640"
I20260709 12:23:06.785487 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:23:06.788748 31357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.789460 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:06.789752 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "503bef451a2b424fa35e8e46b8c06f29"
format_stamp: "Formatted at 2026-07-09 12:23:06 on dist-test-slave-n640"
I20260709 12:23:06.790040 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:06.806718 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:06.807935 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:06.809311 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:06.811626 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:06.811841 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.812079 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:06.812268 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.852059 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:43521
I20260709 12:23:06.852180 31419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:43521 every 8 connection(s)
I20260709 12:23:06.857110 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:06.864693 31424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:06.865181 31425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:06.868330 31427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:06.869503 30223 server_base.cc:1061] running on GCE node
I20260709 12:23:06.870278 31420 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36201
I20260709 12:23:06.870735 31420 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:06.870751 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:06.871122 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:06.871343 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599786871323 us; error 0 us; skew 500 ppm
I20260709 12:23:06.871637 31420 heartbeater.cc:507] Master 127.29.131.254:36201 requested a full tablet report, sending...
I20260709 12:23:06.872001 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:06.873982 31293 ts_manager.cc:194] Registered new tserver with Master: 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:06.874773 30223 webserver.cc:533] Webserver started at http://127.29.131.194:40809/ using document root <none> and password file <none>
I20260709 12:23:06.875433 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:06.875675 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:06.875972 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:06.876436 31293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38044
I20260709 12:23:06.877480 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/instance:
uuid: "842fbe33f4144fa69f1fd428652b6998"
format_stamp: "Formatted at 2026-07-09 12:23:06 on dist-test-slave-n640"
I20260709 12:23:06.881829 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:23:06.885018 31432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.885718 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:06.885999 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root
uuid: "842fbe33f4144fa69f1fd428652b6998"
format_stamp: "Formatted at 2026-07-09 12:23:06 on dist-test-slave-n640"
I20260709 12:23:06.886297 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:06.897480 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:06.898603 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:06.900034 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:06.902061 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:06.902273 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.902513 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:06.902686 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.941406 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.194:40963
I20260709 12:23:06.941514 31494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.194:40963 every 8 connection(s)
I20260709 12:23:06.946170 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:06.952410 31498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:06.953505 31499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:06.956557 31501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:06.957719 30223 server_base.cc:1061] running on GCE node
I20260709 12:23:06.958264 31495 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36201
I20260709 12:23:06.958662 31495 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:06.958684 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:06.959046 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:06.959237 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599786959218 us; error 0 us; skew 500 ppm
I20260709 12:23:06.959580 31495 heartbeater.cc:507] Master 127.29.131.254:36201 requested a full tablet report, sending...
I20260709 12:23:06.959903 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:06.961675 31293 ts_manager.cc:194] Registered new tserver with Master: 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:06.962430 30223 webserver.cc:533] Webserver started at http://127.29.131.195:45197/ using document root <none> and password file <none>
I20260709 12:23:06.962926 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:06.963150 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:06.963158 31293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38054
I20260709 12:23:06.963578 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:06.964895 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/instance:
uuid: "b63f042a541248b88888cbd3049b38ca"
format_stamp: "Formatted at 2026-07-09 12:23:06 on dist-test-slave-n640"
I20260709 12:23:06.969338 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:06.972626 31506 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.973502 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:06.973750 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root
uuid: "b63f042a541248b88888cbd3049b38ca"
format_stamp: "Formatted at 2026-07-09 12:23:06 on dist-test-slave-n640"
I20260709 12:23:06.973978 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:06.982944 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:06.984102 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:06.985488 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:06.987746 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:06.987941 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.988234 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:06.988372 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:07.026659 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.195:37233
I20260709 12:23:07.026772 31568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.195:37233 every 8 connection(s)
I20260709 12:23:07.039839 31569 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36201
I20260709 12:23:07.040158 31569 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:07.040792 31569 heartbeater.cc:507] Master 127.29.131.254:36201 requested a full tablet report, sending...
I20260709 12:23:07.042485 31293 ts_manager.cc:194] Registered new tserver with Master: b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:07.042850 30223 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013036809s
I20260709 12:23:07.043838 31293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38064
I20260709 12:23:07.067533 31293 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38072:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:07.073644 31293 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:07.289709 31458 tablet_service.cc:1511] Processing CreateTablet for tablet d8d8c56f099c45638ca5f2f4da38bc89 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:07.289565 31533 tablet_service.cc:1511] Processing CreateTablet for tablet 4ede0de141bd4d8aafecf4cc1902f9f3 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:07.291486 31532 tablet_service.cc:1511] Processing CreateTablet for tablet d8d8c56f099c45638ca5f2f4da38bc89 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:07.291091 31458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d8c56f099c45638ca5f2f4da38bc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.292553 31533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ede0de141bd4d8aafecf4cc1902f9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.293874 31531 tablet_service.cc:1511] Processing CreateTablet for tablet dd5214a2e2a24f0c93da1f05318d0380 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:07.294611 31457 tablet_service.cc:1511] Processing CreateTablet for tablet dd5214a2e2a24f0c93da1f05318d0380 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:07.287799 31534 tablet_service.cc:1511] Processing CreateTablet for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:07.295208 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5214a2e2a24f0c93da1f05318d0380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.303129 31529 tablet_service.cc:1511] Processing CreateTablet for tablet ea09d8cfad9a493ebdab9d29ceaeedfc (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:07.303184 31455 tablet_service.cc:1511] Processing CreateTablet for tablet ea09d8cfad9a493ebdab9d29ceaeedfc (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:07.296130 31457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5214a2e2a24f0c93da1f05318d0380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.304543 31529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea09d8cfad9a493ebdab9d29ceaeedfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.307564 31534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.307794 31528 tablet_service.cc:1511] Processing CreateTablet for tablet 5eaea245d9414f42b05616da46574eb4 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:07.296643 31459 tablet_service.cc:1511] Processing CreateTablet for tablet 4ede0de141bd4d8aafecf4cc1902f9f3 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:07.309104 31528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eaea245d9414f42b05616da46574eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.309437 31459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ede0de141bd4d8aafecf4cc1902f9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.311553 31532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d8c56f099c45638ca5f2f4da38bc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.297000 31460 tablet_service.cc:1511] Processing CreateTablet for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:07.313850 31460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.298225 31530 tablet_service.cc:1511] Processing CreateTablet for tablet 796a9ec54e6448408ebf535a6f6a5d4f (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:07.316756 31530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796a9ec54e6448408ebf535a6f6a5d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.298228 31456 tablet_service.cc:1511] Processing CreateTablet for tablet 796a9ec54e6448408ebf535a6f6a5d4f (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:07.320746 31456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796a9ec54e6448408ebf535a6f6a5d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.321465 31526 tablet_service.cc:1511] Processing CreateTablet for tablet 5b00e106a7374108a1bb1bb841b5edaa (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:07.322772 31526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b00e106a7374108a1bb1bb841b5edaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.324668 31455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea09d8cfad9a493ebdab9d29ceaeedfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.324559 31525 tablet_service.cc:1511] Processing CreateTablet for tablet 739df497c0c147fa9da0afc2bb1c8873 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:07.325906 31525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739df497c0c147fa9da0afc2bb1c8873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.330518 31451 tablet_service.cc:1511] Processing CreateTablet for tablet 739df497c0c147fa9da0afc2bb1c8873 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:07.330853 31527 tablet_service.cc:1511] Processing CreateTablet for tablet f85a739decfd445aac542c70782b537d (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:07.332146 31527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85a739decfd445aac542c70782b537d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.332799 31452 tablet_service.cc:1511] Processing CreateTablet for tablet 5b00e106a7374108a1bb1bb841b5edaa (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:07.334977 31453 tablet_service.cc:1511] Processing CreateTablet for tablet f85a739decfd445aac542c70782b537d (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:07.336315 31453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85a739decfd445aac542c70782b537d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.338203 31454 tablet_service.cc:1511] Processing CreateTablet for tablet 5eaea245d9414f42b05616da46574eb4 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:07.339597 31452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b00e106a7374108a1bb1bb841b5edaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.341032 31451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739df497c0c147fa9da0afc2bb1c8873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.352427 31454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eaea245d9414f42b05616da46574eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.414852 31527 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5b01f306242f19825d56ac764bc69 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:07.419095 31527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5b01f306242f19825d56ac764bc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.425264 31529 tablet_service.cc:1511] Processing CreateTablet for tablet 0207be23688449b2931af8e5102e206e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:07.426739 31529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0207be23688449b2931af8e5102e206e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.425486 31531 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0ab2689b6649ac9fba57f55c7cd0f1 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:07.429505 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0ab2689b6649ac9fba57f55c7cd0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.453922 31451 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5b01f306242f19825d56ac764bc69 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:07.455504 31451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5b01f306242f19825d56ac764bc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.469614 31458 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0ab2689b6649ac9fba57f55c7cd0f1 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:07.478993 31534 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2a9a290e1f42029551de25d5a7932a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:07.480012 31532 tablet_service.cc:1511] Processing CreateTablet for tablet 27460804ee284848a7cc13b9117e52c7 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:07.480419 31534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2a9a290e1f42029551de25d5a7932a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.486052 31530 tablet_service.cc:1511] Processing CreateTablet for tablet 1433e6dfe06d41c7addfb5462c25ef76 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:07.487102 31530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1433e6dfe06d41c7addfb5462c25ef76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.478485 31526 tablet_service.cc:1511] Processing CreateTablet for tablet f84b503c7c204e5cb7b8dcf59fffdae6 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:07.495134 31385 tablet_service.cc:1511] Processing CreateTablet for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:07.495494 31379 tablet_service.cc:1511] Processing CreateTablet for tablet 5eaea245d9414f42b05616da46574eb4 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:07.496158 31378 tablet_service.cc:1511] Processing CreateTablet for tablet f85a739decfd445aac542c70782b537d (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:07.497814 31585 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:07.498302 31382 tablet_service.cc:1511] Processing CreateTablet for tablet dd5214a2e2a24f0c93da1f05318d0380 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:07.499584 31384 tablet_service.cc:1511] Processing CreateTablet for tablet 4ede0de141bd4d8aafecf4cc1902f9f3 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:07.500854 31381 tablet_service.cc:1511] Processing CreateTablet for tablet 796a9ec54e6448408ebf535a6f6a5d4f (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:07.495496 31383 tablet_service.cc:1511] Processing CreateTablet for tablet d8d8c56f099c45638ca5f2f4da38bc89 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:07.501461 31525 tablet_service.cc:1511] Processing CreateTablet for tablet 2038e3170e644e7e9fb1afa87e11d993 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:07.502060 31380 tablet_service.cc:1511] Processing CreateTablet for tablet ea09d8cfad9a493ebdab9d29ceaeedfc (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:07.503350 31376 tablet_service.cc:1511] Processing CreateTablet for tablet 739df497c0c147fa9da0afc2bb1c8873 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:07.504637 31377 tablet_service.cc:1511] Processing CreateTablet for tablet 5b00e106a7374108a1bb1bb841b5edaa (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:07.506681 31458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0ab2689b6649ac9fba57f55c7cd0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.496534 31385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.507893 31532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27460804ee284848a7cc13b9117e52c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.519685 31379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eaea245d9414f42b05616da46574eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.526700 31382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5214a2e2a24f0c93da1f05318d0380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.529819 31378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85a739decfd445aac542c70782b537d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.549064 31531 tablet_service.cc:1511] Processing CreateTablet for tablet 74b96090004c463795628c0134d8ecac (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:07.550498 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b96090004c463795628c0134d8ecac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.551900 31457 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2a9a290e1f42029551de25d5a7932a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:07.553195 31457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2a9a290e1f42029551de25d5a7932a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.496502 31528 tablet_service.cc:1511] Processing CreateTablet for tablet d43fc3cfb135493da75cf9bdc7debaa9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:07.565552 31459 tablet_service.cc:1511] Processing CreateTablet for tablet 1433e6dfe06d41c7addfb5462c25ef76 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:07.491304 31455 tablet_service.cc:1511] Processing CreateTablet for tablet 0207be23688449b2931af8e5102e206e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:07.568387 31584 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:07.578665 31381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796a9ec54e6448408ebf535a6f6a5d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.596194 31376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739df497c0c147fa9da0afc2bb1c8873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.596910 31377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b00e106a7374108a1bb1bb841b5edaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.598960 31383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d8c56f099c45638ca5f2f4da38bc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.563038 31526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84b503c7c204e5cb7b8dcf59fffdae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.603591 31384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ede0de141bd4d8aafecf4cc1902f9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.603681 31525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2038e3170e644e7e9fb1afa87e11d993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.606775 31456 tablet_service.cc:1511] Processing CreateTablet for tablet f84b503c7c204e5cb7b8dcf59fffdae6 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:07.612159 31454 tablet_service.cc:1511] Processing CreateTablet for tablet d43fc3cfb135493da75cf9bdc7debaa9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:07.613631 31528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43fc3cfb135493da75cf9bdc7debaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.623394 31460 tablet_service.cc:1511] Processing CreateTablet for tablet 27460804ee284848a7cc13b9117e52c7 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:07.627552 31380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea09d8cfad9a493ebdab9d29ceaeedfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.629788 31379 tablet_service.cc:1511] Processing CreateTablet for tablet f717dfc5b2ba4dcf876418eb16911078 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:07.631042 31379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f717dfc5b2ba4dcf876418eb16911078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.567169 31459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1433e6dfe06d41c7addfb5462c25ef76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.631273 31453 tablet_service.cc:1511] Processing CreateTablet for tablet 2038e3170e644e7e9fb1afa87e11d993 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:07.629798 31382 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5b01f306242f19825d56ac764bc69 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:07.642788 31455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0207be23688449b2931af8e5102e206e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.673837 31456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84b503c7c204e5cb7b8dcf59fffdae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.675544 31453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2038e3170e644e7e9fb1afa87e11d993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.676158 31460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27460804ee284848a7cc13b9117e52c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.641181 31452 tablet_service.cc:1511] Processing CreateTablet for tablet 74b96090004c463795628c0134d8ecac (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:07.681840 31452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b96090004c463795628c0134d8ecac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.684338 31384 tablet_service.cc:1511] Processing CreateTablet for tablet f84b503c7c204e5cb7b8dcf59fffdae6 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:07.687554 31454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43fc3cfb135493da75cf9bdc7debaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.687796 31384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84b503c7c204e5cb7b8dcf59fffdae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.649909 31383 tablet_service.cc:1511] Processing CreateTablet for tablet 0207be23688449b2931af8e5102e206e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:07.691828 31382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5b01f306242f19825d56ac764bc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.692529 31383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0207be23688449b2931af8e5102e206e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:07.694677 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:07.692883 31532 tablet_service.cc:1511] Processing CreateTablet for tablet 8a818d01cfc443aea4e12b8ef804f14c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:07.699153 31458 tablet_service.cc:1511] Processing CreateTablet for tablet dbf61ba8f0cc44ee87136dd991354c89 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:07.708006 31458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf61ba8f0cc44ee87136dd991354c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.705500 31531 tablet_service.cc:1511] Processing CreateTablet for tablet 5a413d9092d14aea9490265eb7f932db (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:07.686730 31527 tablet_service.cc:1511] Processing CreateTablet for tablet 0db923f6154349d3ba9a88713b04d088 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:07.700759 31385 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0ab2689b6649ac9fba57f55c7cd0f1 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:07.692444 31451 tablet_service.cc:1511] Processing CreateTablet for tablet f717dfc5b2ba4dcf876418eb16911078 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:07.642485 31533 tablet_service.cc:1511] Processing CreateTablet for tablet dbf61ba8f0cc44ee87136dd991354c89 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:07.713531 31385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0ab2689b6649ac9fba57f55c7cd0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.715605 31379 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2a9a290e1f42029551de25d5a7932a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:07.716814 31379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2a9a290e1f42029551de25d5a7932a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.637073 31530 tablet_service.cc:1511] Processing CreateTablet for tablet f717dfc5b2ba4dcf876418eb16911078 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:07.719774 31532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a818d01cfc443aea4e12b8ef804f14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.710796 31378 tablet_service.cc:1511] Processing CreateTablet for tablet 27460804ee284848a7cc13b9117e52c7 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:07.721132 31378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27460804ee284848a7cc13b9117e52c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.721948 31530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f717dfc5b2ba4dcf876418eb16911078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.722592 31533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf61ba8f0cc44ee87136dd991354c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.723471 31527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db923f6154349d3ba9a88713b04d088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.721189 31584 tablet_bootstrap.cc:654] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.725155 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a413d9092d14aea9490265eb7f932db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.726182 31586 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:07.728622 31451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f717dfc5b2ba4dcf876418eb16911078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.653805 31585 tablet_bootstrap.cc:654] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.679142 31534 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4c1a36e3964960952aee6245d4560e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:07.741562 31534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4c1a36e3964960952aee6245d4560e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.765712 31455 tablet_service.cc:1511] Processing CreateTablet for tablet 0db923f6154349d3ba9a88713b04d088 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:07.767776 31453 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4c1a36e3964960952aee6245d4560e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:07.767607 31455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db923f6154349d3ba9a88713b04d088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.769047 31453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4c1a36e3964960952aee6245d4560e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.795653 31452 tablet_service.cc:1511] Processing CreateTablet for tablet 5a413d9092d14aea9490265eb7f932db (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:07.796291 31529 tablet_service.cc:1511] Processing CreateTablet for tablet ebc2f1162c2a4dea82b0b11efc141c5a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:07.796943 31452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a413d9092d14aea9490265eb7f932db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.796741 31381 tablet_service.cc:1511] Processing CreateTablet for tablet d43fc3cfb135493da75cf9bdc7debaa9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:07.797514 31529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc2f1162c2a4dea82b0b11efc141c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.797178 31460 tablet_service.cc:1511] Processing CreateTablet for tablet 8a818d01cfc443aea4e12b8ef804f14c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:07.797926 31381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43fc3cfb135493da75cf9bdc7debaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.798389 31460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a818d01cfc443aea4e12b8ef804f14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.806734 31586 tablet_bootstrap.cc:654] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.821699 31377 tablet_service.cc:1511] Processing CreateTablet for tablet 2038e3170e644e7e9fb1afa87e11d993 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:07.823892 31377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2038e3170e644e7e9fb1afa87e11d993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.821803 31376 tablet_service.cc:1511] Processing CreateTablet for tablet dbf61ba8f0cc44ee87136dd991354c89 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:07.823661 31457 tablet_service.cc:1511] Processing CreateTablet for tablet ebc2f1162c2a4dea82b0b11efc141c5a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:07.830551 31382 tablet_service.cc:1511] Processing CreateTablet for tablet 74b96090004c463795628c0134d8ecac (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:07.832306 31526 tablet_service.cc:1511] Processing CreateTablet for tablet f5050cffdfb1414e9bf38e82277f43bd (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:07.833577 31526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5050cffdfb1414e9bf38e82277f43bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.835940 31457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc2f1162c2a4dea82b0b11efc141c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.839551 31376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf61ba8f0cc44ee87136dd991354c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.838729 31459 tablet_service.cc:1511] Processing CreateTablet for tablet f5050cffdfb1414e9bf38e82277f43bd (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:07.841656 31525 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc04eb7c849448bba0b8d22faf8751a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:07.842418 31459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5050cffdfb1414e9bf38e82277f43bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.842823 31525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc04eb7c849448bba0b8d22faf8751a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.843391 31380 tablet_service.cc:1511] Processing CreateTablet for tablet 1433e6dfe06d41c7addfb5462c25ef76 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:07.844656 31460 tablet_service.cc:1511] Processing CreateTablet for tablet ab7bbda785db43a8a40b2bbd07b0c97a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:07.846036 31460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7bbda785db43a8a40b2bbd07b0c97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.844805 31456 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc04eb7c849448bba0b8d22faf8751a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:07.847676 31530 tablet_service.cc:1511] Processing CreateTablet for tablet ab7bbda785db43a8a40b2bbd07b0c97a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:07.851466 31530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7bbda785db43a8a40b2bbd07b0c97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.848719 31453 tablet_service.cc:1511] Processing CreateTablet for tablet 27e02f01756e4d3397cca6128df3c644 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:07.844622 31380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1433e6dfe06d41c7addfb5462c25ef76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.856757 31532 tablet_service.cc:1511] Processing CreateTablet for tablet 27e02f01756e4d3397cca6128df3c644 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:07.864797 31455 tablet_service.cc:1511] Processing CreateTablet for tablet 564dc334ebd54aa5baeadc07e099bada (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:07.867009 31584 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:07.889592 31584 ts_tablet_manager.cc:1403] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.322s	user 0.019s	sys 0.005s
I20260709 12:23:07.847564 31456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc04eb7c849448bba0b8d22faf8751a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.869495 31528 tablet_service.cc:1511] Processing CreateTablet for tablet e9371bed6dc240b6969ed373c14c9a75 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:07.866943 31457 tablet_service.cc:1511] Processing CreateTablet for tablet e9371bed6dc240b6969ed373c14c9a75 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:07.896234 31457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9371bed6dc240b6969ed373c14c9a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.899682 31455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564dc334ebd54aa5baeadc07e099bada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.901883 31527 tablet_service.cc:1511] Processing CreateTablet for tablet 069da3737bb54ce19c27f8dcaa7fdf87 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:07.912518 31584 raft_consensus.cc:359] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:07.877251 31533 tablet_service.cc:1511] Processing CreateTablet for tablet 41818a7a6f784af8b64045cfa65d7383 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:07.913964 31584 raft_consensus.cc:385] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.878226 31385 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4c1a36e3964960952aee6245d4560e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:07.879005 31420 heartbeater.cc:499] Master 127.29.131.254:36201 was elected leader, sending a full tablet report...
I20260709 12:23:07.882561 31383 tablet_service.cc:1511] Processing CreateTablet for tablet 0db923f6154349d3ba9a88713b04d088 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:07.914806 31584 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.915661 31383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db923f6154349d3ba9a88713b04d088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.915968 31453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e02f01756e4d3397cca6128df3c644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.913525 31532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e02f01756e4d3397cca6128df3c644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.917587 31533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41818a7a6f784af8b64045cfa65d7383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.919842 31528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9371bed6dc240b6969ed373c14c9a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.925033 31527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069da3737bb54ce19c27f8dcaa7fdf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.931700 31385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4c1a36e3964960952aee6245d4560e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.935254 31384 tablet_service.cc:1511] Processing CreateTablet for tablet 8a818d01cfc443aea4e12b8ef804f14c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:07.936553 31384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a818d01cfc443aea4e12b8ef804f14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.859105 31529 tablet_service.cc:1511] Processing CreateTablet for tablet 564dc334ebd54aa5baeadc07e099bada (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:07.940404 31529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564dc334ebd54aa5baeadc07e099bada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.874586 31531 tablet_service.cc:1511] Processing CreateTablet for tablet 17b17789440044608d6b5d4f1b95d09c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:07.943974 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b17789440044608d6b5d4f1b95d09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.949949 31584 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:07.960517 31382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b96090004c463795628c0134d8ecac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.965641 31495 heartbeater.cc:499] Master 127.29.131.254:36201 was elected leader, sending a full tablet report...
I20260709 12:23:07.966598 31526 tablet_service.cc:1511] Processing CreateTablet for tablet 05d891c1ae594a36bd0f372d87b398dd (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:07.975266 31584 ts_tablet_manager.cc:1434] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.007s
I20260709 12:23:07.976246 31584 tablet_bootstrap.cc:492] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:07.979779 31586 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:07.985628 31526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d891c1ae594a36bd0f372d87b398dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.980629 31378 tablet_service.cc:1511] Processing CreateTablet for tablet 5a413d9092d14aea9490265eb7f932db (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:07.993366 31586 ts_tablet_manager.cc:1403] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.268s	user 0.012s	sys 0.003s
I20260709 12:23:07.994225 31378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a413d9092d14aea9490265eb7f932db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.998131 31459 tablet_service.cc:1511] Processing CreateTablet for tablet 17b17789440044608d6b5d4f1b95d09c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:07.987413 31585 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:07.999169 31585 ts_tablet_manager.cc:1403] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.509s	user 0.034s	sys 0.015s
I20260709 12:23:08.002151 31585 raft_consensus.cc:359] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.008955 31585 raft_consensus.cc:385] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.014541 31585 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.010702 31534 tablet_service.cc:1511] Processing CreateTablet for tablet d762e82a994f48968e08b715c9df4a7a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:08.016510 31534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d762e82a994f48968e08b715c9df4a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.018256 31380 tablet_service.cc:1511] Processing CreateTablet for tablet ebc2f1162c2a4dea82b0b11efc141c5a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:08.009791 31586 raft_consensus.cc:359] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.019400 31586 raft_consensus.cc:385] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.019518 31380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc2f1162c2a4dea82b0b11efc141c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.019744 31586 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.020642 31586 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.022745 31453 tablet_service.cc:1511] Processing CreateTablet for tablet 069da3737bb54ce19c27f8dcaa7fdf87 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:08.025144 31381 tablet_service.cc:1511] Processing CreateTablet for tablet f5050cffdfb1414e9bf38e82277f43bd (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:07.976841 31385 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc04eb7c849448bba0b8d22faf8751a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:08.026377 31381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5050cffdfb1414e9bf38e82277f43bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.008293 31458 tablet_service.cc:1511] Processing CreateTablet for tablet 41818a7a6f784af8b64045cfa65d7383 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:08.026204 31585 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.026391 31384 tablet_service.cc:1511] Processing CreateTablet for tablet ab7bbda785db43a8a40b2bbd07b0c97a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:08.037808 31455 tablet_service.cc:1511] Processing CreateTablet for tablet 05d891c1ae594a36bd0f372d87b398dd (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:08.040750 31531 tablet_service.cc:1511] Processing CreateTablet for tablet 46d997871e814deba55c8b52416644f9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:08.042026 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d997871e814deba55c8b52416644f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.043406 31459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b17789440044608d6b5d4f1b95d09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.046451 31569 heartbeater.cc:499] Master 127.29.131.254:36201 was elected leader, sending a full tablet report...
I20260709 12:23:08.049670 31586 ts_tablet_manager.cc:1434] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.005s
I20260709 12:23:08.050658 31586 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:08.052632 31377 tablet_service.cc:1511] Processing CreateTablet for tablet 564dc334ebd54aa5baeadc07e099bada (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:08.057621 31383 tablet_service.cc:1511] Processing CreateTablet for tablet e9371bed6dc240b6969ed373c14c9a75 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:08.058827 31383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9371bed6dc240b6969ed373c14c9a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.059350 31455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d891c1ae594a36bd0f372d87b398dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.061616 31384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7bbda785db43a8a40b2bbd07b0c97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.066697 31385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc04eb7c849448bba0b8d22faf8751a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.070442 31526 tablet_service.cc:1511] Processing CreateTablet for tablet afa2173634bd428990b41e94ec873527 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:08.075562 31377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564dc334ebd54aa5baeadc07e099bada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.079663 31458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41818a7a6f784af8b64045cfa65d7383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.079551 31378 tablet_service.cc:1511] Processing CreateTablet for tablet 17b17789440044608d6b5d4f1b95d09c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:08.080827 31378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b17789440044608d6b5d4f1b95d09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.083525 31453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069da3737bb54ce19c27f8dcaa7fdf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.076571 31376 tablet_service.cc:1511] Processing CreateTablet for tablet 27e02f01756e4d3397cca6128df3c644 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:08.084823 31376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e02f01756e4d3397cca6128df3c644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.077772 31586 tablet_bootstrap.cc:654] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.086300 31584 tablet_bootstrap.cc:654] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.086594 31379 tablet_service.cc:1511] Processing CreateTablet for tablet 41818a7a6f784af8b64045cfa65d7383 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:08.089393 31454 tablet_service.cc:1511] Processing CreateTablet for tablet d762e82a994f48968e08b715c9df4a7a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:08.090461 31585 ts_tablet_manager.cc:1434] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.000s
I20260709 12:23:08.090736 31454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d762e82a994f48968e08b715c9df4a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.101779 31452 tablet_service.cc:1511] Processing CreateTablet for tablet 46d997871e814deba55c8b52416644f9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:08.103843 31451 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd5e95a0a4f4dca8f4b0e55fd24889e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:08.111755 31592 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.112278 31592 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.114259 31460 tablet_service.cc:1511] Processing CreateTablet for tablet afa2173634bd428990b41e94ec873527 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:08.114910 31592 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:08.103099 31452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d997871e814deba55c8b52416644f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.104523 31530 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd5e95a0a4f4dca8f4b0e55fd24889e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:08.126039 31532 tablet_service.cc:1511] Processing CreateTablet for tablet b119c4a56bea40fb9d13fc79732c5c7f (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:08.131662 31379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41818a7a6f784af8b64045cfa65d7383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.132681 31585 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:08.133291 31528 tablet_service.cc:1511] Processing CreateTablet for tablet a052dcb61f484ed39d373e82a7245551 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:08.134617 31528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a052dcb61f484ed39d373e82a7245551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.138715 31585 tablet_bootstrap.cc:654] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.140113 31526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa2173634bd428990b41e94ec873527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.148550 31533 tablet_service.cc:1511] Processing CreateTablet for tablet a25b6ccdad024914a1cfccf61addaad1 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:08.149124 31457 tablet_service.cc:1511] Processing CreateTablet for tablet b119c4a56bea40fb9d13fc79732c5c7f (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:08.149897 31533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25b6ccdad024914a1cfccf61addaad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.150372 31457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b119c4a56bea40fb9d13fc79732c5c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.150487 31530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd5e95a0a4f4dca8f4b0e55fd24889e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.151569 31451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd5e95a0a4f4dca8f4b0e55fd24889e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.151809 31591 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.152272 31591 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.161533 31380 tablet_service.cc:1511] Processing CreateTablet for tablet 069da3737bb54ce19c27f8dcaa7fdf87 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:08.162804 31380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069da3737bb54ce19c27f8dcaa7fdf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.163646 31590 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.164161 31460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa2173634bd428990b41e94ec873527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.164121 31590 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.165934 31534 tablet_service.cc:1511] Processing CreateTablet for tablet 2673eb8b7e874dc68e3b56393a06a549 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:08.167145 31456 tablet_service.cc:1511] Processing CreateTablet for tablet a25b6ccdad024914a1cfccf61addaad1 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:08.196971 31586 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:08.197475 31586 ts_tablet_manager.cc:1403] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.147s	user 0.022s	sys 0.007s
I20260709 12:23:08.191303 31532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b119c4a56bea40fb9d13fc79732c5c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.190802 31591 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:08.220733 31455 tablet_service.cc:1511] Processing CreateTablet for tablet 2673eb8b7e874dc68e3b56393a06a549 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:08.220885 31527 tablet_service.cc:1511] Processing CreateTablet for tablet 75d99c62694f427cb30f713a2843eec8 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:08.221856 31590 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:08.222901 31456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25b6ccdad024914a1cfccf61addaad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.233590 31534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673eb8b7e874dc68e3b56393a06a549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.203539 31529 tablet_service.cc:1511] Processing CreateTablet for tablet b13f8c8324c04c879d0aa55e41fae892 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:08.205157 31459 tablet_service.cc:1511] Processing CreateTablet for tablet a052dcb61f484ed39d373e82a7245551 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:08.285943 31586 raft_consensus.cc:359] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.287153 31586 raft_consensus.cc:385] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.288427 31586 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.292462 31584 tablet_bootstrap.cc:492] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:08.347707 31584 ts_tablet_manager.cc:1403] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.372s	user 0.011s	sys 0.009s
I20260709 12:23:08.348155 31586 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.350607 31584 raft_consensus.cc:359] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.351601 31586 ts_tablet_manager.cc:1434] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.154s	user 0.011s	sys 0.000s
I20260709 12:23:08.332301 31526 tablet_service.cc:1511] Processing CreateTablet for tablet 9489bc7325d849ad9c1aec0189f21268 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:08.333947 31528 tablet_service.cc:1511] Processing CreateTablet for tablet 18ce134725c84d9782a48f1b1cb859c0 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:08.337908 31376 tablet_service.cc:1511] Processing CreateTablet for tablet 46d997871e814deba55c8b52416644f9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:08.326902 31382 tablet_service.cc:1511] Processing CreateTablet for tablet d762e82a994f48968e08b715c9df4a7a (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:08.322480 31385 tablet_service.cc:1511] Processing CreateTablet for tablet 05d891c1ae594a36bd0f372d87b398dd (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:08.351662 31584 raft_consensus.cc:385] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.329535 31525 tablet_service.cc:1511] Processing CreateTablet for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:08.354810 31381 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd5e95a0a4f4dca8f4b0e55fd24889e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:08.357534 31527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d99c62694f427cb30f713a2843eec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.357784 31455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673eb8b7e874dc68e3b56393a06a549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.377818 31384 tablet_service.cc:1511] Processing CreateTablet for tablet b119c4a56bea40fb9d13fc79732c5c7f (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:08.381986 31451 tablet_service.cc:1511] Processing CreateTablet for tablet b13f8c8324c04c879d0aa55e41fae892 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:08.393100 31584 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.407934 31452 tablet_service.cc:1511] Processing CreateTablet for tablet 75d99c62694f427cb30f713a2843eec8 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:08.375195 31383 tablet_service.cc:1511] Processing CreateTablet for tablet afa2173634bd428990b41e94ec873527 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:08.414575 31459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a052dcb61f484ed39d373e82a7245551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.415498 31586 tablet_bootstrap.cc:492] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:08.416002 31451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13f8c8324c04c879d0aa55e41fae892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.416273 31585 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:08.416774 31585 ts_tablet_manager.cc:1403] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.284s	user 0.051s	sys 0.061s
I20260709 12:23:08.419806 31452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d99c62694f427cb30f713a2843eec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.421694 31526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9489bc7325d849ad9c1aec0189f21268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.419855 31585 raft_consensus.cc:359] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.422554 31585 raft_consensus.cc:385] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.422912 31585 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.423744 31585 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.424165 31530 tablet_service.cc:1511] Processing CreateTablet for tablet c179546c46da4fa98f8b4fb61f9128b2 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:08.425414 31530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c179546c46da4fa98f8b4fb61f9128b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.425995 31585 ts_tablet_manager.cc:1434] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:23:08.426991 31585 tablet_bootstrap.cc:492] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:08.430209 31525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.431550 31529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13f8c8324c04c879d0aa55e41fae892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.442858 31381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd5e95a0a4f4dca8f4b0e55fd24889e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.444082 31454 tablet_service.cc:1511] Processing CreateTablet for tablet 18ce134725c84d9782a48f1b1cb859c0 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:08.399207 31584 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.447858 31584 ts_tablet_manager.cc:1434] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.100s	user 0.001s	sys 0.007s
I20260709 12:23:08.461843 31534 tablet_service.cc:1511] Processing CreateTablet for tablet 3d30d3a647c247fab04a1722a89b8818 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:08.463442 31528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ce134725c84d9782a48f1b1cb859c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.463362 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:08.464120 31584 tablet_bootstrap.cc:492] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:08.464331 31532 tablet_service.cc:1511] Processing CreateTablet for tablet a6b935bf4ae0467a9564dbd51820ce7c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:23:08.464679 31496 tablet.cc:2406] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:08.464735 31454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ce134725c84d9782a48f1b1cb859c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.451681 31585 tablet_bootstrap.cc:654] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.475064 31544 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:08.475538 31532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b935bf4ae0467a9564dbd51820ce7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.477097 31434 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:08.479415 31590 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.479810 31590 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.480193 31590 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.492761 31384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b119c4a56bea40fb9d13fc79732c5c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.493800 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:08.495450 31385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d891c1ae594a36bd0f372d87b398dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.497371 31590 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.499761 31382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d762e82a994f48968e08b715c9df4a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.493700 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:08.467128 31460 tablet_service.cc:1511] Processing CreateTablet for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:23:08.503208 31433 leader_election.cc:343] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.517154 31376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d997871e814deba55c8b52416644f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.444563 31531 tablet_service.cc:1511] Processing CreateTablet for tablet 720e43702af64bf89bc425bfd0ad352e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:08.504961 31584 tablet_bootstrap.cc:654] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.505765 31534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d30d3a647c247fab04a1722a89b8818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.508468 31591 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.509970 31586 tablet_bootstrap.cc:654] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.510484 31456 tablet_service.cc:1511] Processing CreateTablet for tablet 9489bc7325d849ad9c1aec0189f21268 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:08.511646 31590 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:08.512768 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:08.522498 31544 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.521548 31591 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.514539 31457 tablet_service.cc:1511] Processing CreateTablet for tablet c179546c46da4fa98f8b4fb61f9128b2 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:08.524741 31460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.524829 31383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa2173634bd428990b41e94ec873527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.526201 31456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9489bc7325d849ad9c1aec0189f21268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.526470 31377 tablet_service.cc:1511] Processing CreateTablet for tablet a052dcb61f484ed39d373e82a7245551 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:08.527774 31377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a052dcb61f484ed39d373e82a7245551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.527936 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:08.528801 31470 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:08.529625 31457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c179546c46da4fa98f8b4fb61f9128b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.529917 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:08.532866 31591 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:08.536729 31380 tablet_service.cc:1511] Processing CreateTablet for tablet a25b6ccdad024914a1cfccf61addaad1 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:08.537946 31380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25b6ccdad024914a1cfccf61addaad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.545915 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:08.547441 31507 leader_election.cc:343] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.547668 31457 tablet_service.cc:1511] Processing CreateTablet for tablet a6b935bf4ae0467a9564dbd51820ce7c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:08.548900 31457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b935bf4ae0467a9564dbd51820ce7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.551697 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720e43702af64bf89bc425bfd0ad352e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.554103 31585 tablet_bootstrap.cc:492] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:08.554569 31585 ts_tablet_manager.cc:1403] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.011s
I20260709 12:23:08.557605 31585 raft_consensus.cc:359] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.558314 31585 raft_consensus.cc:385] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.558609 31585 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.559410 31585 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:08.559854 31433 leader_election.cc:343] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.560191 31458 tablet_service.cc:1511] Processing CreateTablet for tablet 3d30d3a647c247fab04a1722a89b8818 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:08.561456 31458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d30d3a647c247fab04a1722a89b8818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.561866 31585 ts_tablet_manager.cc:1434] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:23:08.562851 31585 tablet_bootstrap.cc:492] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:08.566443 31455 tablet_service.cc:1511] Processing CreateTablet for tablet 1a937a8e153c40d396843c808354fb5b (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:08.570930 31510 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:08.574249 31455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a937a8e153c40d396843c808354fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.577103 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:08.577806 31543 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:08.578979 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:08.581670 31359 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:08.581836 31533 tablet_service.cc:1511] Processing CreateTablet for tablet 1a937a8e153c40d396843c808354fb5b (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:08.582472 31591 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.582845 31591 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:08.583529 31359 leader_election.cc:343] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.583184 31591 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.585155 31544 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:08.585948 31594 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.517530 31459 tablet_service.cc:1511] Processing CreateTablet for tablet 720e43702af64bf89bc425bfd0ad352e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:08.587245 31434 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:08.588169 31590 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.587455 31459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720e43702af64bf89bc425bfd0ad352e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.583117 31533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a937a8e153c40d396843c808354fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:08.604151 31361 leader_election.cc:343] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.613698 31451 tablet_service.cc:1511] Processing CreateTablet for tablet 78881770eb254ce191fad6a8664b7430 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:08.615576 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:08.614750 31379 tablet_service.cc:1511] Processing CreateTablet for tablet 2673eb8b7e874dc68e3b56393a06a549 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 12:23:08.616865 31361 leader_election.cc:343] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.617345 31361 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:08.617563 31379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673eb8b7e874dc68e3b56393a06a549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.588277 31453 tablet_service.cc:1511] Processing CreateTablet for tablet 25e1632d46704126852887ade0b97386 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:08.625603 31451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78881770eb254ce191fad6a8664b7430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.644812 31385 tablet_service.cc:1511] Processing CreateTablet for tablet 18ce134725c84d9782a48f1b1cb859c0 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:08.646065 31385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ce134725c84d9782a48f1b1cb859c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.647850 31532 tablet_service.cc:1511] Processing CreateTablet for tablet 25e1632d46704126852887ade0b97386 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:08.649160 31532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e1632d46704126852887ade0b97386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.636457 31590 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:08.655550 31531 tablet_service.cc:1511] Processing CreateTablet for tablet 78881770eb254ce191fad6a8664b7430 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:08.656478 31590 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.659559 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78881770eb254ce191fad6a8664b7430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.658731 31382 tablet_service.cc:1511] Processing CreateTablet for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:08.669257 31584 tablet_bootstrap.cc:492] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:08.669831 31584 ts_tablet_manager.cc:1403] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.010s
I20260709 12:23:08.637138 31525 tablet_service.cc:1511] Processing CreateTablet for tablet a542644bc5014371a0403670d46545d9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:08.672612 31525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a542644bc5014371a0403670d46545d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.672900 31584 raft_consensus.cc:359] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.673667 31584 raft_consensus.cc:385] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.674026 31584 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.674983 31584 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.677466 31584 ts_tablet_manager.cc:1434] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:08.678494 31584 tablet_bootstrap.cc:492] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:08.679723 31453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e1632d46704126852887ade0b97386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.680622 31594 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.681097 31594 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.682264 31382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.683319 31378 tablet_service.cc:1511] Processing CreateTablet for tablet 75d99c62694f427cb30f713a2843eec8 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:08.683162 31594 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:08.684218 31452 tablet_service.cc:1511] Processing CreateTablet for tablet a542644bc5014371a0403670d46545d9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:08.684631 31378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d99c62694f427cb30f713a2843eec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.688974 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:08.691695 31452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a542644bc5014371a0403670d46545d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:08.691888 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 73152.7us
I20260709 12:23:08.693230 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:08.694289 31510 leader_election.cc:343] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:08.695156 31507 leader_election.cc:343] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.695612 31507 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:08.696713 31594 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.704133 31381 tablet_service.cc:1511] Processing CreateTablet for tablet b13f8c8324c04c879d0aa55e41fae892 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:08.705705 31381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13f8c8324c04c879d0aa55e41fae892. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:08.727324 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:08.729375 31383 tablet_service.cc:1511] Processing CreateTablet for tablet 9489bc7325d849ad9c1aec0189f21268 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:08.731494 31613 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.731773 31584 tablet_bootstrap.cc:654] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.725510 31585 tablet_bootstrap.cc:654] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.751401 31591 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.753624 31591 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:08.754405 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:08.754658 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:08.755420 31544 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:08.756002 31361 leader_election.cc:343] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.730788 31383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9489bc7325d849ad9c1aec0189f21268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.761168 31452 tablet_service.cc:1511] Processing CreateTablet for tablet 0f0ffee11de74139a74b497dea5ab8fc (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:08.762436 31452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f0ffee11de74139a74b497dea5ab8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.764725 31544 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:08.765920 31359 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:08.767172 31382 tablet_service.cc:1511] Processing CreateTablet for tablet c179546c46da4fa98f8b4fb61f9128b2 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:08.768489 31382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c179546c46da4fa98f8b4fb61f9128b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.769950 31591 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.771155 31591 raft_consensus.cc:697] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:08.772037 31591 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.658982 31527 tablet_service.cc:1511] Processing CreateTablet for tablet 0f0ffee11de74139a74b497dea5ab8fc (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:08.794693 31586 tablet_bootstrap.cc:492] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:08.795202 31586 ts_tablet_manager.cc:1403] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.391s	user 0.023s	sys 0.021s
I20260709 12:23:08.798048 31586 raft_consensus.cc:359] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.801014 31377 tablet_service.cc:1511] Processing CreateTablet for tablet 3d30d3a647c247fab04a1722a89b8818 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:08.802187 31385 tablet_service.cc:1511] Processing CreateTablet for tablet a6b935bf4ae0467a9564dbd51820ce7c (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:08.807943 31382 tablet_service.cc:1511] Processing CreateTablet for tablet 1a937a8e153c40d396843c808354fb5b (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:08.809746 31379 tablet_service.cc:1511] Processing CreateTablet for tablet 25e1632d46704126852887ade0b97386 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:08.816148 31377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d30d3a647c247fab04a1722a89b8818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.818559 31590 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.828392 31527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f0ffee11de74139a74b497dea5ab8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.828647 31384 tablet_service.cc:1511] Processing CreateTablet for tablet 720e43702af64bf89bc425bfd0ad352e (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:08.828514 31590 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.804066 31586 raft_consensus.cc:385] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.830276 31586 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.823863 31381 tablet_service.cc:1511] Processing CreateTablet for tablet 78881770eb254ce191fad6a8664b7430 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:08.821420 31292 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.832899 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:08.835770 31590 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:08.837250 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:08.839424 31586 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:08.839931 31433 leader_election.cc:343] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:08.841233 31434 leader_election.cc:343] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.838193 31382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a937a8e153c40d396843c808354fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.841789 31434 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:08.844003 31585 tablet_bootstrap.cc:492] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:08.844487 31585 ts_tablet_manager.cc:1403] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.282s	user 0.024s	sys 0.013s
I20260709 12:23:08.846138 31384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720e43702af64bf89bc425bfd0ad352e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.844771 31590 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.848090 31584 tablet_bootstrap.cc:492] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:08.848567 31584 ts_tablet_manager.cc:1403] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.001s
I20260709 12:23:08.850041 31590 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.850519 31590 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.852819 31590 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:08.853556 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:08.829805 31376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56506 (request call id 38) took 1044 ms. Trace:
I20260709 12:23:08.853922 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:08.855084 31433 leader_election.cc:343] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:08.855751 31434 leader_election.cc:343] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.856276 31434 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:08.845042 31380 tablet_service.cc:1511] Processing CreateTablet for tablet a542644bc5014371a0403670d46545d9 (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:08.853567 31385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b935bf4ae0467a9564dbd51820ce7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.854385 31376 rpcz_store.cc:276] 0709 12:23:07.783226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.336700 (+553474us) service_pool.cc:224] Handling call
0709 12:23:08.412297 (+ 75597us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962f0831 00007f6e962cdac3 00007f6e9627c400 00007f6e8f701af4 00007f6e8f701a82 00007f6e8f7019b1
0709 12:23:08.442224 (+ 29927us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197e9c 00007f6e8e197a5b 00007f6e970b08d9 00007f6e9620aee0 00007f6e962f0831 00007f6e962cdac3 00007f6e9627c400 00007f6e8f701af4 00007f6e8f701a82 00007f6e8f7019b1
0709 12:23:08.499972 (+ 57748us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:23:08.500100 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:23:08.676799 (+176699us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:08.789975 (+113176us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:08.828012 (+ 38037us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68905216}
I20260709 12:23:08.861130 31376 tablet_service.cc:1511] Processing CreateTablet for tablet 0f0ffee11de74139a74b497dea5ab8fc (DEFAULT_TABLE table=test-workload [id=1802af488d51463c82a3b2082c7c894b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:08.857939 31585 raft_consensus.cc:359] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.845614 31586 ts_tablet_manager.cc:1434] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.050s	user 0.000s	sys 0.007s
I20260709 12:23:08.858579 31380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a542644bc5014371a0403670d46545d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.863922 31381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78881770eb254ce191fad6a8664b7430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.867561 31379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e1632d46704126852887ade0b97386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.871570 31376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f0ffee11de74139a74b497dea5ab8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.872006 31586 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:08.863399 31590 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.863420 31585 raft_consensus.cc:385] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.875650 31585 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.875927 31290 catalog_manager.cc:5697] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.883469 31585 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.885805 31585 ts_tablet_manager.cc:1434] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.002s
I20260709 12:23:08.886768 31585 tablet_bootstrap.cc:492] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:08.897048 31586 tablet_bootstrap.cc:654] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.897054 31585 tablet_bootstrap.cc:654] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.898180 31584 raft_consensus.cc:359] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.904965 31584 raft_consensus.cc:385] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.905274 31584 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.906049 31584 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.922042 31584 ts_tablet_manager.cc:1434] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.004s
I20260709 12:23:08.923183 31584 tablet_bootstrap.cc:492] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:08.937850 31584 tablet_bootstrap.cc:654] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.943116 31586 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:08.943790 31586 ts_tablet_manager.cc:1403] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.019s
I20260709 12:23:08.947623 31586 raft_consensus.cc:359] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:08.948659 31586 raft_consensus.cc:385] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.949047 31586 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.950037 31586 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:08.954704 31586 ts_tablet_manager.cc:1434] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:23:08.956117 31586 tablet_bootstrap.cc:492] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:08.959350 31585 tablet_bootstrap.cc:492] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:08.959895 31585 ts_tablet_manager.cc:1403] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.008s
I20260709 12:23:08.961251 31591 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.961778 31591 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:08.962353 31586 tablet_bootstrap.cc:654] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.964231 31591 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:08.965997 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:08.967617 31361 leader_election.cc:343] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.968307 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:08.970319 31359 leader_election.cc:343] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.970463 31585 raft_consensus.cc:359] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.970888 31359 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:08.971397 31585 raft_consensus.cc:385] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.971720 31585 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.972134 31591 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.972510 31585 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.974418 31584 tablet_bootstrap.cc:492] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:08.975131 31585 ts_tablet_manager.cc:1434] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.003s
I20260709 12:23:08.975124 31584 ts_tablet_manager.cc:1403] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.012s
I20260709 12:23:08.976904 31585 tablet_bootstrap.cc:492] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:08.979597 31584 raft_consensus.cc:359] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.980365 31584 raft_consensus.cc:385] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.980654 31584 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.981460 31584 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.985461 31585 tablet_bootstrap.cc:654] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.984823 31584 ts_tablet_manager.cc:1434] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:23:08.986881 31584 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:08.991120 31586 tablet_bootstrap.cc:492] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:08.995343 31586 ts_tablet_manager.cc:1403] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.003s
I20260709 12:23:08.995975 31584 tablet_bootstrap.cc:654] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.997298 31585 tablet_bootstrap.cc:492] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:08.997773 31585 ts_tablet_manager.cc:1403] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 12:23:08.998289 31586 raft_consensus.cc:359] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:08.999102 31586 raft_consensus.cc:385] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.999413 31586 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.000168 31586 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.001799 31585 raft_consensus.cc:359] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.002419 31584 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.002521 31586 ts_tablet_manager.cc:1434] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:09.002544 31585 raft_consensus.cc:385] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.003166 31584 ts_tablet_manager.cc:1403] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 12:23:09.003424 31585 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.003902 31586 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.004446 31585 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.006707 31585 ts_tablet_manager.cc:1434] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:09.006304 31584 raft_consensus.cc:359] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:09.007144 31584 raft_consensus.cc:385] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.007491 31584 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.008217 31584 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:09.010501 31584 ts_tablet_manager.cc:1434] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:09.010778 31585 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.013101 31586 tablet_bootstrap.cc:654] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.016108 31584 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.017386 31585 tablet_bootstrap.cc:654] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.023120 31584 tablet_bootstrap.cc:654] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.026531 31585 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.027537 31585 ts_tablet_manager.cc:1403] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.001s
I20260709 12:23:09.028849 31586 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.029311 31586 ts_tablet_manager.cc:1403] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.003s
I20260709 12:23:09.030453 31585 raft_consensus.cc:359] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:09.031179 31585 raft_consensus.cc:385] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.031509 31585 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.032131 31586 raft_consensus.cc:359] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.032220 31585 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:09.032892 31586 raft_consensus.cc:385] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.033159 31584 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.033187 31586 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.033757 31584 ts_tablet_manager.cc:1403] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 12:23:09.034425 31585 ts_tablet_manager.cc:1434] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:23:09.034161 31586 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.035892 31585 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.036334 31586 ts_tablet_manager.cc:1434] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:09.036466 31584 raft_consensus.cc:359] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.037174 31584 raft_consensus.cc:385] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.037345 31586 tablet_bootstrap.cc:492] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.037492 31584 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.038506 31584 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.042455 31585 tablet_bootstrap.cc:654] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.043970 31586 tablet_bootstrap.cc:654] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.044288 31584 ts_tablet_manager.cc:1434] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:09.045269 31584 tablet_bootstrap.cc:492] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.064085 31584 tablet_bootstrap.cc:654] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.068964 31584 tablet_bootstrap.cc:492] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.069211 31586 tablet_bootstrap.cc:492] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.069404 31584 ts_tablet_manager.cc:1403] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 12:23:09.069736 31585 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.069684 31586 ts_tablet_manager.cc:1403] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.020s
I20260709 12:23:09.070269 31585 ts_tablet_manager.cc:1403] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.025s
I20260709 12:23:09.071525 31584 raft_consensus.cc:359] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.072063 31584 raft_consensus.cc:385] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.072291 31584 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.072665 31585 raft_consensus.cc:359] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.072846 31584 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.072968 31586 raft_consensus.cc:359] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.073372 31585 raft_consensus.cc:385] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.073665 31586 raft_consensus.cc:385] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.073693 31585 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.074090 31586 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.074776 31584 ts_tablet_manager.cc:1434] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:09.074465 31585 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.074867 31586 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.076011 31584 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.076378 31590 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.076804 31590 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:09.078794 31590 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:09.080056 31585 ts_tablet_manager.cc:1434] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:09.080907 31585 tablet_bootstrap.cc:492] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.081714 31584 tablet_bootstrap.cc:654] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.081996 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.082644 31395 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.080323 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.083597 31544 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.085207 31434 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.086545 31612 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.087743 31586 ts_tablet_manager.cc:1434] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:23:09.088728 31586 tablet_bootstrap.cc:492] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.087113 31612 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.095376 31585 tablet_bootstrap.cc:654] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.095547 31586 tablet_bootstrap.cc:654] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.098376 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.099298 31394 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.102648 31591 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.103274 31591 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.106019 31591 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.108073 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.108657 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.108873 31469 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:09.109506 31544 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:09.110492 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.111613 31591 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.112100 31591 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.112545 31591 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.113494 31590 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.114071 31590 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.114543 31590 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.111409 31433 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.131472 31612 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.132304 31612 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.132735 31612 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.133198 31612 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.134691 31638 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.135339 31638 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.138067 31638 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.140167 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.141031 31395 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.142818 31433 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.145731 31591 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.150053 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:09.150794 31469 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.155869 31639 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.158004 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.175732 31544 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.160014 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.161588 31469 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:09.165149 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.178663 31543 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:09.180032 31434 leader_election.cc:343] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.181505 31639 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.182077 31639 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.185231 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.186427 31613 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.166483 31638 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.187742 31638 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.189303 31612 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.174293 31590 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:09.191473 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.198338 31585 tablet_bootstrap.cc:492] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.198995 31585 ts_tablet_manager.cc:1403] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.118s	user 0.039s	sys 0.067s
W20260709 12:23:09.200001 31433 leader_election.cc:343] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.200163 31612 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.201114 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.198335 31584 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.201702 31544 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.202204 31584 ts_tablet_manager.cc:1403] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.127s	user 0.034s	sys 0.087s
I20260709 12:23:09.203728 31639 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.204582 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.205149 31394 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.204957 31584 raft_consensus.cc:359] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.206024 31639 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.206223 31584 raft_consensus.cc:385] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.206598 31584 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.207278 31584 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.196081 31638 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.208591 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.209151 31584 ts_tablet_manager.cc:1434] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:09.209187 31541 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.210238 31584 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.211761 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.213020 31544 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.214282 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.215106 31393 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.215507 31584 tablet_bootstrap.cc:654] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.197510 31543 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:09.197495 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.216219 31542 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.201550 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.219511 31395 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.222760 31586 tablet_bootstrap.cc:492] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.167011 31591 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.223268 31586 ts_tablet_manager.cc:1403] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.135s	user 0.015s	sys 0.016s
I20260709 12:23:09.225795 31586 raft_consensus.cc:359] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.226636 31586 raft_consensus.cc:385] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.226907 31586 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
W20260709 12:23:09.227553 31434 leader_election.cc:343] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.229456 31434 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.229622 31586 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.230368 31434 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:09.231494 31639 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.231953 31639 raft_consensus.cc:697] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:09.232954 31586 ts_tablet_manager.cc:1434] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:23:09.232728 31639 consensus_queue.cc:237] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.234213 31586 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.235507 31612 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.235870 31612 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.236210 31612 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.238577 31395 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.239373 31594 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.239825 31594 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.241838 31594 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:09.242460 31586 tablet_bootstrap.cc:654] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.243394 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.205317 31585 raft_consensus.cc:359] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.243961 31585 raft_consensus.cc:385] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.244014 31469 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:09.244356 31585 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.245009 31585 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.245292 31510 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.247977 31643 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.249446 31585 ts_tablet_manager.cc:1434] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.050s	user 0.001s	sys 0.005s
I20260709 12:23:09.250056 31640 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.250427 31585 tablet_bootstrap.cc:492] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.250715 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.250494 31640 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.253005 31640 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.253512 31392 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:09.258071 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.258765 31643 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.259928 31643 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.205224 31590 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:09.258436 31585 tablet_bootstrap.cc:654] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.258737 31469 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:09.265930 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.266724 31640 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.267063 31640 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.267470 31640 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.228682 31613 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:09.243155 31394 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.281601 31590 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.280613 31393 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.288818 31612 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.291658 31612 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.297905 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.299263 31541 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.298669 31613 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.298672 31544 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.305614 31434 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.306707 31612 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.307422 31612 raft_consensus.cc:697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:09.284421 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.291025 31643 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.307348 31638 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.295301 31590 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.315433 31612 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } }
I20260709 12:23:09.317210 31586 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.317639 31586 ts_tablet_manager.cc:1403] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.084s	user 0.025s	sys 0.020s
I20260709 12:23:09.320497 31586 raft_consensus.cc:359] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.322796 31586 raft_consensus.cc:385] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.323170 31586 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.325045 31543 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:09.324649 31586 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.323797 31640 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.325286 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.329612 31584 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.330498 31584 ts_tablet_manager.cc:1403] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.120s	user 0.039s	sys 0.038s
I20260709 12:23:09.328145 31291 catalog_manager.cc:5697] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.332032 31586 ts_tablet_manager.cc:1434] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:09.333297 31586 tablet_bootstrap.cc:492] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.336769 31590 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.337829 31586 tablet_bootstrap.cc:654] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.342901 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.343700 31542 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.344866 31643 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:09.346458 31640 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.351974 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:09.351795 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.346953 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:09.346504 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.352555 31470 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.355795 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.356041 31394 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.358304 31393 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:09.361907 31507 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:09.362730 31643 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.368667 31584 raft_consensus.cc:359] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.371759 31584 raft_consensus.cc:385] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.372108 31584 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.372761 31584 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.372717 31290 catalog_manager.cc:5697] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.374876 31584 ts_tablet_manager.cc:1434] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.000s
I20260709 12:23:09.376014 31584 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.376252 31469 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.377148 31585 tablet_bootstrap.cc:492] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.377573 31585 ts_tablet_manager.cc:1403] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.007s
I20260709 12:23:09.380167 31585 raft_consensus.cc:359] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.380792 31585 raft_consensus.cc:385] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.360646 31612 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.381577 31612 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.381775 31584 tablet_bootstrap.cc:654] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.381947 31612 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.374881 31470 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:09.385218 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:09.381050 31585 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.388119 31585 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.388888 31591 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.390071 31585 ts_tablet_manager.cc:1434] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:23:09.390589 31591 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.391247 31591 raft_consensus.cc:697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:09.391525 31585 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.392359 31591 consensus_queue.cc:237] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.394625 31544 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.396535 31613 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.399304 31585 tablet_bootstrap.cc:654] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.399844 31434 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.403645 31586 tablet_bootstrap.cc:492] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.404059 31586 ts_tablet_manager.cc:1403] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 12:23:09.403285 31291 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.396554 31433 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:09.408242 31590 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.410578 31590 raft_consensus.cc:697] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:09.410651 31586 raft_consensus.cc:359] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.411366 31586 raft_consensus.cc:385] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.411659 31586 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.412467 31586 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.414456 31590 consensus_queue.cc:237] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.420428 31586 ts_tablet_manager.cc:1434] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:09.421353 31645 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.421847 31645 raft_consensus.cc:697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:09.422744 31645 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.423008 31613 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.425312 31613 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.429880 31613 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.430739 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.431103 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.433279 31359 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:09.434804 31613 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:09.426143 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 54979.6us
W20260709 12:23:09.435747 31433 leader_election.cc:343] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.442616 31584 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.443061 31584 ts_tablet_manager.cc:1403] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.025s
I20260709 12:23:09.439913 31639 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:09.449901 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.450590 31394 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.468264 31613 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.468351 31586 tablet_bootstrap.cc:492] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.442193 31612 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.479135 31584 raft_consensus.cc:359] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.479776 31584 raft_consensus.cc:385] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.480013 31584 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.480662 31584 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.481266 31612 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.483659 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.484290 31544 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.468816 31613 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.489468 31613 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.490201 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.490744 31393 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.493275 31584 ts_tablet_manager.cc:1434] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.003s
I20260709 12:23:09.494280 31584 tablet_bootstrap.cc:492] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.492054 31289 catalog_manager.cc:5697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.495601 31585 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.496012 31585 ts_tablet_manager.cc:1403] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.019s
I20260709 12:23:09.496912 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:09.498373 31361 leader_election.cc:343] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.498879 31544 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.499539 31586 tablet_bootstrap.cc:654] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.502118 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.503902 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.504766 31612 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.505255 31612 raft_consensus.cc:697] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:09.506084 31612 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:09.508395 31359 leader_election.cc:343] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.508891 31359 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:09.509323 31393 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.512296 31613 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.520160 31584 tablet_bootstrap.cc:654] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.522258 31290 catalog_manager.cc:5697] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.526247 31290 catalog_manager.cc:5697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.527541 31584 tablet_bootstrap.cc:492] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.528007 31584 ts_tablet_manager.cc:1403] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 12:23:09.530517 31584 raft_consensus.cc:359] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.531180 31584 raft_consensus.cc:385] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.531472 31584 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.532701 31586 tablet_bootstrap.cc:492] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.532461 31584 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.533147 31586 ts_tablet_manager.cc:1403] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.007s
I20260709 12:23:09.534731 31584 ts_tablet_manager.cc:1434] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:09.535627 31584 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.535804 31586 raft_consensus.cc:359] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.536482 31586 raft_consensus.cc:385] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.536732 31586 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.537393 31586 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.539359 31586 ts_tablet_manager.cc:1434] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:23:09.540177 31586 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.542176 31594 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.542675 31594 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.544764 31594 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:09.546559 31586 tablet_bootstrap.cc:654] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.546797 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.547528 31584 tablet_bootstrap.cc:654] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.547466 31394 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:09.554543 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.555416 31470 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:09.556824 31510 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.557682 31594 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.558013 31594 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.558326 31594 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.558581 31584 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.558993 31586 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.559006 31584 ts_tablet_manager.cc:1403] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.009s
I20260709 12:23:09.559516 31586 ts_tablet_manager.cc:1403] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 12:23:09.561970 31584 raft_consensus.cc:359] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.562646 31584 raft_consensus.cc:385] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.562610 31586 raft_consensus.cc:359] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.563102 31584 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.563475 31586 raft_consensus.cc:385] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.563766 31586 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.563177 31290 catalog_manager.cc:5697] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.564527 31586 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.564568 31584 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.565402 31594 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.566965 31586 ts_tablet_manager.cc:1434] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:23:09.566789 31584 ts_tablet_manager.cc:1434] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:09.568341 31584 tablet_bootstrap.cc:492] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.568176 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.541647 31585 raft_consensus.cc:359] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.568780 31394 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.569119 31585 raft_consensus.cc:385] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.569406 31585 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.573024 31594 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:09.573616 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:09.574136 31470 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.576650 31394 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:09.576889 31584 tablet_bootstrap.cc:654] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.577723 31507 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.578807 31594 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.579500 31594 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:09.580335 31594 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.580861 31470 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:09.582203 31585 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.583978 31586 tablet_bootstrap.cc:492] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.585433 31584 tablet_bootstrap.cc:492] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.585844 31584 ts_tablet_manager.cc:1403] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 12:23:09.586315 31585 ts_tablet_manager.cc:1434] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.090s	user 0.004s	sys 0.003s
I20260709 12:23:09.587193 31585 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.589929 31584 raft_consensus.cc:359] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.590626 31584 raft_consensus.cc:385] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.590912 31584 raft_consensus.cc:740] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.591538 31584 consensus_queue.cc:260] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.594269 31584 ts_tablet_manager.cc:1434] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:09.595111 31584 tablet_bootstrap.cc:492] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.596423 31586 tablet_bootstrap.cc:654] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.595139 31585 tablet_bootstrap.cc:654] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.601275 31586 tablet_bootstrap.cc:492] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.601704 31586 ts_tablet_manager.cc:1403] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 12:23:09.602732 31584 tablet_bootstrap.cc:654] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.600816 31291 catalog_manager.cc:5697] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:09.604295 31586 raft_consensus.cc:359] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.604936 31586 raft_consensus.cc:385] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.605204 31586 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.606396 31586 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.608775 31586 ts_tablet_manager.cc:1434] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:09.613750 31586 tablet_bootstrap.cc:492] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.619201 31613 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.619782 31613 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.622058 31613 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.622469 31586 tablet_bootstrap.cc:654] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.624352 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.624963 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.625191 31470 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:09.625602 31544 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:09.627035 31359 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:09.627954 31613 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.628355 31613 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.628767 31613 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.635094 31585 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.635636 31584 tablet_bootstrap.cc:492] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.635713 31585 ts_tablet_manager.cc:1403] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.019s
I20260709 12:23:09.636140 31584 ts_tablet_manager.cc:1403] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.022s
I20260709 12:23:09.638800 31584 raft_consensus.cc:359] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.639484 31584 raft_consensus.cc:385] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.639256 31585 raft_consensus.cc:359] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.639807 31584 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.640163 31585 raft_consensus.cc:385] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.640530 31585 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.641394 31585 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.644047 31584 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.644495 31585 ts_tablet_manager.cc:1434] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:23:09.645648 31585 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.647457 31584 ts_tablet_manager.cc:1434] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:23:09.648411 31586 tablet_bootstrap.cc:492] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.648900 31586 ts_tablet_manager.cc:1403] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.019s
I20260709 12:23:09.651770 31585 tablet_bootstrap.cc:654] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.651644 31586 raft_consensus.cc:359] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.652334 31586 raft_consensus.cc:385] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.652089 31613 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.652638 31586 raft_consensus.cc:740] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.653491 31586 consensus_queue.cc:260] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.656179 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:09.656685 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.656996 31586 ts_tablet_manager.cc:1434] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:09.657413 31544 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.658509 31584 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.656720 31470 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.665024 31584 tablet_bootstrap.cc:654] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.665678 31585 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.666115 31585 ts_tablet_manager.cc:1403] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:23:09.667948 31586 tablet_bootstrap.cc:492] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.668676 31585 raft_consensus.cc:359] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.669341 31585 raft_consensus.cc:385] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.669605 31585 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.670674 31585 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.672952 31585 ts_tablet_manager.cc:1434] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:09.673802 31585 tablet_bootstrap.cc:492] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.674846 31470 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:09.675446 31586 tablet_bootstrap.cc:654] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.679668 31585 tablet_bootstrap.cc:654] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.685039 31613 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.685611 31584 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.686038 31584 ts_tablet_manager.cc:1403] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.011s
I20260709 12:23:09.685806 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.687029 31544 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:09.687202 31613 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.688511 31613 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:09.689450 31612 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.689616 31584 raft_consensus.cc:359] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.689950 31612 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.692271 31612 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.693125 31585 tablet_bootstrap.cc:492] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.693005 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.693576 31585 ts_tablet_manager.cc:1403] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 12:23:09.693702 31394 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.690330 31584 raft_consensus.cc:385] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.695084 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.695402 31584 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.695923 31612 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.696316 31612 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.696164 31584 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.696887 31612 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.696533 31585 raft_consensus.cc:359] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.697726 31585 raft_consensus.cc:385] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.698017 31585 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.698750 31584 ts_tablet_manager.cc:1434] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:23:09.698751 31585 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.696412 31613 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.701090 31585 ts_tablet_manager.cc:1434] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:09.701969 31585 tablet_bootstrap.cc:492] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.702214 31584 tablet_bootstrap.cc:492] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.707988 31585 tablet_bootstrap.cc:654] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.709115 31586 tablet_bootstrap.cc:492] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.709620 31586 ts_tablet_manager.cc:1403] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.013s
I20260709 12:23:09.710546 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.711165 31544 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.712563 31586 raft_consensus.cc:359] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.713281 31586 raft_consensus.cc:385] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.713552 31586 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.714250 31586 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.711395 31612 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.718987 31584 tablet_bootstrap.cc:654] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.720124 31586 ts_tablet_manager.cc:1434] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:09.721108 31586 tablet_bootstrap.cc:492] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.721407 31612 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.722536 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.723129 31394 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.726495 31584 tablet_bootstrap.cc:492] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.726917 31584 ts_tablet_manager.cc:1403] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 12:23:09.730509 31394 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.731596 31586 tablet_bootstrap.cc:654] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.731232 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.732157 31544 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.735095 31290 catalog_manager.cc:5697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.737650 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.738582 31612 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:09.739452 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:09.739807 31612 raft_consensus.cc:697] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:09.742591 31612 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.741456 31585 tablet_bootstrap.cc:492] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.743577 31585 ts_tablet_manager.cc:1403] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.001s
I20260709 12:23:09.747130 31585 raft_consensus.cc:359] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.748055 31585 raft_consensus.cc:385] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.748476 31585 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.749480 31585 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.756790 31585 ts_tablet_manager.cc:1434] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:23:09.757771 31585 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:09.741400 31584 raft_consensus.cc:359] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.758783 31638 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.763543 31584 raft_consensus.cc:385] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.763896 31584 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.764608 31584 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.766649 31584 ts_tablet_manager.cc:1434] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:23:09.767725 31584 tablet_bootstrap.cc:492] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.773188 31544 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.773437 31613 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.775985 31613 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.778745 31613 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.780417 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.781442 31585 tablet_bootstrap.cc:654] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.786710 31584 tablet_bootstrap.cc:654] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.789527 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.789295 31638 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.790561 31544 raft_consensus.cc:2393] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:09.791661 31359 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:09.792826 31613 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.798403 31590 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.798893 31590 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.799955 31638 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.802928 31613 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.797614 31289 catalog_manager.cc:5697] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.807907 31586 tablet_bootstrap.cc:492] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.808425 31586 ts_tablet_manager.cc:1403] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.088s	user 0.037s	sys 0.022s
I20260709 12:23:09.811172 31586 raft_consensus.cc:359] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.813100 31586 raft_consensus.cc:385] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.813449 31586 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.814281 31586 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.814824 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.816771 31586 ts_tablet_manager.cc:1434] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 12:23:09.816645 31433 leader_election.cc:343] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.817822 31586 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.818714 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.818862 31590 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:09.820087 31434 leader_election.cc:343] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.820535 31434 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:09.826262 31586 tablet_bootstrap.cc:654] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.832096 31590 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.838040 31586 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:09.838487 31612 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.838646 31590 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.838512 31586 ts_tablet_manager.cc:1403] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:23:09.839007 31612 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.841984 31586 raft_consensus.cc:359] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.842634 31586 raft_consensus.cc:385] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.842906 31586 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.839143 31590 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.846172 31612 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.847141 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.847424 31590 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.847525 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.848218 31586 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:09.848883 31434 leader_election.cc:343] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.849175 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:09.849954 31433 leader_election.cc:343] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.850560 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:09.850669 31433 leader_election.cc:343] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.851285 31544 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.851269 31433 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:09.852479 31612 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.853788 31612 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.854748 31613 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.859366 31584 tablet_bootstrap.cc:492] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.859838 31584 ts_tablet_manager.cc:1403] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.002s
I20260709 12:23:09.859869 31434 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:09.860961 31590 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.861323 31590 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.861768 31590 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.862510 31584 raft_consensus.cc:359] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.863195 31584 raft_consensus.cc:385] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.864449 31584 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.865228 31584 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.866943 31584 ts_tablet_manager.cc:1434] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:09.850831 31586 ts_tablet_manager.cc:1434] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:23:09.867864 31584 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.868496 31586 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:09.873955 31585 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:09.874411 31585 ts_tablet_manager.cc:1403] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.002s
I20260709 12:23:09.877286 31584 tablet_bootstrap.cc:654] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.877502 31640 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.882613 31585 raft_consensus.cc:359] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.883366 31585 raft_consensus.cc:385] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.883667 31585 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.884616 31585 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.889771 31612 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.899920 31640 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.900596 31640 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.907430 31640 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.908872 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.909039 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.910272 31585 ts_tablet_manager.cc:1434] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
W20260709 12:23:09.911594 31359 leader_election.cc:343] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.913452 31585 tablet_bootstrap.cc:492] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
W20260709 12:23:09.914665 31361 leader_election.cc:343] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.917542 31594 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.918041 31594 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.919546 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:09.912248 31612 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:09.921833 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.922435 31643 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.922895 31643 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.924819 31643 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:09.925969 31590 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.927729 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:09.926642 31640 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:09.927069 31510 leader_election.cc:343] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.927484 31586 tablet_bootstrap.cc:654] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.921190 31594 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:09.931774 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:09.932403 31541 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.932639 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.935329 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:09.932309 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:09.936306 31507 leader_election.cc:343] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.937448 31507 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:09.939414 31594 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.939919 31640 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.934047 31590 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:09.940289 31433 leader_election.cc:343] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.939005 31507 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:09.945588 31594 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.946117 31585 tablet_bootstrap.cc:654] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.948346 31639 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.960516 31541 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:09.961707 31584 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:09.962255 31584 ts_tablet_manager.cc:1403] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.021s
I20260709 12:23:09.966128 31584 raft_consensus.cc:359] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.966988 31584 raft_consensus.cc:385] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.967357 31584 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.968130 31584 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.971403 31434 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:09.972093 31584 ts_tablet_manager.cc:1434] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 12:23:09.973923 31584 tablet_bootstrap.cc:492] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:09.974084 31639 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.974568 31639 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:09.975482 31639 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.977294 31591 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.980787 31584 tablet_bootstrap.cc:654] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.981870 31645 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.982357 31645 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:09.984401 31645 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:09.988461 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:09.989111 31395 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:09.989912 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:09.990410 31644 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.993805 31543 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.995018 31433 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:09.996066 31644 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.996426 31644 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.996810 31644 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.996510 31645 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:09.999609 31434 leader_election.cc:343] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.018975 31645 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.019655 31645 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.023208 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.023902 31393 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:10.025300 31433 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:10.026643 31590 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.027035 31590 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.027515 31590 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.027340 31644 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.030226 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:10.030777 31393 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.031852 31645 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.032428 31645 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.032996 31645 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.036273 31585 tablet_bootstrap.cc:492] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:10.036110 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.036592 31594 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.041852 31594 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.036695 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:10.035633 31290 catalog_manager.cc:5697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.039935 31645 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.041141 31393 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:10.041191 31392 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:10.046852 31585 ts_tablet_manager.cc:1403] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.000s
I20260709 12:23:10.049808 31586 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:10.050277 31586 ts_tablet_manager.cc:1403] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.182s	user 0.009s	sys 0.012s
I20260709 12:23:10.050025 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.050544 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:10.055061 31644 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.056248 31643 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.045814 31594 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:10.068217 31433 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:10.071373 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:10.076224 31433 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:10.076265 31639 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.051074 31541 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:10.051951 31394 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:10.088755 31644 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.091858 31590 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.064687 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:10.155539 31507 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:10.161854 31469 raft_consensus.cc:2393] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:10.128968 31644 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.164495 31644 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.168385 31643 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.168780 31643 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.169116 31643 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.179584 31594 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.182755 31643 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.206640 31639 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.206230 31612 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.219341 31612 raft_consensus.cc:697] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:10.220383 31612 consensus_queue.cc:237] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.171591 31590 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:10.210175 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 79349.7us
I20260709 12:23:10.238183 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:10.264150 31395 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.264642 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:10.252527 31643 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:10.212535 31639 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.221625 31594 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.266403 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:10.278252 31586 raft_consensus.cc:359] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.278817 31586 raft_consensus.cc:385] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.279048 31586 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.279773 31586 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.281128 31470 raft_consensus.cc:2393] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:10.284768 31585 raft_consensus.cc:359] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.285526 31585 raft_consensus.cc:385] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.285820 31585 raft_consensus.cc:740] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.269225 31594 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.288302 31639 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.290107 31585 consensus_queue.cc:260] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.291535 31586 ts_tablet_manager.cc:1434] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.241s	user 0.006s	sys 0.001s
I20260709 12:23:10.293093 31543 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.301195 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.303112 31586 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:10.305852 31391 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:10.306393 31613 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:23:10.321866 31594 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:10.358108 31584 tablet_bootstrap.cc:492] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:10.358675 31584 ts_tablet_manager.cc:1403] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.385s	user 0.044s	sys 0.043s
W20260709 12:23:10.358131 31702 log.cc:927] Time spent T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:23:10.311894 31434 leader_election.cc:343] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:10.367452 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 59501.1us
I20260709 12:23:10.373298 31640 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.323951 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:10.323952 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.386974 31433 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:10.389501 31584 raft_consensus.cc:359] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.394627 31584 raft_consensus.cc:385] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.395053 31584 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.396952 31590 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.397369 31590 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.397717 31590 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.401782 31584 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.406046 31699 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:23:10.406401 31644 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.407789 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:10.408551 31539 raft_consensus.cc:2393] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:10.408706 31644 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.421831 31584 ts_tablet_manager.cc:1434] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.001s
I20260709 12:23:10.423260 31584 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:10.386019 31470 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:10.426692 31395 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:10.429508 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:10.432576 31643 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.433082 31643 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.433475 31643 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.448828 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:10.449915 31639 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.451265 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:10.452149 31539 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
W20260709 12:23:10.459831 31507 leader_election.cc:343] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.462683 31590 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.482640 31507 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:10.483618 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:10.476712 31543 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:10.498178 31585 ts_tablet_manager.cc:1434] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.450s	user 0.015s	sys 0.000s
I20260709 12:23:10.494166 31395 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.499153 31643 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.502187 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:10.502532 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:10.502729 31470 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.501669 31643 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:10.507658 31586 tablet_bootstrap.cc:654] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.512965 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:10.513577 31391 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.513096 31590 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.518229 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:10.519148 31470 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:10.520311 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:10.522691 31715 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.520351 31395 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:10.524742 31716 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.530354 31433 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:10.530897 31585 tablet_bootstrap.cc:492] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:10.529721 31716 raft_consensus.cc:697] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:10.530102 31715 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:10.531937 31716 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.532015 31715 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.534298 31714 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.536008 31714 raft_consensus.cc:697] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:10.536849 31714 consensus_queue.cc:237] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:10.535215 31507 leader_election.cc:343] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.540642 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:10.541185 31544 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.541889 31584 tablet_bootstrap.cc:654] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:10.545320 31434 leader_election.cc:343] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.545640 31586 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:10.545295 31710 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:10.546553 31639 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.546962 31586 ts_tablet_manager.cc:1403] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.252s	user 0.016s	sys 0.006s
I20260709 12:23:10.553103 31391 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:10.559041 31433 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:10.578348 31586 raft_consensus.cc:359] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.567107 31639 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.582149 31544 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
W20260709 12:23:10.590307 31433 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:10.594826 31586 raft_consensus.cc:385] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.595285 31586 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.611765 31639 raft_consensus.cc:697] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:10.637022 31585 tablet_bootstrap.cc:654] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.638293 31639 consensus_queue.cc:237] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.646900 31586 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.649298 31586 ts_tablet_manager.cc:1434] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.102s	user 0.010s	sys 0.005s
I20260709 12:23:10.650231 31586 tablet_bootstrap.cc:492] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:10.655357 31290 catalog_manager.cc:5697] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.668790 31585 tablet_bootstrap.cc:492] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:10.669287 31585 ts_tablet_manager.cc:1403] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.139s	user 0.007s	sys 0.010s
I20260709 12:23:10.677291 31585 raft_consensus.cc:359] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.677927 31585 raft_consensus.cc:385] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.680789 31710 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.678198 31585 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.682134 31585 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.684542 31585 ts_tablet_manager.cc:1434] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.004s
I20260709 12:23:10.685436 31585 tablet_bootstrap.cc:492] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:10.696656 31584 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:10.697103 31584 ts_tablet_manager.cc:1403] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.274s	user 0.011s	sys 0.038s
I20260709 12:23:10.698205 31292 catalog_manager.cc:5697] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.699599 31584 raft_consensus.cc:359] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.700289 31584 raft_consensus.cc:385] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.700682 31585 tablet_bootstrap.cc:654] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.700469 31292 catalog_manager.cc:5697] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.705866 31585 tablet_bootstrap.cc:492] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:10.706342 31585 ts_tablet_manager.cc:1403] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 12:23:10.707872 31586 tablet_bootstrap.cc:654] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.708830 31585 raft_consensus.cc:359] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.700529 31584 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.709604 31585 raft_consensus.cc:385] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.709954 31585 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.710275 31584 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.710727 31585 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.712550 31584 ts_tablet_manager.cc:1434] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:23:10.713165 31585 ts_tablet_manager.cc:1434] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:10.713501 31584 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:10.714084 31585 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:10.720355 31585 tablet_bootstrap.cc:654] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.723964 31584 tablet_bootstrap.cc:654] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.734498 31591 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.735031 31591 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.737145 31591 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.734045 31639 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:10.738308 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:10.739794 31361 leader_election.cc:343] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.739964 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:10.742761 31715 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.743274 31715 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.745574 31715 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:10.747521 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:10.748353 31586 tablet_bootstrap.cc:492] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:10.748778 31586 ts_tablet_manager.cc:1403] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.007s
I20260709 12:23:10.748705 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.749358 31393 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
W20260709 12:23:10.750990 31510 leader_election.cc:343] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:10.751212 31359 leader_election.cc:343] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.751497 31586 raft_consensus.cc:359] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.751778 31359 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:10.752166 31507 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:10.752923 31591 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.753674 31715 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.754138 31715 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.754637 31715 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.759963 31586 raft_consensus.cc:385] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.760385 31586 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.761538 31585 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:10.761139 31586 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.762478 31585 ts_tablet_manager.cc:1403] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.009s
I20260709 12:23:10.765407 31586 ts_tablet_manager.cc:1434] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:23:10.766311 31586 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:10.767086 31584 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:10.767987 31584 ts_tablet_manager.cc:1403] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.016s
I20260709 12:23:10.769467 31639 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.770047 31639 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.765444 31585 raft_consensus.cc:359] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.773064 31585 raft_consensus.cc:385] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.772902 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.773567 31393 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:10.773859 31639 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.773471 31292 catalog_manager.cc:5697] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.775130 31433 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:10.775586 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:10.777408 31434 leader_election.cc:343] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.778115 31586 tablet_bootstrap.cc:654] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.778250 31585 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.779129 31585 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.780762 31639 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.781129 31639 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:10.781476 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:10.772377 31715 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.781441 31639 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.786585 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:10.788015 31510 leader_election.cc:343] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.783041 31292 catalog_manager.cc:5697] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.788642 31715 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:10.781431 31585 ts_tablet_manager.cc:1434] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:23:10.790604 31585 tablet_bootstrap.cc:492] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:10.784397 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:10.791483 31393 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.791064 31639 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.795562 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:23:10.796895 31434 leader_election.cc:343] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.784415 31586 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:10.797842 31586 ts_tablet_manager.cc:1403] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.004s
I20260709 12:23:10.798440 31393 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:10.798745 31639 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:10.799201 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:10.810055 31391 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.810556 31507 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:10.815613 31585 tablet_bootstrap.cc:654] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.816900 31391 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:10.802522 31584 raft_consensus.cc:359] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.817797 31584 raft_consensus.cc:385] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.818106 31584 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.818231 31433 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:10.818830 31584 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.819420 31639 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.819882 31639 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:10.821033 31584 ts_tablet_manager.cc:1434] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 12:23:10.820732 31639 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.821888 31584 tablet_bootstrap.cc:492] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:10.826025 31715 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.827303 31715 raft_consensus.cc:697] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:10.828223 31715 consensus_queue.cc:237] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.829502 31586 raft_consensus.cc:359] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.830369 31586 raft_consensus.cc:385] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.830691 31586 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.831525 31586 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.838505 31584 tablet_bootstrap.cc:654] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.839637 31585 tablet_bootstrap.cc:492] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:10.840147 31585 ts_tablet_manager.cc:1403] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.003s
I20260709 12:23:10.840467 31289 catalog_manager.cc:5697] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.842612 31586 ts_tablet_manager.cc:1434] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.013s
I20260709 12:23:10.842986 31585 raft_consensus.cc:359] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.843732 31585 raft_consensus.cc:385] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.844118 31585 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.844805 31584 tablet_bootstrap.cc:492] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:10.845317 31584 ts_tablet_manager.cc:1403] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 12:23:10.845669 31585 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.848336 31585 ts_tablet_manager.cc:1434] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:10.848037 31584 raft_consensus.cc:359] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.848774 31584 raft_consensus.cc:385] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.849048 31584 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.849907 31585 tablet_bootstrap.cc:492] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:10.849797 31584 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.850337 31715 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.852049 31584 ts_tablet_manager.cc:1434] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:23:10.852964 31584 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:10.856894 31585 tablet_bootstrap.cc:654] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.856544 31290 catalog_manager.cc:5697] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.859130 31584 tablet_bootstrap.cc:654] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.850833 31715 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.863412 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.863790 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:10.864195 31391 raft_consensus.cc:2393] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:10.843648 31586 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:10.865854 31507 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:10.866947 31716 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.872284 31584 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:10.872707 31584 ts_tablet_manager.cc:1403] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 12:23:10.874955 31716 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.875289 31584 raft_consensus.cc:359] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.875988 31584 raft_consensus.cc:385] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.876256 31584 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.876513 31715 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:10.876959 31584 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.877749 31585 tablet_bootstrap.cc:492] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:10.878262 31585 ts_tablet_manager.cc:1403] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 12:23:10.879079 31586 tablet_bootstrap.cc:654] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.879665 31584 ts_tablet_manager.cc:1434] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:10.880553 31584 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:10.880972 31585 raft_consensus.cc:359] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.881659 31585 raft_consensus.cc:385] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.881976 31585 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.882759 31585 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.885089 31585 ts_tablet_manager.cc:1434] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:10.887081 31585 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:10.887794 31584 tablet_bootstrap.cc:654] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.895624 31584 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:10.896525 31584 ts_tablet_manager.cc:1403] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:23:10.896821 31585 tablet_bootstrap.cc:654] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.898986 31584 raft_consensus.cc:359] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.899802 31584 raft_consensus.cc:385] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.902236 31586 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:10.902294 31584 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.902827 31586 ts_tablet_manager.cc:1403] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.003s
I20260709 12:23:10.903450 31584 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.905388 31586 raft_consensus.cc:359] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.906013 31586 raft_consensus.cc:385] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.906260 31586 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.906384 31584 ts_tablet_manager.cc:1434] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:10.907321 31584 tablet_bootstrap.cc:492] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:10.907022 31586 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.909051 31586 ts_tablet_manager.cc:1434] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:23:10.912523 31586 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:10.912573 31585 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:10.913061 31585 ts_tablet_manager.cc:1403] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.005s
I20260709 12:23:10.916944 31585 raft_consensus.cc:359] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.917606 31585 raft_consensus.cc:385] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.917867 31585 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.918503 31585 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.919060 31586 tablet_bootstrap.cc:654] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.920634 31585 ts_tablet_manager.cc:1434] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:10.920881 31584 tablet_bootstrap.cc:654] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.936229 31586 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:10.936344 31715 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.936811 31586 ts_tablet_manager.cc:1403] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 12:23:10.937137 31584 tablet_bootstrap.cc:492] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:10.936856 31715 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.937561 31584 ts_tablet_manager.cc:1403] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.006s
I20260709 12:23:10.938864 31715 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:10.939615 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:10.939925 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:10.940363 31391 raft_consensus.cc:2393] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:10.940021 31586 raft_consensus.cc:359] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.940708 31586 raft_consensus.cc:385] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.940984 31586 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.941233 31584 raft_consensus.cc:359] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.941668 31507 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:10.941861 31584 raft_consensus.cc:385] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.941606 31586 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.942251 31584 raft_consensus.cc:740] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.942756 31715 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.942924 31584 consensus_queue.cc:260] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.943778 31586 ts_tablet_manager.cc:1434] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:10.944994 31584 ts_tablet_manager.cc:1434] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:10.946012 31586 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:10.947805 31584 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:10.952726 31586 tablet_bootstrap.cc:654] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.955103 31584 tablet_bootstrap.cc:654] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.957388 31715 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.958495 31585 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:10.963881 31586 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:10.964323 31586 ts_tablet_manager.cc:1403] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:23:10.967092 31586 raft_consensus.cc:359] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.967814 31586 raft_consensus.cc:385] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.968101 31586 raft_consensus.cc:740] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.968926 31586 consensus_queue.cc:260] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.970525 31584 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:10.970738 31586 ts_tablet_manager.cc:1434] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:10.970947 31584 ts_tablet_manager.cc:1403] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 12:23:10.971809 31585 tablet_bootstrap.cc:654] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.973115 31586 tablet_bootstrap.cc:492] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:10.973673 31584 raft_consensus.cc:359] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.974414 31584 raft_consensus.cc:385] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.974879 31584 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.975718 31584 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:10.977897 31584 ts_tablet_manager.cc:1434] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:10.978989 31584 tablet_bootstrap.cc:492] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:10.979439 31586 tablet_bootstrap.cc:654] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.982277 31591 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.985692 31584 tablet_bootstrap.cc:654] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.982905 31591 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:11.000417 31507 consensus_peers.cc:597] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.001220 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.001839 31470 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.002712 31644 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.003301 31644 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.005358 31644 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.009425 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.011270 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.011847 31393 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:11.011885 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.012713 31613 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:11.012916 31434 leader_election.cc:343] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.013070 31613 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.013419 31613 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.016057 31585 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.016530 31585 ts_tablet_manager.cc:1403] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.006s
I20260709 12:23:11.019387 31591 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.021251 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.022297 31585 raft_consensus.cc:359] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.022977 31585 raft_consensus.cc:385] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.023299 31585 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.023840 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.023938 31585 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.025751 31585 ts_tablet_manager.cc:1434] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
W20260709 12:23:11.025732 31359 leader_election.cc:343] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.027431 31644 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.027814 31644 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.028133 31644 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.032737 31585 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.035099 31644 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.027421 31613 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.039075 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:11.039310 31586 tablet_bootstrap.cc:492] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:11.039450 31585 tablet_bootstrap.cc:654] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.039835 31586 ts_tablet_manager.cc:1403] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.067s	user 0.029s	sys 0.032s
I20260709 12:23:11.039845 31470 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:11.041915 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:11.042361 31586 raft_consensus.cc:359] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.042753 31391 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 1: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:11.043500 31644 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.044086 31586 raft_consensus.cc:385] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.044405 31586 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.044965 31613 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.045432 31586 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.045919 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.047067 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.047538 31584 tablet_bootstrap.cc:492] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:11.047552 31586 ts_tablet_manager.cc:1434] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260709 12:23:11.047621 31359 leader_election.cc:343] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.048126 31584 ts_tablet_manager.cc:1403] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.003s
I20260709 12:23:11.048228 31359 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:11.048921 31434 leader_election.cc:343] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.049163 31640 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.049355 31434 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.050441 31644 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.050791 31584 raft_consensus.cc:359] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.051429 31584 raft_consensus.cc:385] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.051669 31586 tablet_bootstrap.cc:492] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:11.051697 31584 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.052723 31584 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.057925 31586 tablet_bootstrap.cc:654] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.054668 31584 ts_tablet_manager.cc:1434] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:11.064973 31585 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.065737 31585 ts_tablet_manager.cc:1403] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.008s
I20260709 12:23:11.068241 31585 raft_consensus.cc:359] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.070627 31584 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:11.072263 31586 tablet_bootstrap.cc:492] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:11.072114 31639 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.074262 31715 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.068856 31585 raft_consensus.cc:385] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.074879 31585 raft_consensus.cc:740] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.076161 31585 consensus_queue.cc:260] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.077313 31584 tablet_bootstrap.cc:654] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.077250 31591 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.078075 31586 ts_tablet_manager.cc:1403] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.000s
I20260709 12:23:11.077836 31591 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.079998 31591 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.081923 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.082090 31586 raft_consensus.cc:359] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.082515 31470 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.082657 31585 ts_tablet_manager.cc:1434] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:23:11.083879 31585 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.087250 31715 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.087482 31361 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.090554 31613 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.090901 31613 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.091214 31613 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.082685 31586 raft_consensus.cc:385] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.094717 31586 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.095357 31586 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.100765 31585 tablet_bootstrap.cc:654] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.101522 31590 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.101977 31590 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.104220 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.104837 31541 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.104362 31590 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.107547 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.107888 31584 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:11.108359 31584 ts_tablet_manager.cc:1403] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.018s
I20260709 12:23:11.108633 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:11.109802 31434 leader_election.cc:343] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.110718 31584 raft_consensus.cc:359] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.111244 31584 raft_consensus.cc:385] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.111528 31584 raft_consensus.cc:740] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
W20260709 12:23:11.111636 31433 leader_election.cc:343] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.112089 31433 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.112421 31584 consensus_queue.cc:260] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.113149 31586 ts_tablet_manager.cc:1434] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:23:11.113662 31644 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.116235 31584 ts_tablet_manager.cc:1434] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:11.117470 31584 tablet_bootstrap.cc:492] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:11.120733 31591 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.121165 31591 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.114104 31586 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:11.122982 31584 tablet_bootstrap.cc:654] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.128235 31586 tablet_bootstrap.cc:654] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.134078 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.134699 31470 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.135493 31644 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.135931 31644 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.137941 31644 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.138612 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.139206 31541 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.139986 31715 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.140520 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:11.142148 31434 leader_election.cc:343] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.142738 31644 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.144553 31361 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.123003 31591 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.148612 31640 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.149121 31640 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.149544 31640 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.156527 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.157297 31391 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:11.110370 31613 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.160360 31584 tablet_bootstrap.cc:492] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:11.160916 31584 ts_tablet_manager.cc:1403] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.012s
I20260709 12:23:11.163880 31591 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.164443 31591 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.167181 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.167941 31468 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.169597 31361 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.174543 31715 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.175012 31715 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.176028 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.177045 31715 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.177106 31639 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.177610 31639 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.177963 31639 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.178092 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.178697 31468 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:11.179858 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:11.180622 31715 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.180955 31715 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.181282 31715 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.182480 31590 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.182979 31590 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.176031 31591 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.187192 31591 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.187563 31591 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.187417 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.188006 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.188657 31391 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
W20260709 12:23:11.189342 31434 leader_election.cc:343] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.189998 31590 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.189865 31639 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.190449 31715 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.190737 31640 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.188150 31591 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.193847 31584 raft_consensus.cc:359] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.194358 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:11.194674 31584 raft_consensus.cc:385] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.194941 31468 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.195050 31584 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.196492 31584 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.192840 31640 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.199443 31640 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.200201 31613 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.200129 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:11.200769 31469 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.202852 31644 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.206007 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.207310 31639 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.207619 31469 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:11.206929 31591 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:11.208379 31434 leader_election.cc:343] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.208709 31361 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.209786 31613 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.210282 31613 raft_consensus.cc:697] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:11.199839 31640 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.212591 31613 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.215195 31585 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.215696 31585 ts_tablet_manager.cc:1403] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.132s	user 0.041s	sys 0.015s
I20260709 12:23:11.215873 31591 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.216182 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:11.216790 31391 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.219553 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:11.220175 31469 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.220396 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.220453 31584 ts_tablet_manager.cc:1434] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 12:23:11.221148 31467 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.221254 31585 raft_consensus.cc:359] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.221969 31585 raft_consensus.cc:385] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.222188 31584 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:11.222261 31361 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.222235 31585 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.226105 31468 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:11.226037 31585 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.219014 31640 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.227218 31361 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.228631 31640 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.229283 31640 raft_consensus.cc:697] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:11.230146 31640 consensus_queue.cc:237] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.231182 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.232580 31585 ts_tablet_manager.cc:1434] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:23:11.232686 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:11.233361 31393 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.233760 31585 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.236853 31584 tablet_bootstrap.cc:654] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.240644 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.241463 31541 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.244341 31644 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.245469 31585 tablet_bootstrap.cc:654] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.245697 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.245929 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.246304 31541 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.246567 31544 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.257682 31393 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:11.268707 31544 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:11.281737 31716 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.282392 31716 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.284723 31716 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.286137 31541 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:11.289551 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.290469 31544 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:23:11.290642 31433 leader_election.cc:343] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.291109 31433 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.292155 31710 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.293234 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.294276 31710 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.294752 31710 raft_consensus.cc:697] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:11.295588 31710 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.305644 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.306423 31470 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:11.307904 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.308465 31541 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.309377 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.310227 31393 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:11.310819 31715 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.311506 31585 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.311975 31585 ts_tablet_manager.cc:1403] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.010s
I20260709 12:23:11.312606 31507 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:11.313458 31391 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:11.313954 31591 raft_consensus.cc:2764] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:11.314519 31585 raft_consensus.cc:359] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.314612 31507 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:11.315177 31585 raft_consensus.cc:385] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.315472 31585 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.315559 31716 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.319800 31584 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:11.320226 31584 ts_tablet_manager.cc:1403] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.003s
I20260709 12:23:11.322624 31584 raft_consensus.cc:359] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.318059 31585 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.325400 31584 raft_consensus.cc:385] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.325712 31584 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.326545 31716 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.326947 31585 ts_tablet_manager.cc:1434] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:23:11.327559 31716 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.327852 31585 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.329584 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:11.330382 31470 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.331398 31584 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.334518 31584 ts_tablet_manager.cc:1434] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:23:11.335489 31584 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:11.335373 31716 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:11.336539 31716 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.342048 31585 tablet_bootstrap.cc:654] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.345002 31290 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.346267 31710 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.346791 31710 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.350220 31469 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:11.350410 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.350782 31584 tablet_bootstrap.cc:654] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.350860 31710 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.360687 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.375816 31395 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:11.368280 31774 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.376901 31774 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.378048 31361 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.379247 31591 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.379823 31591 raft_consensus.cc:697] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:11.380860 31591 consensus_queue.cc:237] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.382143 31544 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:11.384465 31434 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:11.384670 31771 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.370190 31715 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.385351 31771 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.386132 31590 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.386507 31774 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.386564 31590 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.387724 31590 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.392593 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.395601 31771 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.396167 31590 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.397281 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.398206 31467 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:11.399684 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:11.399896 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:11.402086 31507 leader_election.cc:343] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.403868 31590 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.403748 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.404963 31395 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:11.405047 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.405810 31544 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.406327 31585 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.406921 31585 ts_tablet_manager.cc:1403] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.022s
I20260709 12:23:11.410470 31590 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.410840 31590 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.412328 31468 raft_consensus.cc:2393] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:11.415660 31585 raft_consensus.cc:359] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.416388 31585 raft_consensus.cc:385] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.416680 31584 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:11.416666 31585 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.417282 31584 ts_tablet_manager.cc:1403] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.006s
I20260709 12:23:11.417511 31590 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.412537 31507 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:11.418499 31771 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.419036 31771 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.419656 31771 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.421566 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:11.422889 31434 leader_election.cc:343] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.423910 31585 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.426342 31585 ts_tablet_manager.cc:1434] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:23:11.427340 31585 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.430598 31544 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:11.431070 31774 raft_consensus.cc:2764] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:11.431407 31541 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:11.373208 31586 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:11.433075 31586 ts_tablet_manager.cc:1403] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.319s	user 0.013s	sys 0.004s
I20260709 12:23:11.434304 31585 tablet_bootstrap.cc:654] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.437806 31470 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:11.438755 31467 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.439073 31586 raft_consensus.cc:359] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.439965 31586 raft_consensus.cc:385] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.440233 31586 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.468920 31645 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.473069 31395 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.474009 31644 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.420389 31584 raft_consensus.cc:359] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.478072 31584 raft_consensus.cc:385] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.478412 31584 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.479924 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:11.480511 31393 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.481796 31716 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.483352 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.491039 31645 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.491859 31645 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:11.494748 31433 leader_election.cc:343] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.495455 31433 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.495038 31645 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.496493 31590 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.498924 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.502085 31434 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:11.502971 31393 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:11.479038 31584 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.504478 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.504601 31590 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.505242 31590 raft_consensus.cc:697] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:23:11.506067 31434 leader_election.cc:343] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.506531 31590 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.518435 31585 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.518996 31585 ts_tablet_manager.cc:1403] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.017s
I20260709 12:23:11.522027 31585 raft_consensus.cc:359] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.522714 31585 raft_consensus.cc:385] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:11.518214 31433 leader_election.cc:343] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.523432 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.524431 31590 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.527253 31584 ts_tablet_manager.cc:1434] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.000s
I20260709 12:23:11.527724 31645 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.528301 31584 tablet_bootstrap.cc:492] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:11.528178 31645 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.531121 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:11.532456 31434 leader_election.cc:343] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.533005 31645 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.522995 31585 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.535091 31585 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.440819 31586 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.537184 31585 ts_tablet_manager.cc:1434] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:23:11.538053 31585 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.540455 31290 catalog_manager.cc:5697] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.544739 31586 ts_tablet_manager.cc:1434] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.000s
I20260709 12:23:11.545691 31585 tablet_bootstrap.cc:654] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.545948 31586 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:11.549320 31771 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.542977 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.554366 31771 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:11.554677 31433 leader_election.cc:343] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.554844 31771 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.555392 31433 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.555440 31771 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.557017 31645 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.558166 31771 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.563671 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:11.565701 31507 leader_election.cc:343] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.566812 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.567860 31390 raft_consensus.cc:2393] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:11.568701 31584 tablet_bootstrap.cc:654] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.575153 31586 tablet_bootstrap.cc:654] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.575810 31771 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.576272 31771 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.578233 31771 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.578634 31292 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.581638 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.596487 31289 catalog_manager.cc:5697] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:11.596065 31781 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:23:11.604022 31584 tablet_bootstrap.cc:492] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:11.598834 31289 catalog_manager.cc:5697] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.604720 31584 ts_tablet_manager.cc:1403] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.001s
W20260709 12:23:11.607690 31507 leader_election.cc:343] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.606781 31289 catalog_manager.cc:5697] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.614068 31586 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:11.616961 31586 ts_tablet_manager.cc:1403] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.012s
I20260709 12:23:11.627599 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.628324 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:11.628947 31469 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.628348 31468 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:11.634282 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:11.635329 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.636389 31716 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.637459 31716 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.637809 31716 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.639482 31586 raft_consensus.cc:359] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.644348 31586 raft_consensus.cc:385] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.644645 31586 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.645289 31586 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.647585 31586 ts_tablet_manager.cc:1434] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:23:11.647908 31510 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:11.648499 31586 tablet_bootstrap.cc:492] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:11.649380 31785 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.650466 31716 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.642827 31584 raft_consensus.cc:359] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.653630 31584 raft_consensus.cc:385] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.653517 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:11.653960 31584 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.655081 31586 tablet_bootstrap.cc:654] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:11.655120 31507 leader_election.cc:343] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.643644 31469 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:11.654642 31584 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.657305 31584 ts_tablet_manager.cc:1434] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 12:23:11.658198 31584 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:11.640014 31585 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.659783 31585 ts_tablet_manager.cc:1403] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.122s	user 0.032s	sys 0.047s
I20260709 12:23:11.664629 31585 raft_consensus.cc:359] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.665284 31585 raft_consensus.cc:385] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.665580 31585 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.666360 31585 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.665297 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:11.660182 31586 tablet_bootstrap.cc:492] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:11.667436 31586 ts_tablet_manager.cc:1403] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.001s
I20260709 12:23:11.669098 31774 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.672168 31716 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.669615 31774 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:11.674531 31585 ts_tablet_manager.cc:1434] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:11.675647 31785 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.679555 31584 tablet_bootstrap.cc:654] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.679790 31585 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.674952 31774 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.687366 31585 tablet_bootstrap.cc:654] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.690424 31640 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.677115 31586 raft_consensus.cc:359] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.676827 31591 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.677033 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:11.701640 31469 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.702617 31585 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.703166 31585 ts_tablet_manager.cc:1403] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 12:23:11.703683 31584 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:11.704097 31584 ts_tablet_manager.cc:1403] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.015s
I20260709 12:23:11.705787 31585 raft_consensus.cc:359] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.706487 31585 raft_consensus.cc:385] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.706821 31585 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.706540 31584 raft_consensus.cc:359] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.707307 31584 raft_consensus.cc:385] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.707149 31764 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.707662 31585 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.707861 31764 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.708611 31645 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.709108 31645 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.710294 31585 ts_tablet_manager.cc:1434] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:11.711202 31585 tablet_bootstrap.cc:492] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.711112 31645 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.707667 31584 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.712468 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.713044 31584 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:11.713829 31434 leader_election.cc:343] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.715149 31584 ts_tablet_manager.cc:1434] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:11.716231 31584 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:11.717068 31586 raft_consensus.cc:385] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.714769 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:11.718421 31764 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.717375 31586 raft_consensus.cc:740] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.721141 31586 consensus_queue.cc:260] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:11.721479 31433 leader_election.cc:343] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.721998 31433 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.729671 31645 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.729982 31586 ts_tablet_manager.cc:1434] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 12:23:11.730890 31586 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:11.730605 31764 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.735829 31469 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:11.735961 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.740707 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:11.741837 31785 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.741938 31764 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.742388 31785 raft_consensus.cc:697] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:11.743222 31785 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.743688 31645 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:23:11.754657 31289 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.760512 31710 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:11.765166 31591 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.765677 31591 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.767300 31591 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.778013 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.780956 31585 tablet_bootstrap.cc:654] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.797856 31289 catalog_manager.cc:5697] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.800146 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.812312 31591 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.812829 31591 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.818719 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.819419 31466 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
W20260709 12:23:11.823518 31359 leader_election.cc:343] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.835355 31591 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.842820 31586 tablet_bootstrap.cc:654] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.844745 31361 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.847535 31591 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.852710 31584 tablet_bootstrap.cc:654] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.854295 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.855926 31591 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.856467 31591 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.856855 31591 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:11.858403 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:11.860325 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.860934 31466 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:11.862439 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:11.862802 31764 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.863353 31640 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.863716 31640 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.864050 31640 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.869706 31785 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.871460 31640 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.873410 31640 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:11.883912 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.882061 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:11.909845 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:11.910471 31469 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:11.922015 31359 leader_election.cc:343] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:11.923022 31359 leader_election.cc:343] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.925500 31469 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:11.930761 31585 tablet_bootstrap.cc:492] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.931294 31585 ts_tablet_manager.cc:1403] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.220s	user 0.012s	sys 0.018s
I20260709 12:23:11.933607 31584 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:11.934062 31584 ts_tablet_manager.cc:1403] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.218s	user 0.009s	sys 0.003s
I20260709 12:23:11.934427 31585 raft_consensus.cc:359] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.935667 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:11.935114 31585 raft_consensus.cc:385] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.937119 31764 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.937249 31585 raft_consensus.cc:740] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.937598 31764 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:11.938601 31764 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.938827 31591 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.939404 31585 consensus_queue.cc:260] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.942696 31785 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.943115 31585 ts_tablet_manager.cc:1434] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:23:11.944136 31585 tablet_bootstrap.cc:492] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:11.946666 31586 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:11.947220 31586 ts_tablet_manager.cc:1403] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.217s	user 0.025s	sys 0.008s
I20260709 12:23:11.954126 31392 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.964469 31585 tablet_bootstrap.cc:654] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.967339 31586 raft_consensus.cc:359] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.968174 31586 raft_consensus.cc:385] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.968439 31586 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.969087 31586 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.971336 31586 ts_tablet_manager.cc:1434] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:23:11.950891 31584 raft_consensus.cc:359] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.972482 31584 raft_consensus.cc:385] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.972278 31586 tablet_bootstrap.cc:492] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:11.983671 31584 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.974004 31716 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.985684 31584 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.984803 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:11.991421 31539 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.977556 31585 tablet_bootstrap.cc:492] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:11.994707 31585 ts_tablet_manager.cc:1403] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.004s
I20260709 12:23:11.985517 31716 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:11.996785 31765 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.996824 31716 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:11.998363 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:11.999044 31467 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:12.000862 31586 tablet_bootstrap.cc:654] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.003660 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.002561 31539 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:12.002904 31510 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.004954 31774 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:12.005049 31507 leader_election.cc:343] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.005556 31774 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.006008 31774 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.012719 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:12.013850 31584 ts_tablet_manager.cc:1434] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260709 12:23:12.014562 31591 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.014789 31359 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.015089 31469 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.015782 31765 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.016355 31765 raft_consensus.cc:697] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:12.017652 31765 consensus_queue.cc:237] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.014851 31584 tablet_bootstrap.cc:492] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.022995 31645 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.003073 31585 raft_consensus.cc:359] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.024170 31585 raft_consensus.cc:385] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.024493 31585 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.026520 31585 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.026522 31584 tablet_bootstrap.cc:654] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.025466 31774 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.033320 31774 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.034029 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:12.037024 31586 tablet_bootstrap.cc:492] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
W20260709 12:23:12.040177 31507 leader_election.cc:343] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.037998 31585 ts_tablet_manager.cc:1434] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:23:12.040452 31586 ts_tablet_manager.cc:1403] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.005s
I20260709 12:23:12.044708 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:12.043622 31585 tablet_bootstrap.cc:492] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.045538 31466 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.048794 31586 raft_consensus.cc:359] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.056053 31586 raft_consensus.cc:385] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.056756 31586 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.058020 31586 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.060925 31586 ts_tablet_manager.cc:1434] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.004s
I20260709 12:23:12.061959 31586 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.054713 31585 tablet_bootstrap.cc:654] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.069207 31466 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:12.075322 31645 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.079417 31510 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:12.080924 31774 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.081648 31774 raft_consensus.cc:697] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:12.085282 31290 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.089859 31586 tablet_bootstrap.cc:654] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.078263 31469 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:12.102098 31584 tablet_bootstrap.cc:492] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:12.082881 31774 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.102689 31584 ts_tablet_manager.cc:1403] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.030s
I20260709 12:23:12.116150 31584 raft_consensus.cc:359] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.117321 31584 raft_consensus.cc:385] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.117614 31584 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.118307 31584 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.120299 31584 ts_tablet_manager.cc:1434] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:23:12.121173 31584 tablet_bootstrap.cc:492] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.126019 31584 tablet_bootstrap.cc:654] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.128834 31716 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.134446 31585 tablet_bootstrap.cc:492] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.134886 31585 ts_tablet_manager.cc:1403] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.011s
I20260709 12:23:12.136195 31392 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.137439 31585 raft_consensus.cc:359] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.138101 31585 raft_consensus.cc:385] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.138372 31585 raft_consensus.cc:740] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.139016 31585 consensus_queue.cc:260] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.141788 31585 ts_tablet_manager.cc:1434] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:12.142657 31585 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.157377 31645 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.158244 31586 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.158017 31645 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.158713 31586 ts_tablet_manager.cc:1403] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.003s
I20260709 12:23:12.160719 31645 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.161238 31586 raft_consensus.cc:359] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.161098 31292 catalog_manager.cc:5697] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.167725 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.167297 31586 raft_consensus.cc:385] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.163590 31585 tablet_bootstrap.cc:654] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.168414 31544 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
W20260709 12:23:12.170135 31507 consensus_peers.cc:597] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.168521 31586 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.171983 31586 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.173368 31434 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.174073 31586 ts_tablet_manager.cc:1434] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 12:23:12.174443 31590 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.174978 31590 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.175134 31586 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.175439 31590 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.182512 31586 tablet_bootstrap.cc:654] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.187747 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:12.189709 31433 leader_election.cc:343] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.191116 31585 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.191709 31585 ts_tablet_manager.cc:1403] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 12:23:12.194257 31585 raft_consensus.cc:359] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.194908 31585 raft_consensus.cc:385] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.195170 31585 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.195832 31585 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.196710 31290 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.198932 31586 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.199396 31586 ts_tablet_manager.cc:1403] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:23:12.206084 31585 ts_tablet_manager.cc:1434] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:23:12.210096 31585 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.215524 31585 tablet_bootstrap.cc:654] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.202378 31586 raft_consensus.cc:359] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.216558 31586 raft_consensus.cc:385] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.216820 31586 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.217420 31586 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.218894 31586 ts_tablet_manager.cc:1434] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.000s
I20260709 12:23:12.221903 31586 tablet_bootstrap.cc:492] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.227465 31586 tablet_bootstrap.cc:654] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.231839 31584 tablet_bootstrap.cc:492] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:12.232271 31584 ts_tablet_manager.cc:1403] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.111s	user 0.047s	sys 0.054s
I20260709 12:23:12.233878 31764 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.234333 31764 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.234719 31584 raft_consensus.cc:359] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.235360 31584 raft_consensus.cc:385] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.235622 31584 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.236382 31764 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.236224 31584 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.238667 31584 ts_tablet_manager.cc:1434] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:12.238695 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.239485 31539 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:12.240686 31359 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.241432 31591 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.241510 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.241858 31591 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.242143 31466 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:12.242208 31591 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.242902 31585 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.239671 31584 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.243517 31585 ts_tablet_manager.cc:1403] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.002s
I20260709 12:23:12.246960 31585 raft_consensus.cc:359] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.247844 31585 raft_consensus.cc:385] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.248170 31585 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.249456 31584 tablet_bootstrap.cc:654] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.248946 31585 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.251710 31591 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.263836 31585 ts_tablet_manager.cc:1434] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:23:12.283718 31585 tablet_bootstrap.cc:492] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.284085 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:12.285244 31539 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.292798 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:12.293692 31466 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.306931 31716 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.307521 31716 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.310410 31716 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.313663 31765 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.314185 31765 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.314953 31585 tablet_bootstrap.cc:654] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.316799 31765 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.320056 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.324509 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.328176 31585 tablet_bootstrap.cc:492] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.328801 31585 ts_tablet_manager.cc:1403] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.000s
I20260709 12:23:12.332178 31585 raft_consensus.cc:359] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.333074 31585 raft_consensus.cc:385] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.333407 31585 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.334179 31585 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.335813 31590 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.337016 31585 ts_tablet_manager.cc:1434] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:12.354126 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.355190 31467 raft_consensus.cc:2393] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:12.355625 31585 tablet_bootstrap.cc:492] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.339567 31716 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.356309 31716 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.358949 31716 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.342312 31764 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.362540 31764 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.367537 31764 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.352066 31591 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.352147 31785 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.369063 31590 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.371539 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.375880 31466 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:12.380954 31539 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:12.382450 31359 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.386958 31585 tablet_bootstrap.cc:654] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.387317 31586 tablet_bootstrap.cc:492] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.387763 31586 ts_tablet_manager.cc:1403] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.166s	user 0.041s	sys 0.109s
I20260709 12:23:12.384543 31764 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.389796 31764 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:12.390410 31586 raft_consensus.cc:359] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.390609 31764 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.391113 31586 raft_consensus.cc:385] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.391428 31586 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.392146 31586 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.394338 31586 ts_tablet_manager.cc:1434] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 12:23:12.394724 31510 leader_election.cc:343] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.359802 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.360977 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:12.395380 31586 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.395547 31584 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:12.396030 31584 ts_tablet_manager.cc:1403] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.157s	user 0.049s	sys 0.080s
I20260709 12:23:12.397575 31591 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.398726 31584 raft_consensus.cc:359] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.399638 31584 raft_consensus.cc:385] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.399922 31584 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.400539 31584 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.403987 31586 tablet_bootstrap.cc:654] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.406693 31584 ts_tablet_manager.cc:1434] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:23:12.407645 31584 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.414117 31584 tablet_bootstrap.cc:654] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.416043 31290 catalog_manager.cc:5697] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.417665 31586 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.418131 31586 ts_tablet_manager.cc:1403] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
W20260709 12:23:12.338985 31507 leader_election.cc:343] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:12.420037 31510 leader_election.cc:343] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.420672 31586 raft_consensus.cc:359] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.421334 31586 raft_consensus.cc:385] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.421597 31586 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.422201 31586 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.424129 31586 ts_tablet_manager.cc:1434] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:12.425400 31586 tablet_bootstrap.cc:492] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.425266 31510 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:12.426043 31584 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:12.427801 31584 ts_tablet_manager.cc:1403] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.011s
I20260709 12:23:12.429837 31584 raft_consensus.cc:359] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.431207 31584 raft_consensus.cc:385] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.431406 31586 tablet_bootstrap.cc:654] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.431550 31584 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
W20260709 12:23:12.432360 31359 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:12.433207 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 94277.4us
I20260709 12:23:12.433959 31716 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.434885 31584 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.437229 31584 ts_tablet_manager.cc:1434] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:23:12.438683 31584 tablet_bootstrap.cc:492] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.442281 31586 tablet_bootstrap.cc:492] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.442696 31586 ts_tablet_manager.cc:1403] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.011s
I20260709 12:23:12.442762 31716 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.443270 31716 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.438198 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:12.444406 31539 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.445268 31716 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.445246 31586 raft_consensus.cc:359] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.446672 31586 raft_consensus.cc:385] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.446979 31586 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.447813 31586 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.450470 31584 tablet_bootstrap.cc:654] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.450600 31586 ts_tablet_manager.cc:1434] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:12.451383 31539 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:12.451766 31586 tablet_bootstrap.cc:492] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.452153 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.454771 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.455535 31584 tablet_bootstrap.cc:492] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:12.465790 31584 ts_tablet_manager.cc:1403] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.007s
I20260709 12:23:12.455724 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:12.455994 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.458017 31716 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.461222 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.461730 31785 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.468675 31785 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.471421 31785 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.472740 31584 raft_consensus.cc:359] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.473232 31584 raft_consensus.cc:385] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.473470 31584 raft_consensus.cc:740] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.474069 31584 consensus_queue.cc:260] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:12.478252 31433 leader_election.cc:343] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:12.479133 31507 leader_election.cc:343] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.479611 31507 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:12.480060 31585 tablet_bootstrap.cc:492] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.480383 31584 ts_tablet_manager.cc:1434] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:12.480512 31585 ts_tablet_manager.cc:1403] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.017s
I20260709 12:23:12.481295 31584 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.482266 31586 tablet_bootstrap.cc:654] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.483573 31785 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.484393 31764 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.486078 31591 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.486102 31585 raft_consensus.cc:359] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.487141 31585 raft_consensus.cc:385] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.487505 31585 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.490197 31585 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.492601 31585 ts_tablet_manager.cc:1434] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:23:12.494041 31585 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.497187 31586 tablet_bootstrap.cc:492] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.497686 31586 ts_tablet_manager.cc:1403] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.008s
I20260709 12:23:12.498168 31361 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:12.499265 31764 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:12.500892 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:12.501184 31507 leader_election.cc:343] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.501349 31585 tablet_bootstrap.cc:654] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.501528 31466 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:12.502274 31434 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:12.503057 31645 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.503530 31645 raft_consensus.cc:697] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:12.504366 31645 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.506063 31510 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:12.506867 31774 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.507210 31774 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.503531 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.507620 31774 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.507973 31469 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:12.512013 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.512629 31392 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:12.514138 31507 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.514933 31716 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.515398 31716 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.515810 31716 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.516387 31710 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.516626 31774 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.516881 31710 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.517460 31584 tablet_bootstrap.cc:654] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.521136 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:12.521695 31470 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.520663 31710 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.523823 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:12.525379 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.529652 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:12.526954 31433 leader_election.cc:343] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.530727 31539 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:12.531649 31710 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.531929 31785 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.532248 31710 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.534512 31434 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:12.534889 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.535773 31590 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.535781 31390 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:12.536249 31590 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.536708 31590 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.537093 31433 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:12.538054 31644 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.538394 31644 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.538712 31644 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.546597 31644 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.548635 31774 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.548166 31710 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.550313 31470 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:12.553589 31510 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.546380 31590 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.502389 31586 raft_consensus.cc:359] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.555218 31586 raft_consensus.cc:385] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.555570 31586 raft_consensus.cc:740] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.556283 31586 consensus_queue.cc:260] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.557322 31392 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.562278 31590 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.564658 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:12.565977 31585 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.565740 31716 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:12.566056 31433 leader_election.cc:343] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.566490 31585 ts_tablet_manager.cc:1403] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.002s
I20260709 12:23:12.568516 31392 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:12.569604 31585 raft_consensus.cc:359] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.570519 31585 raft_consensus.cc:385] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.570859 31585 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.576557 31644 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.580336 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:12.581179 31764 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.593225 31392 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.585451 31716 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.587086 31844 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:23:12.585574 31586 ts_tablet_manager.cc:1434] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 12:23:12.602808 31586 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.606244 31841 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.614462 31765 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.615041 31765 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.584815 31585 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.617344 31765 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.617974 31585 ts_tablet_manager.cc:1434] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:23:12.618831 31585 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.619956 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.620190 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.588860 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:12.622715 31470 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.624285 31585 tablet_bootstrap.cc:654] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.589951 31842 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.626022 31842 raft_consensus.cc:697] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:12.633188 31470 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:12.635180 31510 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.635851 31586 tablet_bootstrap.cc:654] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.636245 31843 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.636868 31843 raft_consensus.cc:697] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:23:12.623400 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 71293.9us
I20260709 12:23:12.643209 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:12.644537 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:12.644830 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:12.643821 31390 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.645357 31541 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.647140 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.606825 31841 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.626850 31842 consensus_queue.cc:237] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.653087 31359 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:12.637899 31843 consensus_queue.cc:237] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:12.655712 31434 leader_election.cc:343] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.657387 31764 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.659905 31585 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.660331 31585 ts_tablet_manager.cc:1403] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.007s
I20260709 12:23:12.660833 31390 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:12.662832 31585 raft_consensus.cc:359] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.664812 31585 raft_consensus.cc:385] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.665078 31585 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.665701 31585 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.669951 31585 ts_tablet_manager.cc:1434] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:23:12.670765 31585 tablet_bootstrap.cc:492] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.653654 31841 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.673662 31541 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:12.677286 31585 tablet_bootstrap.cc:654] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.677237 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:12.680177 31434 leader_election.cc:343] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.681093 31586 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.681238 31434 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:12.681556 31586 ts_tablet_manager.cc:1403] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.003s
W20260709 12:23:12.682269 31434 leader_election.cc:343] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.682438 31765 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.683374 31644 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.684680 31586 raft_consensus.cc:359] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.685384 31586 raft_consensus.cc:385] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.685667 31586 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
W20260709 12:23:12.685797 31845 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
I20260709 12:23:12.686192 31644 raft_consensus.cc:697] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:12.686326 31586 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.689548 31586 ts_tablet_manager.cc:1434] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:12.682278 31292 catalog_manager.cc:5697] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.694749 31644 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.707751 31585 tablet_bootstrap.cc:492] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.709903 31585 ts_tablet_manager.cc:1403] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.009s
I20260709 12:23:12.713853 31585 raft_consensus.cc:359] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.714602 31585 raft_consensus.cc:385] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.714845 31585 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.715802 31584 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:12.715526 31585 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.716236 31584 ts_tablet_manager.cc:1403] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.235s	user 0.035s	sys 0.058s
I20260709 12:23:12.717404 31585 ts_tablet_manager.cc:1434] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:23:12.718943 31584 raft_consensus.cc:359] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.719705 31584 raft_consensus.cc:385] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.720009 31584 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.720258 31586 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.722146 31585 tablet_bootstrap.cc:492] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.720749 31584 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.724994 31584 ts_tablet_manager.cc:1434] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:12.725960 31584 tablet_bootstrap.cc:492] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.726377 31586 tablet_bootstrap.cc:654] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.731339 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.733521 31289 catalog_manager.cc:5697] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.734372 31585 tablet_bootstrap.cc:654] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.731746 31584 tablet_bootstrap.cc:654] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.735659 31392 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:12.738787 31433 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:12.740275 31645 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.740765 31645 raft_consensus.cc:697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:12.741636 31645 consensus_queue.cc:237] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.748956 31586 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.749420 31586 ts_tablet_manager.cc:1403] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.005s
W20260709 12:23:12.752182 31433 leader_election.cc:343] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.752626 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:12.753204 31585 tablet_bootstrap.cc:492] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.753666 31585 ts_tablet_manager.cc:1403] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.005s
I20260709 12:23:12.754076 31590 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.756279 31585 raft_consensus.cc:359] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.756949 31585 raft_consensus.cc:385] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.757200 31585 raft_consensus.cc:740] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.757836 31585 consensus_queue.cc:260] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.760001 31585 ts_tablet_manager.cc:1434] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:12.760804 31585 tablet_bootstrap.cc:492] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.761157 31289 catalog_manager.cc:5697] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.764050 31640 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.764974 31640 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.766366 31585 tablet_bootstrap.cc:654] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.769114 31586 raft_consensus.cc:359] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.769817 31586 raft_consensus.cc:385] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.770058 31586 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.771072 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.772385 31466 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:12.773954 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:12.774893 31764 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:12.775502 31764 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.775920 31764 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.778482 31586 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.779706 31844 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.779855 31584 tablet_bootstrap.cc:492] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:12.780280 31584 ts_tablet_manager.cc:1403] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.016s
I20260709 12:23:12.780521 31586 ts_tablet_manager.cc:1434] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:23:12.780144 31844 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.781373 31586 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:12.782341 31844 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.782862 31584 raft_consensus.cc:359] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.783546 31584 raft_consensus.cc:385] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.783812 31584 raft_consensus.cc:740] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.784124 31640 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.784471 31584 consensus_queue.cc:260] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.785830 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.786453 31541 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:12.786685 31584 ts_tablet_manager.cc:1434] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:12.787627 31584 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.788574 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:12.791371 31510 leader_election.cc:343] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.794392 31390 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.799831 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.801529 31585 tablet_bootstrap.cc:492] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:12.802134 31585 ts_tablet_manager.cc:1403] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.001s
I20260709 12:23:12.807704 31585 raft_consensus.cc:359] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.808563 31585 raft_consensus.cc:385] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.808892 31585 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.810127 31585 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:12.808983 31507 leader_election.cc:343] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.816030 31507 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:12.820147 31640 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.825467 31584 tablet_bootstrap.cc:654] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.828348 31842 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.832423 31842 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.832859 31842 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.836819 31585 ts_tablet_manager.cc:1434] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 12:23:12.842504 31585 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:12.844262 31710 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.844691 31710 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.843427 31764 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.846578 31710 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.837755 31640 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.847441 31640 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.848143 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.848910 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:12.849391 31640 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.849459 31467 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.850556 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.850735 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.851298 31540 raft_consensus.cc:2393] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:12.851346 31469 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
W20260709 12:23:12.849412 31433 leader_election.cc:343] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.852655 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.853240 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.855356 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:12.840489 31842 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.859416 31541 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:12.862311 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:12.862757 31640 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.863885 31510 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:12.866856 31764 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.867759 31586 tablet_bootstrap.cc:654] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.873027 31842 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.870093 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:12.873914 31540 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.873384 31842 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.875144 31434 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:12.875784 31842 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.876574 31645 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.877063 31645 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.877501 31645 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:12.881008 31507 leader_election.cc:343] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.873394 31290 catalog_manager.cc:5697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.883107 31290 catalog_manager.cc:5697] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.885492 31467 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:12.889390 31645 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.889671 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:12.890522 31764 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:12.891191 31764 raft_consensus.cc:697] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:12.892257 31645 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.892650 31764 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.893093 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:12.899863 31765 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.901623 31540 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:12.909008 31765 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.909485 31765 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.894023 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:12.921658 31765 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.923789 31585 tablet_bootstrap.cc:654] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.926182 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.926968 31466 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:12.916420 31640 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:12.930471 31433 leader_election.cc:343] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.931519 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:12.933717 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:12.934340 31544 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:12.935937 31584 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:12.936354 31584 ts_tablet_manager.cc:1403] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.149s	user 0.013s	sys 0.003s
I20260709 12:23:12.951743 31290 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 2, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.947216 31591 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.958452 31584 raft_consensus.cc:359] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.959079 31591 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.959161 31584 raft_consensus.cc:385] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.960018 31584 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.959503 31591 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.961262 31584 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.964532 31584 ts_tablet_manager.cc:1434] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:23:12.966868 31539 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.968130 31584 tablet_bootstrap.cc:492] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:12.955350 31765 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.971958 31765 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.974946 31591 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.976647 31842 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.977828 31765 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.978989 31586 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:12.979440 31586 ts_tablet_manager.cc:1403] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.198s	user 0.020s	sys 0.005s
I20260709 12:23:12.981262 31591 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:12.982121 31541 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:12.993904 31774 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.994396 31774 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:12.996351 31774 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:12.996645 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:12.998735 31644 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.003872 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:13.004536 31467 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:13.005514 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:13.006105 31544 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.008471 31510 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:13.009234 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:13.010258 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.011129 31844 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.015188 31544 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:13.019117 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:13.020539 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:13.022104 31844 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.026965 31844 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.024492 31359 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:13.024492 31507 leader_election.cc:343] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.028766 31591 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.029204 31591 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:23:13.032101 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:23:13.035117 31507 leader_election.cc:343] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.037798 31434 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:13.034965 31591 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.029568 31467 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.052223 31645 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.050669 31540 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:13.048990 31842 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.066623 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:13.067502 31466 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:13.068638 31586 raft_consensus.cc:359] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.069960 31586 raft_consensus.cc:385] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.072530 31359 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:13.070230 31586 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.077469 31510 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:13.079784 31584 tablet_bootstrap.cc:654] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.080356 31868 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.081306 31586 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.083431 31586 ts_tablet_manager.cc:1434] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.001s
I20260709 12:23:13.084354 31586 tablet_bootstrap.cc:492] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:13.085853 31842 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.087718 31585 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:13.088210 31585 ts_tablet_manager.cc:1403] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.246s	user 0.015s	sys 0.014s
I20260709 12:23:13.093008 31844 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.101256 31868 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.101429 31844 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.101593 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:13.102842 31507 leader_election.cc:343] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.095099 31644 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:13.105757 31846 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.106117 31585 raft_consensus.cc:359] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.106805 31585 raft_consensus.cc:385] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.107438 31585 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.108242 31585 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.109460 31292 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.110476 31640 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.110713 31585 ts_tablet_manager.cc:1434] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 12:23:13.111128 31640 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.114769 31585 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:13.118156 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:13.118736 31465 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.147491 31640 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.149483 31843 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.149995 31843 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.155730 31843 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.159078 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:13.143407 31467 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:13.163292 31540 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:13.168308 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.169322 31395 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:13.172461 31585 tablet_bootstrap.cc:654] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.178442 31644 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.179749 31584 tablet_bootstrap.cc:492] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:13.180383 31584 ts_tablet_manager.cc:1403] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.212s	user 0.018s	sys 0.014s
I20260709 12:23:13.180362 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:13.188782 31584 raft_consensus.cc:359] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.189615 31584 raft_consensus.cc:385] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.189904 31584 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.191074 31584 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.196058 31510 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:13.196774 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:13.197839 31469 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:13.197883 31846 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.206144 31584 ts_tablet_manager.cc:1434] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 12:23:13.207518 31584 tablet_bootstrap.cc:492] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:13.219152 31846 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.224216 31361 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:13.225873 31640 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.231644 31644 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.231966 31645 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.239202 31774 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:13.239705 31774 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.243208 31716 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.244807 31640 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.250102 31586 tablet_bootstrap.cc:654] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.233294 31844 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:23:13.264663 31584 tablet_bootstrap.cc:654] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.272187 31846 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.281728 31846 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.289991 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.291074 31774 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.291965 31710 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:13.293915 31507 leader_election.cc:343] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.297333 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.298698 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:13.299458 31846 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.300805 31465 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:13.308281 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:13.308480 31842 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.308254 31510 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:13.319506 31469 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:13.333621 31846 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:13.333900 31510 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:13.335220 31842 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.335856 31842 raft_consensus.cc:697] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:13.336980 31842 consensus_queue.cc:237] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.380820 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:13.382128 31774 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.382524 31774 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.384941 31774 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.385705 31644 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.386349 31644 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.394809 31586 tablet_bootstrap.cc:492] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:13.395462 31586 ts_tablet_manager.cc:1403] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.311s	user 0.012s	sys 0.005s
I20260709 12:23:13.389853 31644 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.415567 31586 raft_consensus.cc:359] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.416477 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:13.417531 31586 raft_consensus.cc:385] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.417881 31586 raft_consensus.cc:740] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.418571 31586 consensus_queue.cc:260] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:13.419150 31434 leader_election.cc:343] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.426335 31585 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:13.426903 31585 ts_tablet_manager.cc:1403] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.312s	user 0.021s	sys 0.006s
I20260709 12:23:13.428143 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.437196 31585 raft_consensus.cc:359] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.440228 31585 raft_consensus.cc:385] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.440589 31585 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.442745 31585 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.442448 31586 ts_tablet_manager.cc:1434] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:23:13.445127 31586 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:13.447461 31584 tablet_bootstrap.cc:492] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:13.447894 31584 ts_tablet_manager.cc:1403] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.241s	user 0.013s	sys 0.004s
I20260709 12:23:13.454763 31540 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:23:13.444875 31433 leader_election.cc:343] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.457314 31433 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:13.458463 31710 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.462579 31584 raft_consensus.cc:359] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.463264 31584 raft_consensus.cc:385] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.463496 31584 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.464056 31584 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.465701 31584 ts_tablet_manager.cc:1434] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:23:13.466514 31584 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
W20260709 12:23:13.473894 31878 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:23:13.477840 31591 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.492445 31468 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:13.492657 31591 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.500195 31585 ts_tablet_manager.cc:1434] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 12:23:13.501118 31585 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:13.519172 31290 catalog_manager.cc:5697] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.516166 31868 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:23:13.539181 31584 tablet_bootstrap.cc:654] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.546348 31774 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.549048 31774 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.553421 31842 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.557713 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:13.558533 31586 tablet_bootstrap.cc:654] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.563454 31842 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.566087 31465 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.574005 31465 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:13.575917 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:13.563212 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:13.578106 31843 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.578157 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.578655 31843 raft_consensus.cc:697] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:23:13.579442 31507 leader_election.cc:343] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.579690 31842 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.579909 31710 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:13.580363 31507 leader_election.cc:343] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.580960 31710 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.581866 31843 consensus_queue.cc:237] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.583624 31710 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.586591 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:13.587759 31510 leader_election.cc:343] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.588274 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.588475 31510 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:13.597414 31585 tablet_bootstrap.cc:654] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:13.596117 31433 leader_election.cc:343] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.600996 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:13.602171 31434 leader_election.cc:343] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.596517 31842 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.602547 31434 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:13.603164 31888 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.612918 31584 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:13.614158 31584 ts_tablet_manager.cc:1403] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.010s
I20260709 12:23:13.616771 31584 raft_consensus.cc:359] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.617570 31584 raft_consensus.cc:385] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.617905 31584 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.618638 31584 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.620784 31584 ts_tablet_manager.cc:1434] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:13.622345 31584 tablet_bootstrap.cc:492] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:13.616479 31290 catalog_manager.cc:5697] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.623067 31710 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.623571 31710 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.623121 31867 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:23:13.631529 31585 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:13.631587 31842 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.632032 31585 ts_tablet_manager.cc:1403] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.131s	user 0.020s	sys 0.002s
I20260709 12:23:13.632169 31842 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.634075 31586 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:13.654539 31584 tablet_bootstrap.cc:654] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.635124 31710 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.662626 31586 ts_tablet_manager.cc:1403] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.218s	user 0.009s	sys 0.007s
I20260709 12:23:13.634241 31842 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.635052 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.665235 31586 raft_consensus.cc:359] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.666102 31586 raft_consensus.cc:385] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.666396 31586 raft_consensus.cc:740] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
W20260709 12:23:13.666739 31433 leader_election.cc:343] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.646418 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:13.651750 31764 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.668308 31541 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:13.669639 31434 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:13.668313 31764 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.635273 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.672266 31584 tablet_bootstrap.cc:492] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:13.672689 31584 ts_tablet_manager.cc:1403] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.004s
W20260709 12:23:13.673174 31507 leader_election.cc:343] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.673520 31764 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.674875 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:13.675163 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:13.675938 31465 raft_consensus.cc:2393] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:13.635632 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:13.676618 31586 consensus_queue.cc:260] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:13.677276 31510 leader_election.cc:343] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.677732 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:13.678522 31586 ts_tablet_manager.cc:1434] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.006s
I20260709 12:23:13.679220 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:13.679909 31867 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.680160 31586 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:13.680265 31842 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.683406 31710 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.683820 31710 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.684165 31710 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.676177 31584 raft_consensus.cc:359] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.686201 31584 raft_consensus.cc:385] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.686488 31584 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.687430 31867 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.678606 31585 raft_consensus.cc:359] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.688652 31584 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.691897 31586 tablet_bootstrap.cc:654] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.693683 31585 raft_consensus.cc:385] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.694067 31585 raft_consensus.cc:740] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.696560 31585 consensus_queue.cc:260] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.700296 31585 ts_tablet_manager.cc:1434] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 12:23:13.701092 31584 ts_tablet_manager.cc:1434] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:23:13.701514 31710 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.703253 31585 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:13.703482 31584 tablet_bootstrap.cc:492] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:13.704332 31710 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.705032 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:13.705032 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:13.705729 31540 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:13.706589 31433 leader_election.cc:343] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.712764 31540 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:13.713907 31434 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:13.715178 31888 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.715651 31888 raft_consensus.cc:697] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:13.716419 31888 consensus_queue.cc:237] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.718111 31585 tablet_bootstrap.cc:654] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.726706 31644 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.727422 31644 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.729388 31584 tablet_bootstrap.cc:654] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.729655 31644 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.730877 31586 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:13.731097 31585 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:13.731351 31586 ts_tablet_manager.cc:1403] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.023s
I20260709 12:23:13.731582 31585 ts_tablet_manager.cc:1403] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 12:23:13.775611 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:13.777590 31541 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:13.779748 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.781493 31434 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:13.782634 31433 leader_election.cc:343] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.734066 31586 raft_consensus.cc:359] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.791838 31586 raft_consensus.cc:385] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.792307 31586 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.793584 31586 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.799045 31774 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.803944 31585 raft_consensus.cc:359] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.805029 31585 raft_consensus.cc:385] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.805361 31585 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.806326 31585 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.815701 31841 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.816319 31841 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.816815 31841 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.818408 31774 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.823808 31584 tablet_bootstrap.cc:492] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:13.824803 31584 ts_tablet_manager.cc:1403] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.000s
I20260709 12:23:13.839433 31774 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:13.847321 31586 ts_tablet_manager.cc:1434] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.116s	user 0.014s	sys 0.017s
I20260709 12:23:13.849398 31586 tablet_bootstrap.cc:492] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:13.833595 31584 raft_consensus.cc:359] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.850335 31584 raft_consensus.cc:385] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.850701 31584 raft_consensus.cc:740] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.851559 31584 consensus_queue.cc:260] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.852129 31774 consensus_queue.cc:1048] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.853377 31584 ts_tablet_manager.cc:1434] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 12:23:13.856400 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:13.871188 31586 tablet_bootstrap.cc:654] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.886544 31584 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:13.891319 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.892198 31395 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
W20260709 12:23:13.898528 31510 leader_election.cc:343] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.904098 31584 tablet_bootstrap.cc:654] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.907989 31585 ts_tablet_manager.cc:1434] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.176s	user 0.007s	sys 0.004s
I20260709 12:23:13.963428 31586 tablet_bootstrap.cc:492] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:13.964061 31586 ts_tablet_manager.cc:1403] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.014s
I20260709 12:23:13.964076 31585 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:13.968124 31888 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.968734 31888 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.971997 31888 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.901490 31841 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.977785 31841 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:13.978404 31585 tablet_bootstrap.cc:654] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.979092 31586 raft_consensus.cc:359] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.979866 31586 raft_consensus.cc:385] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.980161 31586 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.980765 31586 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:13.983161 31586 ts_tablet_manager.cc:1434] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:23:13.984459 31586 tablet_bootstrap.cc:492] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:13.990080 31843 consensus_queue.cc:1048] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.990852 31586 tablet_bootstrap.cc:654] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.998581 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:13.999544 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:14.000607 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:23:14.001050 31433 leader_election.cc:343] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.001688 31843 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:14.002173 31433 leader_election.cc:343] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.002204 31843 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.003068 31843 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.006659 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:14.010532 31543 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.018630 31543 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:14.019492 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.031550 31843 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.045385 31289 catalog_manager.cc:5697] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.051961 31843 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:14.055424 31584 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:14.055639 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:14.056182 31584 ts_tablet_manager.cc:1403] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.170s	user 0.009s	sys 0.007s
W20260709 12:23:14.059973 31510 leader_election.cc:343] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.060863 31584 raft_consensus.cc:359] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.061653 31584 raft_consensus.cc:385] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.061985 31584 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.062811 31584 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:14.064483 31434 leader_election.cc:343] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.065541 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:14.066622 31584 ts_tablet_manager.cc:1434] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:14.069128 31584 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:14.074028 31888 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.074980 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:14.075579 31395 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.076347 31434 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:14.081391 31888 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.082021 31888 raft_consensus.cc:697] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:14.082692 31584 tablet_bootstrap.cc:654] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.083204 31888 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.089483 31585 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:14.090106 31585 ts_tablet_manager.cc:1403] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.002s
I20260709 12:23:14.083693 31395 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:14.105525 31584 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:14.106105 31584 ts_tablet_manager.cc:1403] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.009s
I20260709 12:23:14.108856 31584 raft_consensus.cc:359] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.109728 31584 raft_consensus.cc:385] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.110066 31584 raft_consensus.cc:740] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.111095 31584 consensus_queue.cc:260] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.113077 31843 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.122732 31843 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.124902 31843 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:14.118624 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:14.125816 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:14.126807 31584 ts_tablet_manager.cc:1434] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:23:14.127754 31467 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:14.128456 31584 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:14.129050 31510 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:14.129945 31843 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.130295 31843 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.130649 31843 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.130396 31292 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.135298 31584 tablet_bootstrap.cc:654] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.137805 31391 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.143326 31645 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.143793 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:14.143954 31645 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.144709 31774 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.145206 31774 raft_consensus.cc:697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:14.146114 31774 consensus_queue.cc:237] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.146672 31645 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.149799 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:14.151714 31433 leader_election.cc:343] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.154074 31888 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.154534 31888 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.155452 31586 tablet_bootstrap.cc:492] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:14.155889 31586 ts_tablet_manager.cc:1403] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.172s	user 0.052s	sys 0.054s
I20260709 12:23:14.156641 31888 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.158517 31584 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:14.158504 31586 raft_consensus.cc:359] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.121111 31585 raft_consensus.cc:359] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.159293 31586 raft_consensus.cc:385] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.159376 31585 raft_consensus.cc:385] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.159523 31584 ts_tablet_manager.cc:1403] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.007s
I20260709 12:23:14.159626 31586 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.160923 31640 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.161383 31640 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.159752 31585 raft_consensus.cc:740] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.163570 31640 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.163713 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:14.165134 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:14.165453 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.166388 31586 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:14.167114 31359 leader_election.cc:343] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:14.167797 31433 leader_election.cc:343] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.169869 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:14.170065 31586 ts_tablet_manager.cc:1434] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:14.170552 31868 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.171288 31586 tablet_bootstrap.cc:492] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:14.171554 31868 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.170979 31645 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:14.175997 31868 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.162855 31585 consensus_queue.cc:260] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.178324 31586 tablet_bootstrap.cc:654] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.179955 31585 ts_tablet_manager.cc:1434] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 12:23:14.179876 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.180661 31540 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:14.181097 31585 tablet_bootstrap.cc:492] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:14.183698 31359 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:14.219425 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:14.189504 31584 raft_consensus.cc:359] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.220702 31584 raft_consensus.cc:385] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.221010 31584 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.201155 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.212918 31774 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:14.194502 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:14.224155 31507 leader_election.cc:343] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.228878 31843 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.230434 31586 tablet_bootstrap.cc:492] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:14.233484 31584 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.237852 31905 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:14.255086 31584 ts_tablet_manager.cc:1434] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.002s
I20260709 12:23:14.256464 31467 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
W20260709 12:23:14.245726 31434 leader_election.cc:343] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.258083 31434 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:14.258358 31586 ts_tablet_manager.cc:1403] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.087s	user 0.024s	sys 0.022s
W20260709 12:23:14.259387 31434 leader_election.cc:343] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.259776 31434 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:14.248881 31395 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.261023 31586 raft_consensus.cc:359] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.261682 31586 raft_consensus.cc:385] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.261929 31586 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.262586 31586 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.263762 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:14.264348 31465 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.264796 31586 ts_tablet_manager.cc:1434] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:14.266237 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:14.266697 31586 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
W20260709 12:23:14.267505 31507 leader_election.cc:343] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.269059 31905 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:14.269515 31905 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.258105 31584 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:14.273046 31586 tablet_bootstrap.cc:654] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.274637 31644 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.275444 31710 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.289754 31645 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:14.291348 31289 catalog_manager.cc:5697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:14.293859 31905 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.276368 31843 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:14.297436 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:14.300312 31846 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:14.301883 31905 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.308012 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:14.309253 31905 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.315876 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:14.314291 31905 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.317638 31905 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.332890 31585 tablet_bootstrap.cc:654] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.327700 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:14.339910 31584 tablet_bootstrap.cc:654] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.337736 31640 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:14.347198 31586 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:14.347759 31586 ts_tablet_manager.cc:1403] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.002s
I20260709 12:23:14.351621 31586 raft_consensus.cc:359] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.352247 31586 raft_consensus.cc:385] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.347582 31905 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.352551 31586 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.353040 31586 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.354110 31465 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:14.357326 31510 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:14.361027 31843 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.361474 31905 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.362214 31586 ts_tablet_manager.cc:1434] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:14.361508 31843 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:14.363164 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:14.364274 31843 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.371675 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:14.372314 31465 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:14.373607 31359 leader_election.cc:343] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.376140 31585 tablet_bootstrap.cc:492] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:14.376552 31586 tablet_bootstrap.cc:492] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:14.376595 31585 ts_tablet_manager.cc:1403] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.196s	user 0.019s	sys 0.000s
I20260709 12:23:14.382714 31586 tablet_bootstrap.cc:654] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.382390 31585 raft_consensus.cc:359] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.383030 31585 raft_consensus.cc:385] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.384692 31585 raft_consensus.cc:740] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.385347 31585 consensus_queue.cc:260] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.388100 31465 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:14.390689 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:14.392007 31905 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.392622 31905 raft_consensus.cc:697] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:14.393713 31905 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.399641 31585 ts_tablet_manager.cc:1434] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:23:14.399758 31586 tablet_bootstrap.cc:492] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:14.400254 31586 ts_tablet_manager.cc:1403] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 12:23:14.400697 31585 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:14.402745 31586 raft_consensus.cc:359] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.403486 31586 raft_consensus.cc:385] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.403791 31586 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.404744 31586 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.407822 31586 ts_tablet_manager.cc:1434] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:14.408514 31585 tablet_bootstrap.cc:654] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.408809 31586 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:14.412042 31289 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:14.436650 31584 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:14.437103 31584 ts_tablet_manager.cc:1403] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.179s	user 0.017s	sys 0.042s
I20260709 12:23:14.440704 31584 raft_consensus.cc:359] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.441956 31584 raft_consensus.cc:385] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.442246 31584 raft_consensus.cc:740] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.442848 31584 consensus_queue.cc:260] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.443418 31585 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:14.444020 31585 ts_tablet_manager.cc:1403] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.015s
I20260709 12:23:14.444941 31584 ts_tablet_manager.cc:1434] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:14.446206 31584 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:14.450372 31585 raft_consensus.cc:359] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.451033 31585 raft_consensus.cc:385] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.451262 31586 tablet_bootstrap.cc:654] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.451324 31585 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.452242 31585 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.451654 31584 tablet_bootstrap.cc:654] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.455513 31585 ts_tablet_manager.cc:1434] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:14.456857 31710 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.457382 31710 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.456519 31585 tablet_bootstrap.cc:492] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:14.462091 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:14.462905 31395 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:14.464143 31586 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:14.464926 31585 tablet_bootstrap.cc:654] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.465600 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.467134 31434 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:14.468220 31888 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.472378 31868 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.472801 31868 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.474674 31868 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.466297 31289 catalog_manager.cc:5697] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.475333 31710 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.476145 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:14.476708 31465 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:14.480059 31361 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:14.480978 31868 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.481410 31868 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.482844 31868 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.483331 31584 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:14.483759 31584 ts_tablet_manager.cc:1403] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.009s
I20260709 12:23:14.486287 31586 ts_tablet_manager.cc:1403] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.003s
I20260709 12:23:14.486618 31584 raft_consensus.cc:359] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.487334 31584 raft_consensus.cc:385] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.487612 31584 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.488478 31584 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.491978 31841 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.492556 31584 ts_tablet_manager.cc:1434] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:14.492419 31841 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.494436 31841 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.495396 31584 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:14.495133 31586 raft_consensus.cc:359] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.496025 31586 raft_consensus.cc:385] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.496358 31586 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.497066 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.497728 31543 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:14.497316 31586 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.499717 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:14.500682 31841 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.501036 31841 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.501394 31841 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.503481 31584 tablet_bootstrap.cc:654] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.506757 31391 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.500089 31868 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.517104 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.517182 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:14.518617 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:14.519203 31465 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:14.519793 31433 leader_election.cc:343] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.527302 31465 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
W20260709 12:23:14.527880 31359 leader_election.cc:343] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.528796 31361 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:14.530689 31640 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.531400 31640 raft_consensus.cc:697] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:14.532536 31640 consensus_queue.cc:237] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.499715 31586 ts_tablet_manager.cc:1434] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:14.545783 31586 tablet_bootstrap.cc:492] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:14.509184 31841 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.585811 31868 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.599028 31841 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.605825 31888 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.607853 31584 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:14.608338 31584 ts_tablet_manager.cc:1403] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.115s	user 0.028s	sys 0.015s
I20260709 12:23:14.608656 31586 tablet_bootstrap.cc:654] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.608857 31585 tablet_bootstrap.cc:492] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:14.609239 31585 ts_tablet_manager.cc:1403] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.153s	user 0.035s	sys 0.043s
I20260709 12:23:14.617738 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:14.632058 31585 raft_consensus.cc:359] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.632655 31585 raft_consensus.cc:385] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.632901 31585 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.645139 31640 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:14.621740 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 72355.9us
I20260709 12:23:14.649112 31640 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.655643 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:14.780344 31868 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.699779 31905 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.671212 31584 raft_consensus.cc:359] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.782263 31584 raft_consensus.cc:385] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.768309 31585 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.781843 31868 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.781874 31905 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.782649 31584 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
W20260709 12:23:14.732349 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 82592.9us
I20260709 12:23:14.783748 31584 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.719218 31290 catalog_manager.cc:5697] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:14.696257 31433 leader_election.cc:343] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:14.785665 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 89442.1us
I20260709 12:23:14.768599 31640 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.730775 31936 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.790202 31584 ts_tablet_manager.cc:1434] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.182s	user 0.004s	sys 0.012s
I20260709 12:23:14.790503 31868 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.791317 31584 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:14.736902 31842 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:23:14.792665 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:14.793336 31467 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
W20260709 12:23:14.776580 31359 leader_election.cc:343] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.796522 31846 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:14.796655 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:14.798990 31392 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.800339 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:14.802290 31361 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:14.803606 31903 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.803943 31903 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.804280 31903 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.804505 31543 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.808571 31390 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:14.810120 31586 tablet_bootstrap.cc:492] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:14.810438 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.811094 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.812383 31541 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:14.812525 31586 ts_tablet_manager.cc:1403] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.267s	user 0.018s	sys 0.003s
I20260709 12:23:14.817842 31935 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:14.824822 31359 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:14.825067 31905 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.825539 31868 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:14.826169 31359 leader_election.cc:343] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.828076 31585 ts_tablet_manager.cc:1434] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.219s	user 0.020s	sys 0.067s
I20260709 12:23:14.830075 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.831887 31585 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:14.827327 31868 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.834328 31586 raft_consensus.cc:359] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.839550 31586 raft_consensus.cc:385] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.839972 31586 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.840812 31586 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.842572 31868 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.853183 31939 consensus_queue.cc:1059] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:23:14.865995 31937 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.787196 31936 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.884891 31868 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.885799 31936 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:14.867480 31937 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.882325 31903 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.889796 31903 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.891399 31390 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:23:14.893455 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:14.894138 31391 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:14.895056 31868 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.895265 31584 tablet_bootstrap.cc:654] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.895494 31938 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.887132 31846 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.887212 31543 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:14.902594 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:14.901926 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:14.905239 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 64730us
I20260709 12:23:14.906400 31586 ts_tablet_manager.cc:1434] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.004s
I20260709 12:23:14.907372 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:14.907956 31539 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.910094 31936 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:14.910513 31936 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.910856 31936 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:14.908571 31359 leader_election.cc:343] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.895932 31938 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.901782 31846 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.930429 31846 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:14.936474 31585 tablet_bootstrap.cc:654] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.940184 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:14.940881 31469 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
W20260709 12:23:14.941174 31359 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.941423 31645 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.942025 31645 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.943989 31645 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.954775 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:14.956408 31842 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:14.957293 31539 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:14.960041 31586 tablet_bootstrap.cc:492] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:14.961205 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:14.961330 31934 raft_consensus.cc:3055] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:14.961815 31934 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:14.961999 31468 raft_consensus.cc:2393] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:14.962834 31937 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:14.962859 31359 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:14.963781 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:14.964794 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.964929 31937 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:14.968694 31937 raft_consensus.cc:697] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:14.962812 31934 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.979429 31934 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.980472 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:14.980908 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:14.971189 31937 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.984532 31938 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:14.976688 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:14.985656 31468 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.986850 31846 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.987457 31846 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.989432 31846 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:14.989866 31936 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:14.991298 31543 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:14.992929 31936 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:14.999258 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:14.999507 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:15.000110 31394 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:15.000136 31393 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:15.002956 31507 leader_election.cc:343] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.009264 31507 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:15.033332 31945 consensus_queue.cc:1059] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 12:23:15.040483 31507 leader_election.cc:343] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.043434 31468 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:15.033345 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:15.034179 31939 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.034032 31935 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.043912 31586 tablet_bootstrap.cc:654] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.047546 31945 raft_consensus.cc:3055] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:15.047902 31945 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:15.057251 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:15.057888 31468 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:15.059350 31393 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:15.063813 31943 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.064261 31943 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.064589 31943 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.049897 31935 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.066534 31584 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:15.066946 31584 ts_tablet_manager.cc:1403] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.276s	user 0.020s	sys 0.003s
I20260709 12:23:15.050051 31939 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.071668 31361 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:15.074127 31939 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:15.076515 31361 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:15.076689 31292 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.077823 31640 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.073278 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:15.075265 31905 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.098949 31640 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:15.086935 31842 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:23:15.095162 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 57371.4us
I20260709 12:23:15.098620 31584 raft_consensus.cc:359] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.102238 31584 raft_consensus.cc:385] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.102500 31584 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.104377 31584 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.104143 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:15.111739 31361 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:15.084071 31903 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:23:15.102840 31640 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.118937 31585 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:15.119454 31585 ts_tablet_manager.cc:1403] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.288s	user 0.032s	sys 0.035s
I20260709 12:23:15.103449 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:15.122510 31584 ts_tablet_manager.cc:1434] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 12:23:15.124046 31584 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:15.125229 31585 raft_consensus.cc:359] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.126161 31585 raft_consensus.cc:385] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.126502 31585 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.127609 31585 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.142777 31584 tablet_bootstrap.cc:654] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.112653 31842 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:15.156586 31585 ts_tablet_manager.cc:1434] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:23:15.157886 31942 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.158386 31942 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:15.160964 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:15.162575 31935 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:15.101225 31945 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.163848 31945 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.149251 31841 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.146929 31469 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
W20260709 12:23:15.201500 31359 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.207191 31585 tablet_bootstrap.cc:492] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:15.224539 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:15.225335 31464 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:15.192094 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:15.231880 31942 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:15.232118 31954 raft_consensus.cc:2764] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:23:15.180895 31842 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.220114 31841 raft_consensus.cc:697] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:15.268086 31841 consensus_queue.cc:237] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.267088 31586 tablet_bootstrap.cc:492] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:15.269289 31586 ts_tablet_manager.cc:1403] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.330s	user 0.015s	sys 0.012s
W20260709 12:23:15.281354 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 169668us
I20260709 12:23:15.286936 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:15.270629 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 158645us
I20260709 12:23:15.287572 31467 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.287847 31434 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:15.291841 31433 leader_election.cc:343] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.313760 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:15.314563 31465 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:15.316704 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:15.325968 31586 raft_consensus.cc:359] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.326568 31586 raft_consensus.cc:385] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.326797 31586 raft_consensus.cc:740] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.327421 31586 consensus_queue.cc:260] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.303843 31954 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:23:15.337888 31586 ts_tablet_manager.cc:1434] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 12:23:15.339440 31510 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:15.363302 31942 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.363718 31942 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.364121 31942 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.368528 31585 tablet_bootstrap.cc:654] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.375284 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:15.376834 31584 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:15.377244 31584 ts_tablet_manager.cc:1403] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.253s	user 0.011s	sys 0.007s
I20260709 12:23:15.365458 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:15.385697 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:15.388880 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:15.373024 31943 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.398525 31467 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:15.410383 31943 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:15.383901 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:15.412499 31584 raft_consensus.cc:359] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.413473 31944 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:15.180842 31710 consensus_queue.cc:1175] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b63f042a541248b88888cbd3049b38ca" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:15.414309 31584 raft_consensus.cc:385] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.415143 31584 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.416038 31584 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.417342 31938 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.417728 31938 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.418040 31938 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.424885 31586 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:15.431542 31584 ts_tablet_manager.cc:1434] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 12:23:15.432875 31584 tablet_bootstrap.cc:492] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
W20260709 12:23:15.437048 31433 leader_election.cc:343] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.442786 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:15.443408 31389 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.449131 31938 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.451800 31938 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:15.453110 31542 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.455830 31964 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:15.457392 31510 leader_election.cc:343] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.460506 31846 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.462131 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:15.463210 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:15.463351 31389 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:15.465070 31290 catalog_manager.cc:5697] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.467784 31586 tablet_bootstrap.cc:654] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.456367 31964 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.456634 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:15.469575 31292 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 2, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.468068 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:23:15.487512 31510 leader_election.cc:343] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.491061 31467 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.522449 31585 tablet_bootstrap.cc:492] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:15.523026 31585 ts_tablet_manager.cc:1403] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.322s	user 0.016s	sys 0.017s
I20260709 12:23:15.529458 31964 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:15.536655 31957 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.542330 31584 tablet_bootstrap.cc:654] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:15.543447 31434 leader_election.cc:343] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.543944 31434 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:15.545061 31434 leader_election.cc:343] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.545418 31434 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:15.546087 31710 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:15.548831 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53600us
W20260709 12:23:15.556250 31507 leader_election.cc:343] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.556855 31507 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:15.558642 31842 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.559124 31842 raft_consensus.cc:697] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:15.559942 31842 consensus_queue.cc:237] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.511883 31942 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.567042 31585 raft_consensus.cc:359] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.567741 31585 raft_consensus.cc:385] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.568020 31585 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.570742 31585 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.588523 31585 ts_tablet_manager.cc:1434] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 12:23:15.590343 31585 tablet_bootstrap.cc:492] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:15.598361 31586 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:15.598845 31586 ts_tablet_manager.cc:1403] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.174s	user 0.017s	sys 0.003s
I20260709 12:23:15.601416 31586 raft_consensus.cc:359] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.602139 31586 raft_consensus.cc:385] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.602413 31586 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.608170 31585 tablet_bootstrap.cc:654] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.602988 31586 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.617370 31586 ts_tablet_manager.cc:1434] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:23:15.618589 31586 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:15.619011 31585 tablet_bootstrap.cc:492] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:15.619700 31585 ts_tablet_manager.cc:1403] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 12:23:15.570194 31888 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.624643 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:15.548837 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:15.626567 31467 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:15.626984 31466 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:15.627923 31464 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:23:15.628309 31464 pending_rounds.cc:85] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 0
I20260709 12:23:15.628626 31464 pending_rounds.cc:107] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:23:15.628916 31464 raft_consensus.cc:2889] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:15.629441 31942 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:15.587697 31936 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.633330 31936 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.636088 31936 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:15.636168 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:15.636891 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:15.637101 31467 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.637746 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:15.639066 31938 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.639436 31938 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.639761 31938 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.640311 31966 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:15.643364 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:15.644903 31507 leader_election.cc:343] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.648419 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:15.649523 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:15.650118 31393 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.650012 31585 raft_consensus.cc:359] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.650511 31942 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.653033 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:15.653498 31585 raft_consensus.cc:385] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.657768 31585 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.663816 31585 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.660385 31942 raft_consensus.cc:697] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:15.670114 31942 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.658167 31774 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.675633 31538 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.682121 31292 catalog_manager.cc:5697] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.683995 31543 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:15.694671 31905 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.695434 31393 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:15.697714 31507 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:15.698679 31936 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.699126 31936 raft_consensus.cc:697] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:15.703791 31936 consensus_queue.cc:237] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.707463 31290 catalog_manager.cc:5697] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.710637 31585 ts_tablet_manager.cc:1434] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.002s
I20260709 12:23:15.710632 31903 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:23:15.728619 31585 tablet_bootstrap.cc:492] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:15.733844 31584 tablet_bootstrap.cc:492] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:15.734341 31584 ts_tablet_manager.cc:1403] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.302s	user 0.026s	sys 0.014s
I20260709 12:23:15.734516 31467 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:15.725543 31938 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.745957 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:15.747087 31938 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:15.748238 31359 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:15.749764 31507 leader_election.cc:343] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.762019 31584 raft_consensus.cc:359] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.762995 31584 raft_consensus.cc:385] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.765648 31584 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.773535 31584 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.773078 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:15.790207 31710 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.792068 31465 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.792172 31710 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:15.793262 31433 consensus_peers.cc:597] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.790557 31389 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:15.797709 31584 ts_tablet_manager.cc:1434] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.063s	user 0.002s	sys 0.007s
I20260709 12:23:15.798439 31888 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.803197 31710 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:15.803725 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:15.804343 31543 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 0.
I20260709 12:23:15.799003 31938 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.800966 31586 tablet_bootstrap.cc:654] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.806797 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:15.807209 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:15.808676 31936 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:15.810102 31936 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.810485 31467 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:15.811415 31944 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.812211 31944 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.812567 31944 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.816475 31842 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:15.814886 31433 leader_election.cc:343] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.827946 31465 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:15.837531 31936 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:15.843689 31584 tablet_bootstrap.cc:492] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:15.847532 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:15.848610 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:15.845973 31955 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.852516 31391 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:15.853549 31955 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.855620 31955 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:15.847168 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:15.856755 31463 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:15.856981 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:15.857749 31466 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:15.859530 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:15.862815 31936 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:15.863193 31936 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:15.863574 31936 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.864302 31944 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.866761 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:15.867141 31944 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:15.850903 31942 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.872320 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:15.867980 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:15.873603 31539 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.867911 31942 raft_consensus.cc:697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:15.876046 31942 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.875087 31585 tablet_bootstrap.cc:654] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:15.880308 31433 leader_election.cc:343] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.882218 31359 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:15.883976 31290 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.884852 31955 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.885828 31290 catalog_manager.cc:5697] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.907354 31955 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.913496 31539 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:15.966540 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:15.970811 31939 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.971351 31939 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:15.972188 31939 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:15.981915 31290 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.005208 31586 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:16.005678 31586 ts_tablet_manager.cc:1403] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.387s	user 0.008s	sys 0.004s
I20260709 12:23:16.007614 31936 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.010618 31936 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:16.013010 31586 raft_consensus.cc:359] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.013669 31586 raft_consensus.cc:385] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.013906 31586 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.014475 31586 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.017660 31586 ts_tablet_manager.cc:1434] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:23:16.019263 31951 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.019721 31951 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.023492 31586 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:16.023866 31951 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.032496 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:16.040539 31584 tablet_bootstrap.cc:654] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:16.042193 31433 leader_election.cc:343] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.047101 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:16.053546 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:16.052752 31289 catalog_manager.cc:5697] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:16.056223 31510 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:16.066457 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:16.067190 31390 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:23:16.068781 31434 leader_election.cc:343] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.069171 31434 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:16.070894 31951 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:16.072939 31586 tablet_bootstrap.cc:654] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.075765 31585 tablet_bootstrap.cc:492] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:16.076274 31585 ts_tablet_manager.cc:1403] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.349s	user 0.015s	sys 0.017s
I20260709 12:23:16.078846 31467 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:16.088179 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:16.090230 31584 tablet_bootstrap.cc:492] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:16.090767 31584 ts_tablet_manager.cc:1403] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.252s	user 0.009s	sys 0.004s
I20260709 12:23:16.093446 31962 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:16.093938 31962 raft_consensus.cc:697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:16.094722 31962 consensus_queue.cc:237] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.096987 31585 raft_consensus.cc:359] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.097824 31585 raft_consensus.cc:385] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.098155 31585 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.098774 31585 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.105692 31584 raft_consensus.cc:359] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.108902 31584 raft_consensus.cc:385] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.109225 31584 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.109983 31584 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.112389 31584 ts_tablet_manager.cc:1434] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:23:16.114781 31584 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Bootstrap starting.
I20260709 12:23:16.113610 31585 ts_tablet_manager.cc:1434] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:23:16.122093 31543 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.129613 31586 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:16.133103 31586 ts_tablet_manager.cc:1403] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.110s	user 0.016s	sys 0.015s
I20260709 12:23:16.130584 31585 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:16.135859 31586 raft_consensus.cc:359] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.136526 31586 raft_consensus.cc:385] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.136878 31586 raft_consensus.cc:740] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.137710 31586 consensus_queue.cc:260] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.132635 31584 tablet_bootstrap.cc:654] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.139945 31586 ts_tablet_manager.cc:1434] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 12:23:16.141031 31586 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:16.142017 31289 catalog_manager.cc:5697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.155303 31586 tablet_bootstrap.cc:654] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.161617 31942 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.163020 31585 tablet_bootstrap.cc:654] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.183293 31942 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.184669 31942 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.186970 31846 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.188099 31585 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:16.189460 31585 ts_tablet_manager.cc:1403] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.001s
I20260709 12:23:16.198246 31584 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: No bootstrap required, opened a new log
I20260709 12:23:16.198727 31584 ts_tablet_manager.cc:1403] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.000s
I20260709 12:23:16.199961 31585 raft_consensus.cc:359] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.200793 31585 raft_consensus.cc:385] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.201136 31585 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.201383 31584 raft_consensus.cc:359] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.202041 31584 raft_consensus.cc:385] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.202325 31584 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.201825 31585 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.204210 31585 ts_tablet_manager.cc:1434] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:23:16.205088 31585 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:16.202941 31584 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.221696 31955 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.222409 31955 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.225014 31955 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.226612 31585 tablet_bootstrap.cc:654] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.222342 31584 ts_tablet_manager.cc:1434] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:23:16.230397 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.231465 31467 raft_consensus.cc:2393] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:16.253847 31846 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:16.259547 31585 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:16.260022 31585 ts_tablet_manager.cc:1403] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.007s
I20260709 12:23:16.267360 31944 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.267940 31944 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.263082 31585 raft_consensus.cc:359] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.268857 31585 raft_consensus.cc:385] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.269125 31585 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.269794 31585 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.270212 31944 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.277405 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:16.279489 31585 ts_tablet_manager.cc:1434] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:23:16.280431 31585 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:16.281843 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:16.285600 31359 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:16.290468 31955 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.294162 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:16.293217 31942 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.295560 31433 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:16.296072 31942 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.297901 31944 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:16.298237 31942 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:16.308209 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.308862 31466 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:16.310058 31510 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:16.310853 31846 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:16.311384 31846 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.312247 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:16.306712 31955 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:16.311830 31846 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.314082 31585 tablet_bootstrap.cc:654] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:16.323266 31341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:16.324131 31585 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:16.324620 31585 ts_tablet_manager.cc:1403] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.044s	user 0.002s	sys 0.015s
W20260709 12:23:16.324975 31507 leader_election.cc:343] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.326262 31846 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.329118 31586 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:16.329592 31586 ts_tablet_manager.cc:1403] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.189s	user 0.019s	sys 0.019s
I20260709 12:23:16.330806 31846 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:16.332243 31586 raft_consensus.cc:359] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.332695 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:16.332947 31586 raft_consensus.cc:385] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.333210 31586 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.333259 31466 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.334139 31586 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.336949 31586 ts_tablet_manager.cc:1434] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:16.337980 31586 tablet_bootstrap.cc:492] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:16.340545 31466 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:16.342949 31510 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:16.343521 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:16.339308 31585 raft_consensus.cc:359] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.344774 31585 raft_consensus.cc:385] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.345548 31962 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.347728 31962 raft_consensus.cc:697] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:16.347072 31585 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.348578 31962 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:16.345494 31507 leader_election.cc:343] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.348687 31585 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.354171 31391 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.357223 31586 tablet_bootstrap.cc:654] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.357775 31585 ts_tablet_manager.cc:1434] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 12:23:16.361189 31585 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: Bootstrap starting.
I20260709 12:23:16.367852 31585 tablet_bootstrap.cc:654] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.383572 31962 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.382777 31289 catalog_manager.cc:5697] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.384172 31962 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.385907 31962 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:16.387081 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:16.387166 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.389444 31466 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:16.390709 31510 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:16.391637 31507 leader_election.cc:343] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.392500 31962 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:16.392926 31585 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: No bootstrap required, opened a new log
I20260709 12:23:16.392936 31962 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.393509 31585 ts_tablet_manager.cc:1403] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.006s
I20260709 12:23:16.393517 31962 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.396461 31586 tablet_bootstrap.cc:492] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:16.396307 31585 raft_consensus.cc:359] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.396966 31586 ts_tablet_manager.cc:1403] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.015s
I20260709 12:23:16.397063 31585 raft_consensus.cc:385] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.397483 31585 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.398160 31585 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.400326 31585 ts_tablet_manager.cc:1434] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:16.403949 31586 raft_consensus.cc:359] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.404706 31586 raft_consensus.cc:385] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.405004 31586 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.405762 31586 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.405821 31962 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.408790 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:16.409433 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:16.410084 31507 leader_election.cc:343] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:16.410099 31466 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.410882 31586 ts_tablet_manager.cc:1434] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:23:16.412246 31586 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:16.417991 31962 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:16.418509 31586 tablet_bootstrap.cc:654] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.426152 31466 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:16.428510 31510 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:16.429343 31846 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.429953 31846 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:16.430344 31586 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:16.431105 31586 ts_tablet_manager.cc:1403] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 12:23:16.430800 31846 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.432986 31586 raft_consensus.cc:359] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.433446 31586 raft_consensus.cc:385] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.433651 31586 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.434270 31586 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.436239 31586 ts_tablet_manager.cc:1434] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:16.437671 31586 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:16.443162 31586 tablet_bootstrap.cc:654] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.445726 31290 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.448814 31586 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:16.449226 31586 ts_tablet_manager.cc:1403] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:23:16.451352 31961 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.451665 31586 raft_consensus.cc:359] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.451817 31961 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.452322 31586 raft_consensus.cc:385] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.452596 31586 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.453171 31586 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.453835 31961 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.455338 31586 ts_tablet_manager.cc:1434] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:23:16.455687 31846 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:16.456393 31586 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Bootstrap starting.
I20260709 12:23:16.458894 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:16.461598 31944 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.462849 31586 tablet_bootstrap.cc:654] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.463897 31962 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.475905 31846 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.482940 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.486231 31466 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:16.487543 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:16.479071 31846 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.492849 31955 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:16.500123 31966 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.503623 31955 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.519896 31905 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.520365 31586 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: No bootstrap required, opened a new log
I20260709 12:23:16.511664 31966 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.520987 31586 ts_tablet_manager.cc:1403] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.010s
I20260709 12:23:16.520422 31905 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.522590 31966 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.516355 31955 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.523797 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.524569 31467 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:16.525544 31905 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.526975 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.527621 31467 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:16.528996 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:16.530311 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:16.530833 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:16.531199 31542 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:16.532676 31359 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:16.538338 31586 raft_consensus.cc:359] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.539151 31586 raft_consensus.cc:385] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.539513 31586 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.539592 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:16.540285 31586 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.541842 31846 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:16.543365 31586 ts_tablet_manager.cc:1434] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:23:16.547982 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.548566 31467 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 0.
I20260709 12:23:16.549556 31465 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.532951 31905 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:16.552134 31905 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.553884 31510 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:16.553911 31905 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.555819 31774 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:16.556196 31774 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.556522 31774 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.561375 31905 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.570705 31391 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.578557 31389 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:16.547080 31955 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.579345 31390 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:16.581892 31905 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.570883 31966 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.591475 31951 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.593734 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:16.594522 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:16.595093 31466 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.596468 31774 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.596974 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:16.597551 31463 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.597661 31543 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:16.597247 31955 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.605516 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:16.605664 31943 consensus_queue.cc:1059] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:23:16.657172 31466 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:16.671489 31463 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:16.679121 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:16.679736 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:16.686653 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:16.682834 31774 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:16.684140 31961 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.688297 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:16.689640 31464 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:16.689973 31389 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 1: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:16.689579 31905 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:16.691972 31938 raft_consensus.cc:3055] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:16.692143 31905 raft_consensus.cc:697] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:16.692373 31938 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:16.693037 31905 consensus_queue.cc:237] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.694963 31938 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:16.696094 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.696388 31938 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.697443 31510 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:16.699018 31774 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:16.694065 32020 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.693397 31961 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.703874 31961 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.706712 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.707376 31464 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:16.688966 31966 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:16.710359 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:16.716166 31542 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 0.
I20260709 12:23:16.710510 31903 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.717142 31903 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.720007 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:16.724350 31903 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.708693 32020 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:16.713831 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:16.727563 32020 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.732913 31903 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:16.733332 31903 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.733693 31903 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.734516 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:16.735303 31464 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 1: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:16.736297 31361 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:16.737756 31955 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.740610 31903 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.742663 31903 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:16.743628 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:16.744378 31464 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.747864 31955 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:16.754396 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:16.755059 31539 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.761298 31464 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:16.762609 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:16.763357 32025 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.764094 32025 raft_consensus.cc:697] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:16.764977 32025 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:16.775586 31539 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:16.779239 31938 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.783350 31290 catalog_manager.cc:5697] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 2 to 3, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.786857 31290 catalog_manager.cc:5697] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.788623 31290 catalog_manager.cc:5697] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.794291 31938 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.936018 31938 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.946967 31943 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.115831 31465 raft_consensus.cc:1275] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:17.116871 31955 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.117226 32020 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:17.128628 31542 raft_consensus.cc:1275] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:17.129014 31542 pending_rounds.cc:85] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 1
I20260709 12:23:17.129253 31542 pending_rounds.cc:107] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:17.129492 31542 raft_consensus.cc:2889] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:17.131973 31903 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:17.138949 32020 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.169354 31966 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.179728 31903 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.376107 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:17.410086 32039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:17.410900 30223 server_base.cc:1061] running on GCE node
W20260709 12:23:17.411316 32038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:17.412791 32041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:17.415900 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:17.416236 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:17.416566 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599797416532 us; error 0 us; skew 500 ppm
I20260709 12:23:17.417351 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:17.422318 30223 webserver.cc:533] Webserver started at http://127.29.131.196:42479/ using document root <none> and password file <none>
I20260709 12:23:17.423040 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:17.423339 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:17.423774 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:17.425442 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-3-root/instance:
uuid: "8d38acb9ce494ceb917c8441666104c4"
format_stamp: "Formatted at 2026-07-09 12:23:17 on dist-test-slave-n640"
I20260709 12:23:17.432806 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:17.438138 32046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:17.439141 30223 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:23:17.439597 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-3-root
uuid: "8d38acb9ce494ceb917c8441666104c4"
format_stamp: "Formatted at 2026-07-09 12:23:17 on dist-test-slave-n640"
I20260709 12:23:17.440013 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:17.479599 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:17.481410 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:17.483340 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:17.487553 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:17.487865 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:17.488188 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:17.488413 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:17.574244 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.196:40531
I20260709 12:23:17.574368 32108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.196:40531 every 8 connection(s)
I20260709 12:23:17.584844 30223 auto_leader_rebalancer-test.cc:439] add a tserver: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:17.599583 32109 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36201
I20260709 12:23:17.600046 32109 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:17.600822 32109 heartbeater.cc:507] Master 127.29.131.254:36201 requested a full tablet report, sending...
I20260709 12:23:17.602618 31290 ts_manager.cc:194] Registered new tserver with Master: 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:17.604375 31290 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45406
I20260709 12:23:18.606839 32109 heartbeater.cc:499] Master 127.29.131.254:36201 was elected leader, sending a full tablet report...
W20260709 12:23:18.647055 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 52936.5us
I20260709 12:23:18.679522 31393 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:18.688829 31539 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.690133 32120 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.695215 31463 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.696748 32121 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.703199 32120 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.704871 31539 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.718113 31393 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:18.723927 31463 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.728775 31290 catalog_manager.cc:5697] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
W20260709 12:23:18.739777 31361 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f0ffee11de74139a74b497dea5ab8fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.748409 31543 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:18.749346 31361 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fc04eb7c849448bba0b8d22faf8751a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.750022 32118 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.751310 31463 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.752732 32120 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.768631 32120 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.770573 31543 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.784461 31463 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.800527 31292 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.851606 31539 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:18.859889 31393 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.860446 31463 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.861382 31943 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.862373 32113 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:18.870350 31510 consensus_peers.cc:597] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbf61ba8f0cc44ee87136dd991354c89. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.872737 31943 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.874557 31463 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.876302 31393 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.888309 31292 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.915158 31463 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:18.922974 31539 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.924350 31393 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.924418 32138 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:18.926405 32139 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:18.938289 31436 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ede0de141bd4d8aafecf4cc1902f9f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.940157 32138 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.941751 31393 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.943627 31539 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:18.961022 31289 catalog_manager.cc:5697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.162655 32149 ts_tablet_manager.cc:933] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:19.179322 32151 ts_tablet_manager.cc:933] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:19.181557 32149 tablet_copy_client.cc:323] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:19.193645 32151 tablet_copy_client.cc:323] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:19.206446 31405 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet 0f0ffee11de74139a74b497dea5ab8fc from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:19.206707 31404 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet 1fc04eb7c849448bba0b8d22faf8751a from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:19.207006 31405 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet 0f0ffee11de74139a74b497dea5ab8fc from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-0f0ffee11de74139a74b497dea5ab8fc
I20260709 12:23:19.207949 31404 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet 1fc04eb7c849448bba0b8d22faf8751a from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-1fc04eb7c849448bba0b8d22faf8751a
I20260709 12:23:19.212652 31405 tablet_copy_source_session.cc:215] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.215112 31404 tablet_copy_source_session.cc:215] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.216598 32149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f0ffee11de74139a74b497dea5ab8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.221124 32151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc04eb7c849448bba0b8d22faf8751a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.231415 32149 tablet_copy_client.cc:806] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.232105 32149 tablet_copy_client.cc:670] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.237679 32149 tablet_copy_client.cc:538] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.239396 32151 tablet_copy_client.cc:806] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.239928 32151 tablet_copy_client.cc:670] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.243691 32151 tablet_copy_client.cc:538] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.245306 32149 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:19.252305 32151 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:19.277369 32151 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.278369 32151 tablet_bootstrap.cc:492] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:19.279068 32151 ts_tablet_manager.cc:1403] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.010s
I20260709 12:23:19.282255 32151 raft_consensus.cc:359] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:19.283070 32151 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:19.283747 32151 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:19.290518 32149 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.291534 32149 tablet_bootstrap.cc:492] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:19.294394 32149 ts_tablet_manager.cc:1403] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.008s
I20260709 12:23:19.297516 32149 raft_consensus.cc:359] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:19.298787 32149 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:19.299472 32149 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:19.302620 32151 ts_tablet_manager.cc:1434] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 12:23:19.309018 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-1fc04eb7c849448bba0b8d22faf8751a received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:19.309492 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-1fc04eb7c849448bba0b8d22faf8751a on tablet 1fc04eb7c849448bba0b8d22faf8751a with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:19.320281 32149 ts_tablet_manager.cc:1434] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.010s
I20260709 12:23:19.322067 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-0f0ffee11de74139a74b497dea5ab8fc received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:19.322485 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-0f0ffee11de74139a74b497dea5ab8fc on tablet 0f0ffee11de74139a74b497dea5ab8fc with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:19.347129 32149 ts_tablet_manager.cc:933] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:19.349694 32149 tablet_copy_client.cc:323] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:19.361124 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet dbf61ba8f0cc44ee87136dd991354c89 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:19.361697 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet dbf61ba8f0cc44ee87136dd991354c89 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-dbf61ba8f0cc44ee87136dd991354c89
I20260709 12:23:19.369040 31554 tablet_copy_source_session.cc:215] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.372207 32149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf61ba8f0cc44ee87136dd991354c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.385927 32149 tablet_copy_client.cc:806] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.386512 32149 tablet_copy_client.cc:670] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.390337 32149 tablet_copy_client.cc:538] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.396552 32149 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:19.413295 32149 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.414161 32149 tablet_bootstrap.cc:492] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:19.414788 32149 ts_tablet_manager.cc:1403] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 12:23:19.417402 32149 raft_consensus.cc:359] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:19.418181 32149 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:19.418787 32149 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:19.420668 32149 ts_tablet_manager.cc:1434] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:19.423357 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-dbf61ba8f0cc44ee87136dd991354c89 received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:19.423775 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-dbf61ba8f0cc44ee87136dd991354c89 on tablet dbf61ba8f0cc44ee87136dd991354c89 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:19.500799 32149 ts_tablet_manager.cc:933] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:19.502724 32149 tablet_copy_client.cc:323] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:23:19.515884 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet 4ede0de141bd4d8aafecf4cc1902f9f3 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:23:19.516439 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet 4ede0de141bd4d8aafecf4cc1902f9f3 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-4ede0de141bd4d8aafecf4cc1902f9f3
I20260709 12:23:19.523746 31480 tablet_copy_source_session.cc:215] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.526646 32149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ede0de141bd4d8aafecf4cc1902f9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.542799 32149 tablet_copy_client.cc:806] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.543363 32149 tablet_copy_client.cc:670] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.548159 32149 tablet_copy_client.cc:538] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.554173 32149 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:19.569872 32149 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.570744 32149 tablet_bootstrap.cc:492] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:19.572244 32149 ts_tablet_manager.cc:1403] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.005s
I20260709 12:23:19.574673 32149 raft_consensus.cc:359] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:19.575416 32149 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:19.576005 32149 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:23:19.583572 31324 debug-util.cc:398] Leaking SignalData structure 0x7b0800034b80 after lost signal to thread 30226
W20260709 12:23:19.642607 31324 debug-util.cc:398] Leaking SignalData structure 0x7b080008b920 after lost signal to thread 31327
I20260709 12:23:19.644855 32149 ts_tablet_manager.cc:1434] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.072s	user 0.010s	sys 0.026s
I20260709 12:23:19.664556 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-4ede0de141bd4d8aafecf4cc1902f9f3 received from {username='slave'} at 127.0.0.1:48410
I20260709 12:23:19.665056 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-4ede0de141bd4d8aafecf4cc1902f9f3 on tablet 4ede0de141bd4d8aafecf4cc1902f9f3 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:19.705379 32084 raft_consensus.cc:1217] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:19.746925 32084 raft_consensus.cc:1217] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:19.921104 32084 raft_consensus.cc:1217] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:20.073675 32084 raft_consensus.cc:1217] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:20.100595 32166 raft_consensus.cc:1064] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:20.103575 32166 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:20.119491 31542 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.121160 31464 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.121492 32084 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.122601 32166 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.159981 32168 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.161334 32167 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.186566 32168 raft_consensus.cc:1064] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:20.189332 32168 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:20.207707 32167 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.211782 31464 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.212337 31542 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.221716 32084 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.230739 31290 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.243825 32083 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.244967 31542 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.247311 31466 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.250350 32166 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.253216 32167 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.283650 32167 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.302213 32166 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.305282 32084 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.345137 31538 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.350915 31465 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.373736 31389 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:20.382426 31289 catalog_manager.cc:5697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.400313 32084 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.401808 32168 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.408402 31542 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.410418 32168 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.413192 32116 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.413003 31390 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:20.418336 32084 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.417338 31538 raft_consensus.cc:2955] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.422986 32083 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.424450 32166 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.426970 31465 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.434810 32167 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.434561 32116 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.441977 31465 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.444118 32082 raft_consensus.cc:2955] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.450199 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f0ffee11de74139a74b497dea5ab8fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:20.454052 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fc04eb7c849448bba0b8d22faf8751a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:20.447006 32113 raft_consensus.cc:1064] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:20.456861 32113 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:20.457449 31289 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.471575 31453 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fc04eb7c849448bba0b8d22faf8751a with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
I20260709 12:23:20.478114 32190 tablet_replica.cc:333] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:20.480160 32190 raft_consensus.cc:2243] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.482625 32190 raft_consensus.cc:2272] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.491472 31289 catalog_manager.cc:5697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.497660 32190 ts_tablet_manager.cc:1916] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:20.507943 32082 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.509923 32186 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.513229 31463 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.515450 32114 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.525444 32190 ts_tablet_manager.cc:1929] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:20.525794 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f0ffee11de74139a74b497dea5ab8fc with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:20.525972 32190 log.cc:1199] T 1fc04eb7c849448bba0b8d22faf8751a P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/1fc04eb7c849448bba0b8d22faf8751a
I20260709 12:23:20.541025 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet 1fc04eb7c849448bba0b8d22faf8751a (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:20.573100 31390 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.631050 32192 tablet_replica.cc:333] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:20.652561 32170 raft_consensus.cc:1064] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:20.655207 32170 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:20.668224 32113 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.689317 32114 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.695582 32082 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.735773 32192 raft_consensus.cc:2243] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.736685 32192 raft_consensus.cc:2272] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.740607 32192 ts_tablet_manager.cc:1916] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:20.747327 32084 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.754361 32117 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.775501 31290 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.783998 31538 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.789309 32172 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:20.812837 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 53305.7us
I20260709 12:23:20.817481 31390 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.825191 31391 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.848560 31465 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:23:20.853266 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 46096.5us
I20260709 12:23:20.874969 32196 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:23:20.900246 31538 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:20.906854 32192 ts_tablet_manager.cc:1929] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:20.907379 32192 log.cc:1199] T 0f0ffee11de74139a74b497dea5ab8fc P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/0f0ffee11de74139a74b497dea5ab8fc
I20260709 12:23:20.920138 32082 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.915493 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet 0f0ffee11de74139a74b497dea5ab8fc (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:20.920555 32173 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.922297 32113 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.925408 31465 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.927117 32199 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:20.930809 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 59468.2us
I20260709 12:23:20.939671 32199 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.947964 32084 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.952200 31538 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.955928 31464 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.954802 31289 catalog_manager.cc:5697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.946015 32082 raft_consensus.cc:2955] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:20.972174 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbf61ba8f0cc44ee87136dd991354c89 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:21.011740 31290 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.018880 31391 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:21.043435 31379 tablet_service.cc:1558] Processing DeleteTablet for tablet dbf61ba8f0cc44ee87136dd991354c89 with delete_type TABLET_DATA_TOMBSTONED (TS 503bef451a2b424fa35e8e46b8c06f29 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56506
I20260709 12:23:21.061053 32205 tablet_replica.cc:333] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:23:21.062166 32205 raft_consensus.cc:2243] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:21.066495 32205 raft_consensus.cc:2272] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:21.066910 31465 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:21.073477 32082 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:21.074414 31389 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:21.075923 32173 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:21.076841 32203 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:21.086009 32173 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:21.091775 32082 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:21.104193 31289 catalog_manager.cc:5697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:21.106814 32205 ts_tablet_manager.cc:1916] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:21.111809 31389 raft_consensus.cc:2955] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:21.115387 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ede0de141bd4d8aafecf4cc1902f9f3 with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:21.116317 32192 tablet_replica.cc:333] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:21.117282 32192 raft_consensus.cc:2243] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:21.117945 32192 raft_consensus.cc:2272] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:21.121508 32192 ts_tablet_manager.cc:1916] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:21.135150 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ede0de141bd4d8aafecf4cc1902f9f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:21.187688 32192 ts_tablet_manager.cc:1929] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:21.188280 32192 log.cc:1199] T 4ede0de141bd4d8aafecf4cc1902f9f3 P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/4ede0de141bd4d8aafecf4cc1902f9f3
I20260709 12:23:21.189966 32205 ts_tablet_manager.cc:1929] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:21.190197 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet 4ede0de141bd4d8aafecf4cc1902f9f3 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:21.190486 32205 log.cc:1199] T dbf61ba8f0cc44ee87136dd991354c89 P 503bef451a2b424fa35e8e46b8c06f29: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/wals/dbf61ba8f0cc44ee87136dd991354c89
I20260709 12:23:21.192148 31277 catalog_manager.cc:5028] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): tablet dbf61ba8f0cc44ee87136dd991354c89 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:22.205363 31464 consensus_queue.cc:237] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:23:22.221022 31436 consensus_peers.cc:597] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 720e43702af64bf89bc425bfd0ad352e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.222079 31391 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.227559 32173 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.233150 31538 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.234562 32173 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.241689 32173 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.243875 31391 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.249648 31538 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.259028 31542 consensus_queue.cc:237] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:22.262449 31289 catalog_manager.cc:5697] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
W20260709 12:23:22.288264 31510 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcbeeb8bf3c34f9fad2c9e7cfc641146. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.289724 31391 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.289700 31465 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.292052 32201 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.292796 32208 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.307732 32199 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.309512 31465 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.319152 31391 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.328631 31538 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:22.346125 31290 catalog_manager.cc:5697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.356843 31465 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:22.357558 31510 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a937a8e153c40d396843c808354fb5b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.358745 32218 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.371955 31391 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.373528 32218 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:22.377880 32208 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.379282 31465 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.405107 31289 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.423725 31389 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.433326 31391 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:23:22.452837 31361 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 069da3737bb54ce19c27f8dcaa7fdf87. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.454589 31542 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.456619 32206 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.456611 31465 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.458436 32116 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.468194 32206 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.472218 31463 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.480099 31542 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:22.486532 31292 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.749521 32225 ts_tablet_manager.cc:933] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:22.761405 32225 tablet_copy_client.cc:323] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:23:22.763141 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet 720e43702af64bf89bc425bfd0ad352e from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:23:22.763720 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet 720e43702af64bf89bc425bfd0ad352e from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-720e43702af64bf89bc425bfd0ad352e
I20260709 12:23:22.786494 31480 tablet_copy_source_session.cc:215] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:22.791280 32225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720e43702af64bf89bc425bfd0ad352e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.813162 32225 tablet_copy_client.cc:806] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:22.815845 32225 tablet_copy_client.cc:670] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:22.823336 32225 tablet_copy_client.cc:538] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:22.834873 32225 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:22.879616 32225 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.880671 32225 tablet_bootstrap.cc:492] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:22.881418 32225 ts_tablet_manager.cc:1403] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.016s
I20260709 12:23:22.885650 32225 raft_consensus.cc:359] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:22.886606 32225 raft_consensus.cc:740] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:22.887387 32225 consensus_queue.cc:260] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:22.897905 32225 ts_tablet_manager.cc:1434] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 12:23:22.912743 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-720e43702af64bf89bc425bfd0ad352e received from {username='slave'} at 127.0.0.1:48410
I20260709 12:23:22.913213 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-720e43702af64bf89bc425bfd0ad352e on tablet 720e43702af64bf89bc425bfd0ad352e with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:22.927328 32225 ts_tablet_manager.cc:933] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:22.929497 32225 tablet_copy_client.cc:323] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:22.931849 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:22.932404 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-fcbeeb8bf3c34f9fad2c9e7cfc641146
I20260709 12:23:22.943779 31554 tablet_copy_source_session.cc:215] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:22.948040 32225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.949185 32228 ts_tablet_manager.cc:933] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:22.988651 32233 ts_tablet_manager.cc:933] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:23.005812 32233 tablet_copy_client.cc:323] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:23.006500 32228 tablet_copy_client.cc:323] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:23.007768 31404 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet 069da3737bb54ce19c27f8dcaa7fdf87 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:23.008317 31404 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet 069da3737bb54ce19c27f8dcaa7fdf87 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-069da3737bb54ce19c27f8dcaa7fdf87
I20260709 12:23:23.008474 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet 1a937a8e153c40d396843c808354fb5b from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:23.008975 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet 1a937a8e153c40d396843c808354fb5b from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-1a937a8e153c40d396843c808354fb5b
I20260709 12:23:23.015446 31404 tablet_copy_source_session.cc:215] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:23.019070 32233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069da3737bb54ce19c27f8dcaa7fdf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.025496 31554 tablet_copy_source_session.cc:215] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:23.032143 32228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a937a8e153c40d396843c808354fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.035058 32233 tablet_copy_client.cc:806] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:23.035701 32233 tablet_copy_client.cc:670] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:23.039288 32225 tablet_copy_client.cc:806] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:23.040123 32225 tablet_copy_client.cc:670] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:23.039647 32233 tablet_copy_client.cc:538] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:23.050673 32233 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:23.051301 32225 tablet_copy_client.cc:538] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:23.051980 32228 tablet_copy_client.cc:806] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:23.052505 32228 tablet_copy_client.cc:670] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:23.057319 32228 tablet_copy_client.cc:538] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:23.060752 32225 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:23.068151 32228 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:23.097289 32233 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.098181 32233 tablet_bootstrap.cc:492] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:23.098822 32233 ts_tablet_manager.cc:1403] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.019s
I20260709 12:23:23.103335 32233 raft_consensus.cc:359] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:23.104192 32233 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:23.104830 32233 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:23.107087 32233 ts_tablet_manager.cc:1434] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:23:23.115450 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-069da3737bb54ce19c27f8dcaa7fdf87 received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:23.115849 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-069da3737bb54ce19c27f8dcaa7fdf87 on tablet 069da3737bb54ce19c27f8dcaa7fdf87 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:23.163916 32082 raft_consensus.cc:1217] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:23.229000 32228 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.230280 32228 tablet_bootstrap.cc:492] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:23.231125 32228 ts_tablet_manager.cc:1403] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.163s	user 0.043s	sys 0.083s
I20260709 12:23:23.234488 32228 raft_consensus.cc:359] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:23.235510 32228 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:23.236310 32228 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:23.239420 32228 ts_tablet_manager.cc:1434] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:23:23.254382 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-1a937a8e153c40d396843c808354fb5b received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:23.254895 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-1a937a8e153c40d396843c808354fb5b on tablet 1a937a8e153c40d396843c808354fb5b with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:23.293048 32225 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.294227 32225 tablet_bootstrap.cc:492] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:23.295117 32225 ts_tablet_manager.cc:1403] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.235s	user 0.026s	sys 0.018s
I20260709 12:23:23.298563 32225 raft_consensus.cc:359] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:23.299600 32225 raft_consensus.cc:740] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:23.300420 32225 consensus_queue.cc:260] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:23.303503 32225 ts_tablet_manager.cc:1434] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:23.305320 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-fcbeeb8bf3c34f9fad2c9e7cfc641146 received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:23.305780 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-fcbeeb8bf3c34f9fad2c9e7cfc641146 on tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:23.360167 32082 raft_consensus.cc:1217] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:23.522569 32082 raft_consensus.cc:1217] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:23.548851 32082 raft_consensus.cc:1217] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:23.616982 32173 raft_consensus.cc:1064] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:23.619176 32173 consensus_queue.cc:237] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:23.629204 31543 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.629616 32082 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.632141 31389 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.631093 32173 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:23:23.634254 32235 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.635118 32203 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:23.662017 31391 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.660550 32173 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.678052 31538 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.698246 32082 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.714855 31292 catalog_manager.cc:5697] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.762391 31464 consensus_queue.cc:237] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:23.770859 31543 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.772472 32173 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:23.776077 32082 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:23.783599 32203 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.790059 32235 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:23.793268 31543 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.813805 32082 raft_consensus.cc:2955] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.820744 31289 catalog_manager.cc:5697] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:23.826205 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 720e43702af64bf89bc425bfd0ad352e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:23.837689 31379 tablet_service.cc:1558] Processing DeleteTablet for tablet 720e43702af64bf89bc425bfd0ad352e with delete_type TABLET_DATA_TOMBSTONED (TS 503bef451a2b424fa35e8e46b8c06f29 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56506
I20260709 12:23:23.871675 32248 tablet_replica.cc:333] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:23:23.881608 32248 raft_consensus.cc:2243] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:23.882920 32248 raft_consensus.cc:2272] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:23.886226 32248 ts_tablet_manager.cc:1916] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:23.978420 32206 raft_consensus.cc:1064] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:23.982760 32206 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:24.018155 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 51989.5us
I20260709 12:23:24.030835 32248 ts_tablet_manager.cc:1929] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:24.032837 32248 log.cc:1199] T 720e43702af64bf89bc425bfd0ad352e P 503bef451a2b424fa35e8e46b8c06f29: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/wals/720e43702af64bf89bc425bfd0ad352e
I20260709 12:23:24.035122 31277 catalog_manager.cc:5028] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): tablet 720e43702af64bf89bc425bfd0ad352e (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:24.053658 32251 raft_consensus.cc:1064] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:24.053833 32218 raft_consensus.cc:1064] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:24.059677 32218 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:24.057744 32251 consensus_queue.cc:237] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:24.078469 32082 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.079111 31543 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.080545 32166 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:24.083940 31463 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.084887 32166 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:24.088428 32166 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:24.179945 32084 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.191712 32201 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:24.210067 31388 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.214526 32083 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.222361 32201 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:24.229502 31390 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.243599 32252 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:24.261307 31464 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.284257 32166 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.287700 31466 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:24.296407 32082 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:23:24.300227 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 60077.4us
I20260709 12:23:24.307821 31543 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.320015 31289 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:24.326355 32263 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:24.338702 32252 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:24.328984 31467 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.350809 32208 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:24.427505 32263 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.433863 31389 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.437930 31465 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:23:24.445699 32265 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:23:24.455416 32218 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.519634 31465 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.539455 32083 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.556322 32082 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.576815 31391 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.591367 31292 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.600097 31292 catalog_manager.cc:5697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.644383 31391 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:24.649734 32082 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:24.650665 31465 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:24.651459 32253 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.652545 32230 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:24.658587 31544 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:24.651068 31543 consensus_queue.cc:237] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:24.667615 32082 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:24.668278 32166 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.670318 31463 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.671880 32082 raft_consensus.cc:2955] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.672842 32201 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.686322 32273 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.692792 31290 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.698439 32082 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.717223 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet 069da3737bb54ce19c27f8dcaa7fdf87 with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:24.721710 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:24.732702 31391 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:24.733824 32083 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:24.735600 32273 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.736200 32263 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.736693 31290 catalog_manager.cc:5697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:24.745955 31389 raft_consensus.cc:2955] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.746587 32274 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.755474 32275 tablet_replica.cc:333] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:24.763463 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 069da3737bb54ce19c27f8dcaa7fdf87 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:24.763939 32082 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.780435 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a937a8e153c40d396843c808354fb5b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:24.786880 32275 raft_consensus.cc:2243] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:24.787952 32275 raft_consensus.cc:2272] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:24.795598 32275 ts_tablet_manager.cc:1916] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:24.800014 31453 tablet_service.cc:1558] Processing DeleteTablet for tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
I20260709 12:23:24.800979 31391 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:24.821408 31291 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.828344 32263 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.841102 31458 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a937a8e153c40d396843c808354fb5b with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
I20260709 12:23:24.843760 31389 raft_consensus.cc:2955] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:24.883459 32276 tablet_replica.cc:333] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:24.885039 32276 raft_consensus.cc:2243] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:24.886487 32276 raft_consensus.cc:2272] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:24.885614 32275 ts_tablet_manager.cc:1929] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:24.887451 32275 log.cc:1199] T 069da3737bb54ce19c27f8dcaa7fdf87 P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/069da3737bb54ce19c27f8dcaa7fdf87
I20260709 12:23:24.894381 32276 ts_tablet_manager.cc:1916] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:24.894637 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet 069da3737bb54ce19c27f8dcaa7fdf87 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:24.910231 32276 ts_tablet_manager.cc:1929] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:24.910775 32276 log.cc:1199] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/fcbeeb8bf3c34f9fad2c9e7cfc641146
I20260709 12:23:24.912659 32276 tablet_replica.cc:333] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:24.913784 32276 raft_consensus.cc:2243] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:24.914647 32276 raft_consensus.cc:2272] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:24.915518 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet fcbeeb8bf3c34f9fad2c9e7cfc641146 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:24.918890 32276 ts_tablet_manager.cc:1916] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:24.933745 32276 ts_tablet_manager.cc:1929] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:24.934065 32276 log.cc:1199] T 1a937a8e153c40d396843c808354fb5b P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/1a937a8e153c40d396843c808354fb5b
I20260709 12:23:24.935473 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet 1a937a8e153c40d396843c808354fb5b (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:25.948110 31469 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:25.955062 31389 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:25.955304 31544 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:25.956439 31436 consensus_peers.cc:597] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d43fc3cfb135493da75cf9bdc7debaa9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.956293 32277 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:25.958211 32235 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:25.966178 32235 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:25.969091 31389 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:25.973759 31544 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:25.985723 31290 catalog_manager.cc:5697] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.989467 31543 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:23:25.997535 31510 consensus_peers.cc:597] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6b935bf4ae0467a9564dbd51820ce7c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.997949 31389 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:25.999203 31469 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:25.999475 32263 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:26.002251 32263 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.010571 32263 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.032902 31389 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.038713 31469 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.050596 31391 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.052598 31289 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:26.063632 31361 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18ce134725c84d9782a48f1b1cb859c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.070930 31543 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:26.072425 32230 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.072633 31469 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:26.073855 32278 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.080289 32253 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.082425 31544 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.083024 31469 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.097107 31463 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.097513 31290 catalog_manager.cc:5697] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
W20260709 12:23:26.111310 31436 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c4c1a36e3964960952aee6245d4560e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.112068 31391 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:26.114282 32280 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.116232 31544 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:26.118760 32280 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.129033 32283 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.132529 31542 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.156701 31291 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.157655 31391 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:26.508718 32299 ts_tablet_manager.cc:933] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:26.512485 32299 tablet_copy_client.cc:323] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:23:26.514691 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet d43fc3cfb135493da75cf9bdc7debaa9 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:23:26.515275 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet d43fc3cfb135493da75cf9bdc7debaa9 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-d43fc3cfb135493da75cf9bdc7debaa9
I20260709 12:23:26.522746 31480 tablet_copy_source_session.cc:215] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:26.525604 32299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43fc3cfb135493da75cf9bdc7debaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:26.538825 32299 tablet_copy_client.cc:806] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:26.539422 32299 tablet_copy_client.cc:670] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:26.543071 32299 tablet_copy_client.cc:538] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:26.549755 32299 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:26.558100 32301 ts_tablet_manager.cc:933] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:26.560524 32301 tablet_copy_client.cc:323] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:26.570034 32299 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:26.571097 32299 tablet_bootstrap.cc:492] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:26.571866 32299 ts_tablet_manager.cc:1403] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.011s
I20260709 12:23:26.573551 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet a6b935bf4ae0467a9564dbd51820ce7c from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:26.574112 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet a6b935bf4ae0467a9564dbd51820ce7c from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-a6b935bf4ae0467a9564dbd51820ce7c
I20260709 12:23:26.576574 32299 raft_consensus.cc:359] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.577392 32299 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:26.578030 32299 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.592224 32304 ts_tablet_manager.cc:933] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:26.593327 31554 tablet_copy_source_session.cc:215] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:26.603662 32301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b935bf4ae0467a9564dbd51820ce7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:26.691485 32299 ts_tablet_manager.cc:1434] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.119s	user 0.034s	sys 0.042s
I20260709 12:23:26.694053 32301 tablet_copy_client.cc:806] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:26.694197 32304 tablet_copy_client.cc:323] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:26.694793 32301 tablet_copy_client.cc:670] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:26.697167 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-d43fc3cfb135493da75cf9bdc7debaa9 received from {username='slave'} at 127.0.0.1:48410
I20260709 12:23:26.697662 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-d43fc3cfb135493da75cf9bdc7debaa9 on tablet d43fc3cfb135493da75cf9bdc7debaa9 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:26.700752 31404 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet 18ce134725c84d9782a48f1b1cb859c0 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:26.701411 31404 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet 18ce134725c84d9782a48f1b1cb859c0 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-18ce134725c84d9782a48f1b1cb859c0
I20260709 12:23:26.702895 32301 tablet_copy_client.cc:538] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:26.709893 32299 ts_tablet_manager.cc:933] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:26.714373 31404 tablet_copy_source_session.cc:215] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:26.719748 32299 tablet_copy_client.cc:323] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:23:26.720830 32301 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:26.721544 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet 6c4c1a36e3964960952aee6245d4560e from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:23:26.721805 32304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ce134725c84d9782a48f1b1cb859c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:26.722098 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet 6c4c1a36e3964960952aee6245d4560e from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-6c4c1a36e3964960952aee6245d4560e
I20260709 12:23:26.729681 31480 tablet_copy_source_session.cc:215] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:26.736629 32299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4c1a36e3964960952aee6245d4560e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:26.771776 32304 tablet_copy_client.cc:806] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:26.772451 32304 tablet_copy_client.cc:670] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:26.775338 32299 tablet_copy_client.cc:806] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:26.777509 32304 tablet_copy_client.cc:538] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:26.777652 32299 tablet_copy_client.cc:670] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:26.781957 32299 tablet_copy_client.cc:538] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:26.792567 32301 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:26.794142 32301 tablet_bootstrap.cc:492] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:26.794955 32301 ts_tablet_manager.cc:1403] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.074s	user 0.031s	sys 0.023s
I20260709 12:23:26.800976 32299 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:26.800645 32301 raft_consensus.cc:359] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.794948 32304 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:26.802011 32301 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:26.802778 32301 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.808074 32301 ts_tablet_manager.cc:1434] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 12:23:26.812781 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-a6b935bf4ae0467a9564dbd51820ce7c received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:26.814004 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-a6b935bf4ae0467a9564dbd51820ce7c on tablet a6b935bf4ae0467a9564dbd51820ce7c with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:26.846009 32299 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:26.847465 32299 tablet_bootstrap.cc:492] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:26.848304 32299 ts_tablet_manager.cc:1403] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.003s
I20260709 12:23:26.852000 32299 raft_consensus.cc:359] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.853045 32299 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:26.853819 32299 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.856777 32299 ts_tablet_manager.cc:1434] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:23:26.859858 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-6c4c1a36e3964960952aee6245d4560e received from {username='slave'} at 127.0.0.1:48410
I20260709 12:23:26.860252 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-6c4c1a36e3964960952aee6245d4560e on tablet 6c4c1a36e3964960952aee6245d4560e with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:26.855182 32304 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:26.864243 32304 tablet_bootstrap.cc:492] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:26.865041 32304 ts_tablet_manager.cc:1403] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.007s
I20260709 12:23:26.870671 32304 raft_consensus.cc:359] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.871791 32304 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:26.872577 32304 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:26.874751 32304 ts_tablet_manager.cc:1434] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:23:26.876546 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-18ce134725c84d9782a48f1b1cb859c0 received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:26.877058 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-18ce134725c84d9782a48f1b1cb859c0 on tablet 18ce134725c84d9782a48f1b1cb859c0 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:27.041847 32083 raft_consensus.cc:1217] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:27.073216 32083 raft_consensus.cc:1217] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:27.142607 32083 raft_consensus.cc:1217] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:27.217029 32083 raft_consensus.cc:1217] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:27.514798 32253 raft_consensus.cc:1064] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:27.517604 32253 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:27.528095 31544 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.528646 32083 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.530359 32230 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.533639 31465 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.535254 32230 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:27.546197 32315 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.554241 32312 raft_consensus.cc:1064] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:27.556972 32312 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:27.561540 32285 raft_consensus.cc:1064] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:27.564281 32285 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:27.569391 31463 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.576822 32082 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.578167 32280 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.578576 31390 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.579098 31542 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.580425 32280 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.581423 32313 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.595829 31291 catalog_manager.cc:5697] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.567574 32315 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.637176 32235 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.642055 32082 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.650000 31391 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.660893 32082 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.662317 32273 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.666785 31469 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.668344 32273 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.674104 31543 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.691983 31389 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.707381 31289 catalog_manager.cc:5697] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.711680 32328 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.713032 31463 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.723330 32273 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.728645 32083 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.733470 32082 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.744268 31389 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.749858 31543 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.776156 31290 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.792405 31543 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:27.795032 31389 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:27.799642 32082 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.804643 32328 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.803002 31463 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:27.805634 31544 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.809262 31469 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.810951 32082 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.814020 32285 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.815111 32082 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.820066 32253 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.821230 31543 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:27.821662 32253 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:23:27.824198 32235 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.826769 32273 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.831740 32235 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.842432 31544 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.843542 32283 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.845316 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6b935bf4ae0467a9564dbd51820ce7c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:27.850414 31542 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.852856 32323 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.837960 32083 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.862687 31290 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.863013 32082 raft_consensus.cc:2955] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.869246 32312 raft_consensus.cc:1064] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:27.872299 32312 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:27.870625 32084 raft_consensus.cc:2955] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.877802 31379 tablet_service.cc:1558] Processing DeleteTablet for tablet a6b935bf4ae0467a9564dbd51820ce7c with delete_type TABLET_DATA_TOMBSTONED (TS 503bef451a2b424fa35e8e46b8c06f29 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56506
I20260709 12:23:27.889909 31463 raft_consensus.cc:2955] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.894814 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d43fc3cfb135493da75cf9bdc7debaa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:27.895638 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18ce134725c84d9782a48f1b1cb859c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:27.904774 32081 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.905650 31292 catalog_manager.cc:5697] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.906644 31389 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.906956 32313 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.908998 31544 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:27.912122 32313 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.913651 31290 catalog_manager.cc:5697] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.916429 32312 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.924621 31453 tablet_service.cc:1558] Processing DeleteTablet for tablet 18ce134725c84d9782a48f1b1cb859c0 with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
I20260709 12:23:27.937034 32337 tablet_replica.cc:333] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:23:27.943557 32341 tablet_replica.cc:333] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:27.944664 32341 raft_consensus.cc:2243] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.944295 32280 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.945511 32341 raft_consensus.cc:2272] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.945964 32081 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.949967 31379 tablet_service.cc:1558] Processing DeleteTablet for tablet d43fc3cfb135493da75cf9bdc7debaa9 with delete_type TABLET_DATA_TOMBSTONED (TS 503bef451a2b424fa35e8e46b8c06f29 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56506
I20260709 12:23:27.976655 31544 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.988951 32341 ts_tablet_manager.cc:1916] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:27.995783 32337 raft_consensus.cc:2243] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.001681 32337 raft_consensus.cc:2272] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.005960 32337 ts_tablet_manager.cc:1916] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:28.005275 31389 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:27.997551 31290 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.030117 32341 ts_tablet_manager.cc:1929] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:28.030660 32341 log.cc:1199] T 18ce134725c84d9782a48f1b1cb859c0 P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/18ce134725c84d9782a48f1b1cb859c0
I20260709 12:23:28.032330 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet 18ce134725c84d9782a48f1b1cb859c0 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:28.043488 32337 ts_tablet_manager.cc:1929] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:28.044025 32337 log.cc:1199] T a6b935bf4ae0467a9564dbd51820ce7c P 503bef451a2b424fa35e8e46b8c06f29: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/wals/a6b935bf4ae0467a9564dbd51820ce7c
I20260709 12:23:28.045982 32337 tablet_replica.cc:333] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:23:28.045922 31277 catalog_manager.cc:5028] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): tablet a6b935bf4ae0467a9564dbd51820ce7c (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:28.047356 32337 raft_consensus.cc:2243] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.048298 32337 raft_consensus.cc:2272] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.055090 32337 ts_tablet_manager.cc:1916] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:28.054731 31469 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:28.063200 32081 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:28.065054 32280 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:28.070406 31391 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:28.071779 32313 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:28.072551 32337 ts_tablet_manager.cc:1929] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:28.072960 32337 log.cc:1199] T d43fc3cfb135493da75cf9bdc7debaa9 P 503bef451a2b424fa35e8e46b8c06f29: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/wals/d43fc3cfb135493da75cf9bdc7debaa9
I20260709 12:23:28.074532 32283 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:28.075125 31277 catalog_manager.cc:5028] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): tablet d43fc3cfb135493da75cf9bdc7debaa9 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:28.077266 32081 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:28.089664 31391 raft_consensus.cc:2955] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:28.092935 31289 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:28.096120 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c4c1a36e3964960952aee6245d4560e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:28.105857 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c4c1a36e3964960952aee6245d4560e with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:28.116487 32342 tablet_replica.cc:333] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:28.118678 32342 raft_consensus.cc:2243] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.120282 32342 raft_consensus.cc:2272] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.123477 32342 ts_tablet_manager.cc:1916] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:28.136236 32342 ts_tablet_manager.cc:1929] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:28.136644 32342 log.cc:1199] T 6c4c1a36e3964960952aee6245d4560e P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/6c4c1a36e3964960952aee6245d4560e
I20260709 12:23:28.137814 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet 6c4c1a36e3964960952aee6245d4560e (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:29.171700 31391 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.178587 31542 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:29.180197 31469 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:29.180764 32344 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:29.183353 32344 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:29.184496 31361 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0db923f6154349d3ba9a88713b04d088. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.190106 32253 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.191985 31544 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.194619 31463 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.204850 31391 consensus_queue.cc:237] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.207106 31289 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:29.218034 31361 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a413d9092d14aea9490265eb7f932db. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.219954 31463 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:29.221016 32315 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:29.223459 31542 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:29.225412 32253 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:29.232051 32315 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.235034 31463 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.240787 31542 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.246631 31469 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:23:29.257839 31436 consensus_peers.cc:597] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5eaea245d9414f42b05616da46574eb4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.260396 31541 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:29.260792 31391 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:29.261961 32283 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:29.261360 31292 catalog_manager.cc:5697] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.264288 32313 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:29.280743 32283 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.282068 31542 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.285418 31391 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.295819 31389 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.297542 31289 catalog_manager.cc:5697] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
W20260709 12:23:29.321249 31361 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a542644bc5014371a0403670d46545d9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.322207 31542 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:29.323984 32253 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:29.324281 31469 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:29.325686 32315 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:29.334172 32344 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.335667 31542 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.335850 31469 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.350134 31292 catalog_manager.cc:5697] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:29.661549 32363 ts_tablet_manager.cc:933] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:29.668608 32363 tablet_copy_client.cc:323] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:29.670323 31404 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet 5a413d9092d14aea9490265eb7f932db from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:29.670866 31404 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet 5a413d9092d14aea9490265eb7f932db from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-5a413d9092d14aea9490265eb7f932db
I20260709 12:23:29.677701 31404 tablet_copy_source_session.cc:215] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:29.686964 32363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a413d9092d14aea9490265eb7f932db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.694166 32365 ts_tablet_manager.cc:933] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:29.699646 32365 tablet_copy_client.cc:323] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:29.701288 31404 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet 0db923f6154349d3ba9a88713b04d088 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:29.701838 31404 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet 0db923f6154349d3ba9a88713b04d088 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-0db923f6154349d3ba9a88713b04d088
I20260709 12:23:29.702615 32363 tablet_copy_client.cc:806] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.703202 32363 tablet_copy_client.cc:670] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.707710 31404 tablet_copy_source_session.cc:215] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:29.709878 32363 tablet_copy_client.cc:538] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.718281 32363 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:29.724159 32365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db923f6154349d3ba9a88713b04d088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.742511 32365 tablet_copy_client.cc:806] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.743055 32365 tablet_copy_client.cc:670] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.746174 32363 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:29.746771 32365 tablet_copy_client.cc:538] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.747120 32363 tablet_bootstrap.cc:492] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:29.748317 32363 ts_tablet_manager.cc:1403] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.003s
I20260709 12:23:29.751271 32363 raft_consensus.cc:359] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.752101 32363 raft_consensus.cc:740] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:29.752754 32363 consensus_queue.cc:260] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.755811 32365 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:29.807781 32371 ts_tablet_manager.cc:933] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:29.811988 32369 ts_tablet_manager.cc:933] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:29.815614 32369 tablet_copy_client.cc:323] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:29.817994 32363 ts_tablet_manager.cc:1434] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.069s	user 0.035s	sys 0.027s
I20260709 12:23:29.818933 32371 tablet_copy_client.cc:323] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:23:29.819164 31404 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet a542644bc5014371a0403670d46545d9 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:29.819778 31404 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet a542644bc5014371a0403670d46545d9 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-a542644bc5014371a0403670d46545d9
I20260709 12:23:29.820729 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet 5eaea245d9414f42b05616da46574eb4 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:23:29.821305 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet 5eaea245d9414f42b05616da46574eb4 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-5eaea245d9414f42b05616da46574eb4
I20260709 12:23:29.827703 31404 tablet_copy_source_session.cc:215] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:29.830951 32365 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:29.833038 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-5a413d9092d14aea9490265eb7f932db received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:29.833491 32365 tablet_bootstrap.cc:492] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:29.833570 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-5a413d9092d14aea9490265eb7f932db on tablet 5a413d9092d14aea9490265eb7f932db with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:29.834301 32365 ts_tablet_manager.cc:1403] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.079s	user 0.050s	sys 0.009s
I20260709 12:23:29.834880 32369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a542644bc5014371a0403670d46545d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.837355 32365 raft_consensus.cc:359] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.838104 32365 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:29.838791 32365 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.841099 31480 tablet_copy_source_session.cc:215] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:29.844714 32371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eaea245d9414f42b05616da46574eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.860102 32365 ts_tablet_manager.cc:1434] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260709 12:23:29.868758 32371 tablet_copy_client.cc:806] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.869383 32371 tablet_copy_client.cc:670] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.870790 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-0db923f6154349d3ba9a88713b04d088 received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:29.871218 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-0db923f6154349d3ba9a88713b04d088 on tablet 0db923f6154349d3ba9a88713b04d088 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:29.875780 32369 tablet_copy_client.cc:806] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.876466 32369 tablet_copy_client.cc:670] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.885875 32369 tablet_copy_client.cc:538] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.886052 32371 tablet_copy_client.cc:538] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.895826 32371 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:29.905603 32369 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:29.919711 32371 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:29.920599 32371 tablet_bootstrap.cc:492] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:29.921245 32371 ts_tablet_manager.cc:1403] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.011s
I20260709 12:23:29.924141 32371 raft_consensus.cc:359] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.924962 32371 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:29.925793 32371 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.928507 32371 ts_tablet_manager.cc:1434] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:23:29.930446 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-5eaea245d9414f42b05616da46574eb4 received from {username='slave'} at 127.0.0.1:48410
I20260709 12:23:29.930862 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-5eaea245d9414f42b05616da46574eb4 on tablet 5eaea245d9414f42b05616da46574eb4 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:29.933223 32369 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:29.934106 32369 tablet_bootstrap.cc:492] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:29.934732 32369 ts_tablet_manager.cc:1403] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 12:23:29.938818 32369 raft_consensus.cc:359] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.940691 32369 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:29.941326 32369 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:29.943758 32369 ts_tablet_manager.cc:1434] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:29.945549 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-a542644bc5014371a0403670d46545d9 received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:29.945950 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-a542644bc5014371a0403670d46545d9 on tablet a542644bc5014371a0403670d46545d9 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:30.162674 32082 raft_consensus.cc:1217] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:30.262171 32082 raft_consensus.cc:1217] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:23:30.283310 32082 raft_consensus.cc:1217] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:30.324419 32082 raft_consensus.cc:1217] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:30.693194 32315 raft_consensus.cc:1064] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:30.695312 32315 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:30.712392 31542 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:30.714874 32344 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.717289 32082 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:30.720412 31465 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:30.721403 32253 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.721891 32344 raft_consensus.cc:1064] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:30.724390 32344 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:30.729130 32315 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.734330 32081 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.736656 32315 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:30.759425 32344 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:30.761633 31541 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.761668 31543 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:30.765377 31465 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.767508 31465 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:30.772756 32385 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:23:30.786791 32315 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.794143 31292 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:30.798523 32283 raft_consensus.cc:1064] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:30.802227 32253 raft_consensus.cc:1064] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:30.803261 32082 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:30.804559 32253 consensus_queue.cc:237] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:30.805310 32283 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:30.837088 31542 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.847306 32253 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:30.852556 31543 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:30.853681 32081 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.855357 32374 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.859493 32385 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:30.868707 31391 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.872166 32356 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:30.885763 32084 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.889025 31469 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.889905 32084 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:30.970098 32378 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:30.971638 32344 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:30.990891 31542 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:30.999686 32398 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:31.017388 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 47192.3us
W20260709 12:23:31.018455 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 182862us
I20260709 12:23:31.017127 32400 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.020602 31391 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.046262 31465 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.054668 32081 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.082939 31390 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:31.075361 31290 catalog_manager.cc:5697] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.091905 31544 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.095135 31463 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:31.095549 32083 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:31.109870 32399 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.110526 31289 catalog_manager.cc:5697] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.118309 32315 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.121703 31390 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:31.123929 31544 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.134059 32315 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.147029 31465 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:31.148523 32084 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.152508 31292 catalog_manager.cc:5697] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.149700 32083 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:31.158717 32378 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.145503 31463 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.174055 32399 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.175769 32253 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.175859 31465 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.181759 31390 consensus_queue.cc:237] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:31.181808 31462 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:31.185782 32084 raft_consensus.cc:2955] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.186808 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0db923f6154349d3ba9a88713b04d088 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:31.189694 31544 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:31.191218 32399 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.192960 32081 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:31.194433 32344 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.200881 32081 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:31.202610 32398 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.203887 32385 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.210783 32398 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.200860 32083 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.214316 32082 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.220152 31469 raft_consensus.cc:2955] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.233575 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5eaea245d9414f42b05616da46574eb4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:31.234548 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a542644bc5014371a0403670d46545d9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:31.241132 31544 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:31.243116 32356 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.245764 32399 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.248180 31541 raft_consensus.cc:2955] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.248342 31544 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.249315 31292 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.262437 32081 raft_consensus.cc:2955] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.276278 31290 catalog_manager.cc:5697] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.279372 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a413d9092d14aea9490265eb7f932db with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:31.295959 31291 catalog_manager.cc:5697] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.298553 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet 0db923f6154349d3ba9a88713b04d088 with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:31.306562 31379 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eaea245d9414f42b05616da46574eb4 with delete_type TABLET_DATA_TOMBSTONED (TS 503bef451a2b424fa35e8e46b8c06f29 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56506
I20260709 12:23:31.309628 31453 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a413d9092d14aea9490265eb7f932db with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
I20260709 12:23:31.312611 32408 tablet_replica.cc:333] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:31.313407 32406 tablet_replica.cc:333] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:31.316004 31291 catalog_manager.cc:5697] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:31.313673 32408 raft_consensus.cc:2243] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.317845 32408 raft_consensus.cc:2272] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.315419 32406 raft_consensus.cc:2243] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.329066 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet a542644bc5014371a0403670d46545d9 with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:31.328642 32406 raft_consensus.cc:2272] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.336630 32408 ts_tablet_manager.cc:1916] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:31.339109 32406 ts_tablet_manager.cc:1916] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:31.340366 32407 tablet_replica.cc:333] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:23:31.341466 32407 raft_consensus.cc:2243] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.342176 32407 raft_consensus.cc:2272] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.346015 32407 ts_tablet_manager.cc:1916] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:31.354153 32408 ts_tablet_manager.cc:1929] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:31.354564 32408 log.cc:1199] T 5a413d9092d14aea9490265eb7f932db P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/5a413d9092d14aea9490265eb7f932db
I20260709 12:23:31.356321 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet 5a413d9092d14aea9490265eb7f932db (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:31.356288 32406 ts_tablet_manager.cc:1929] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:31.357268 32406 log.cc:1199] T 0db923f6154349d3ba9a88713b04d088 P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/0db923f6154349d3ba9a88713b04d088
I20260709 12:23:31.358664 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet 0db923f6154349d3ba9a88713b04d088 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:31.358794 32406 tablet_replica.cc:333] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:31.359767 32406 raft_consensus.cc:2243] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.360378 32406 raft_consensus.cc:2272] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.362852 32407 ts_tablet_manager.cc:1929] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:31.363328 32407 log.cc:1199] T 5eaea245d9414f42b05616da46574eb4 P 503bef451a2b424fa35e8e46b8c06f29: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/wals/5eaea245d9414f42b05616da46574eb4
I20260709 12:23:31.363662 32406 ts_tablet_manager.cc:1916] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:31.364861 31277 catalog_manager.cc:5028] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): tablet 5eaea245d9414f42b05616da46574eb4 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:31.376031 32406 ts_tablet_manager.cc:1929] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:31.376413 32406 log.cc:1199] T a542644bc5014371a0403670d46545d9 P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/a542644bc5014371a0403670d46545d9
I20260709 12:23:31.377580 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet a542644bc5014371a0403670d46545d9 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:32.391875 31542 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:32.397663 31391 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:32.397712 31463 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:32.397828 31510 consensus_peers.cc:597] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9489bc7325d849ad9c1aec0189f21268. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.399235 32392 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.400170 32377 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.407358 32409 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.408979 31463 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.411830 31391 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.427716 31292 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.428283 31542 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:23:32.443097 31510 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afa2173634bd428990b41e94ec873527. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.443482 31391 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.445214 31463 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.445407 32409 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.446964 32392 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.456387 32377 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.457917 31463 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.458532 31390 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.487653 31463 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:32.489742 31290 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.495564 31542 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:32.496774 31391 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:32.497015 32398 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:32.498541 31436 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3d5b01f306242f19825d56ac764bc69. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.500094 32400 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:32.528147 31390 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.527916 32400 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.559705 31544 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.563478 31290 catalog_manager.cc:5697] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.629025 31542 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:32.646148 31463 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:32.646438 31510 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a25b6ccdad024914a1cfccf61addaad1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.649912 32377 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.651383 31390 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:32.667873 32392 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:32.674824 32392 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.685477 31463 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.693277 31390 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:32.715559 31291 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.919840 32431 ts_tablet_manager.cc:933] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:32.922247 32431 tablet_copy_client.cc:323] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:23:32.923714 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet b3d5b01f306242f19825d56ac764bc69 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:23:32.924230 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet b3d5b01f306242f19825d56ac764bc69 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-b3d5b01f306242f19825d56ac764bc69
I20260709 12:23:32.931766 31480 tablet_copy_source_session.cc:215] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:32.934688 32431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5b01f306242f19825d56ac764bc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:32.950954 32431 tablet_copy_client.cc:806] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:32.951508 32431 tablet_copy_client.cc:670] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:32.955196 32431 tablet_copy_client.cc:538] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:32.962731 32431 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:32.978461 32431 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:32.979214 32431 tablet_bootstrap.cc:492] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:32.979836 32431 ts_tablet_manager.cc:1403] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.009s
I20260709 12:23:32.981966 32431 raft_consensus.cc:359] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:32.982582 32431 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:32.983116 32431 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:32.989183 32431 ts_tablet_manager.cc:1434] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:23:32.993711 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-b3d5b01f306242f19825d56ac764bc69 received from {username='slave'} at 127.0.0.1:48410
I20260709 12:23:32.994158 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-b3d5b01f306242f19825d56ac764bc69 on tablet b3d5b01f306242f19825d56ac764bc69 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:33.002313 32431 ts_tablet_manager.cc:933] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:33.007622 32431 tablet_copy_client.cc:323] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:33.011564 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet 9489bc7325d849ad9c1aec0189f21268 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:33.012084 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet 9489bc7325d849ad9c1aec0189f21268 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-9489bc7325d849ad9c1aec0189f21268
I20260709 12:23:33.018838 31554 tablet_copy_source_session.cc:215] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:33.022949 32431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9489bc7325d849ad9c1aec0189f21268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:33.038040 32431 tablet_copy_client.cc:806] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:33.038635 32431 tablet_copy_client.cc:670] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:33.042762 32431 tablet_copy_client.cc:538] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:33.052572 32431 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:33.059415 32435 ts_tablet_manager.cc:933] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:33.061723 32435 tablet_copy_client.cc:323] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:33.063658 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet afa2173634bd428990b41e94ec873527 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:33.064982 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet afa2173634bd428990b41e94ec873527 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-afa2173634bd428990b41e94ec873527
I20260709 12:23:33.075488 31554 tablet_copy_source_session.cc:215] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:33.079422 32435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa2173634bd428990b41e94ec873527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:33.083271 32431 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:33.084589 32431 tablet_bootstrap.cc:492] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:33.085657 32431 ts_tablet_manager.cc:1403] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.033s	user 0.026s	sys 0.003s
I20260709 12:23:33.089033 32431 raft_consensus.cc:359] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:33.089927 32431 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:33.090601 32431 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:33.095836 32431 ts_tablet_manager.cc:1434] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:33.097489 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-9489bc7325d849ad9c1aec0189f21268 received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:33.097952 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-9489bc7325d849ad9c1aec0189f21268 on tablet 9489bc7325d849ad9c1aec0189f21268 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:33.101567 32435 tablet_copy_client.cc:806] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:33.102370 32435 tablet_copy_client.cc:670] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:33.113837 32435 tablet_copy_client.cc:538] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:33.122314 32435 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:33.142675 32435 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:33.144075 32435 tablet_bootstrap.cc:492] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:33.144726 32435 ts_tablet_manager.cc:1403] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.010s
I20260709 12:23:33.147562 32435 raft_consensus.cc:359] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:33.148382 32435 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:33.149008 32435 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:33.151409 32435 ts_tablet_manager.cc:1434] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:23:33.153331 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-afa2173634bd428990b41e94ec873527 received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:33.153728 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-afa2173634bd428990b41e94ec873527 on tablet afa2173634bd428990b41e94ec873527 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:33.264789 32435 ts_tablet_manager.cc:933] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:33.266333 32435 tablet_copy_client.cc:323] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:33.267669 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet a25b6ccdad024914a1cfccf61addaad1 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:33.268110 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet a25b6ccdad024914a1cfccf61addaad1 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-a25b6ccdad024914a1cfccf61addaad1
I20260709 12:23:33.274736 31554 tablet_copy_source_session.cc:215] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:33.278589 32435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25b6ccdad024914a1cfccf61addaad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:33.293290 32435 tablet_copy_client.cc:806] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:33.294049 32435 tablet_copy_client.cc:670] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:33.297394 32435 tablet_copy_client.cc:538] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:33.307783 32435 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:33.326296 32435 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:33.327253 32435 tablet_bootstrap.cc:492] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:33.327912 32435 ts_tablet_manager.cc:1403] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:23:33.330415 32435 raft_consensus.cc:359] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:33.331012 32435 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:33.331616 32435 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:33.333901 32435 ts_tablet_manager.cc:1434] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:23:33.338984 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-a25b6ccdad024914a1cfccf61addaad1 received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:33.339419 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-a25b6ccdad024914a1cfccf61addaad1 on tablet a25b6ccdad024914a1cfccf61addaad1 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:33.406533 32081 raft_consensus.cc:1217] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:33.490633 32081 raft_consensus.cc:1217] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:33.618391 32083 raft_consensus.cc:1217] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:23:33.785342 32083 raft_consensus.cc:1217] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:33.930814 32377 raft_consensus.cc:1064] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:33.933789 32377 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:33.940249 32081 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.940937 31463 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.940968 31390 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:33.941707 32377 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.942584 32442 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.943419 32444 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.966553 32442 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:33.976153 32081 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.013019 31463 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.015615 31390 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.071933 31290 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.111495 32421 raft_consensus.cc:1064] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:34.116209 32421 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:34.142792 32453 raft_consensus.cc:1064] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:34.149878 32453 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:34.181900 31390 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:34.183434 32081 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:34.186014 32452 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:34.187801 31542 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:34.189138 32451 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:34.193531 32452 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:34.196089 32377 raft_consensus.cc:1064] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:34.202095 32377 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:34.236168 32081 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:34.271211 32452 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.279661 31463 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:34.300513 32428 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:34.312302 31463 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:34.305617 32081 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:34.317873 31388 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:34.319869 31395 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:34.322602 31389 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.338184 32428 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:23:34.361518 32467 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:34.378365 31541 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.352895 32083 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:23:34.435933 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 77547.1us
I20260709 12:23:34.437759 32463 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:34.441574 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 86489.1us
I20260709 12:23:34.450407 32467 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:34.456305 32463 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:34.469236 31544 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:34.478474 31291 catalog_manager.cc:5697] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:34.511195 32463 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.514479 32082 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:34.545207 31392 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.553437 31462 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:34.554946 32084 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.561218 32467 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:34.563179 31395 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:34.568533 31465 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:34.574790 32451 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:34.580217 32467 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.586680 32468 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:34.588163 32452 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.590384 31388 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.584933 31291 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:34.636864 32082 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:34.629153 32080 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.639130 32463 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.652376 31395 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.663395 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3d5b01f306242f19825d56ac764bc69 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:34.672057 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9489bc7325d849ad9c1aec0189f21268 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:34.673763 32398 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:34.675462 31467 raft_consensus.cc:2955] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.678063 31541 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:34.678701 32081 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.681736 31465 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.706516 31388 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:34.708051 32444 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:34.712400 31291 catalog_manager.cc:5697] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.714423 32081 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:34.717291 31292 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.704000 32080 raft_consensus.cc:2955] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.729431 31379 tablet_service.cc:1558] Processing DeleteTablet for tablet 9489bc7325d849ad9c1aec0189f21268 with delete_type TABLET_DATA_TOMBSTONED (TS 503bef451a2b424fa35e8e46b8c06f29 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56506
I20260709 12:23:34.732209 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet b3d5b01f306242f19825d56ac764bc69 with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:34.737000 31289 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.753268 31467 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.755112 32467 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:34.758414 32463 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.766309 31395 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.768855 32482 tablet_replica.cc:333] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:34.771353 32482 raft_consensus.cc:2243] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.761210 32481 tablet_replica.cc:333] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:23:34.793584 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet afa2173634bd428990b41e94ec873527 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:34.795128 32481 raft_consensus.cc:2243] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.796084 32481 raft_consensus.cc:2272] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.800688 32481 ts_tablet_manager.cc:1916] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:34.800367 31293 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.815632 32481 ts_tablet_manager.cc:1929] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:34.816064 32482 raft_consensus.cc:2272] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.816336 32481 log.cc:1199] T 9489bc7325d849ad9c1aec0189f21268 P 503bef451a2b424fa35e8e46b8c06f29: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/wals/9489bc7325d849ad9c1aec0189f21268
I20260709 12:23:34.781350 32080 raft_consensus.cc:2955] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.787230 31544 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:34.818641 31277 catalog_manager.cc:5028] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): tablet 9489bc7325d849ad9c1aec0189f21268 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:34.822127 32081 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:34.823518 31388 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:34.824414 32467 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:34.827862 32467 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:34.832206 31453 tablet_service.cc:1558] Processing DeleteTablet for tablet afa2173634bd428990b41e94ec873527 with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
I20260709 12:23:34.836225 32482 ts_tablet_manager.cc:1916] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:34.840862 32444 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.851794 32482 ts_tablet_manager.cc:1929] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:34.852365 32482 log.cc:1199] T b3d5b01f306242f19825d56ac764bc69 P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/b3d5b01f306242f19825d56ac764bc69
I20260709 12:23:34.852118 32081 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.858013 31388 raft_consensus.cc:2955] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.860523 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a25b6ccdad024914a1cfccf61addaad1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:34.864917 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet b3d5b01f306242f19825d56ac764bc69 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:34.875140 32483 tablet_replica.cc:333] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:34.875072 31293 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:34.876628 32483 raft_consensus.cc:2243] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.877488 32483 raft_consensus.cc:2272] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.880276 32483 ts_tablet_manager.cc:1916] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:34.897621 31453 tablet_service.cc:1558] Processing DeleteTablet for tablet a25b6ccdad024914a1cfccf61addaad1 with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
I20260709 12:23:34.904349 32483 ts_tablet_manager.cc:1929] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:34.904791 32483 log.cc:1199] T afa2173634bd428990b41e94ec873527 P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/afa2173634bd428990b41e94ec873527
I20260709 12:23:34.906471 32483 tablet_replica.cc:333] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:34.906404 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet afa2173634bd428990b41e94ec873527 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:34.907639 32483 raft_consensus.cc:2243] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.908262 32483 raft_consensus.cc:2272] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.911409 32483 ts_tablet_manager.cc:1916] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:34.922498 32483 ts_tablet_manager.cc:1929] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:34.922945 32483 log.cc:1199] T a25b6ccdad024914a1cfccf61addaad1 P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/a25b6ccdad024914a1cfccf61addaad1
I20260709 12:23:34.924497 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet a25b6ccdad024914a1cfccf61addaad1 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:35.968160 31544 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:35.975791 31388 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:35.976684 31510 consensus_peers.cc:597] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74b96090004c463795628c0134d8ecac. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.977053 31467 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.977937 32467 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:35.979614 32486 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.987862 32463 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:35.989670 31388 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:35.990382 31467 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.003026 31544 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.005255 31289 catalog_manager.cc:5697] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:36.012606 31510 consensus_peers.cc:597] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5050cffdfb1414e9bf38e82277f43bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.013904 31467 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:36.015305 32486 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.016958 31388 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:36.020349 32463 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:36.033255 32486 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.035708 31465 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.044737 31388 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.054306 31395 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.065984 31291 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.068280 31465 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.069411 31544 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.070629 32471 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:36.074154 31361 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2673eb8b7e874dc68e3b56393a06a549. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.074540 32484 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.095203 32470 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.100626 31465 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.106436 31544 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.110538 31388 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.113129 31293 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.134315 31543 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:36.146296 32484 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:23:36.156898 31361 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2038e3170e644e7e9fb1afa87e11d993. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.160732 31465 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:36.162322 32471 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.164567 32471 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.166229 31544 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.185150 31291 catalog_manager.cc:5697] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.193840 31465 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:36.486690 32505 ts_tablet_manager.cc:933] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:36.488802 32505 tablet_copy_client.cc:323] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:36.490484 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet 74b96090004c463795628c0134d8ecac from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:36.490911 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet 74b96090004c463795628c0134d8ecac from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-74b96090004c463795628c0134d8ecac
I20260709 12:23:36.496853 31554 tablet_copy_source_session.cc:215] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.501058 32505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b96090004c463795628c0134d8ecac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.519910 32505 tablet_copy_client.cc:806] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.520530 32505 tablet_copy_client.cc:670] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.524453 32505 tablet_copy_client.cc:538] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.533209 32505 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:36.553759 32505 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.554530 32505 tablet_bootstrap.cc:492] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:36.555106 32505 ts_tablet_manager.cc:1403] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:23:36.557642 32505 raft_consensus.cc:359] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.558418 32505 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:36.559055 32505 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.562057 32505 ts_tablet_manager.cc:1434] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:36.568310 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-74b96090004c463795628c0134d8ecac received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:36.568794 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-74b96090004c463795628c0134d8ecac on tablet 74b96090004c463795628c0134d8ecac with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:36.633917 32505 ts_tablet_manager.cc:933] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:36.635965 32509 ts_tablet_manager.cc:933] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:36.636153 32505 tablet_copy_client.cc:323] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:36.637778 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet f5050cffdfb1414e9bf38e82277f43bd from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:36.638283 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet f5050cffdfb1414e9bf38e82277f43bd from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-f5050cffdfb1414e9bf38e82277f43bd
I20260709 12:23:36.648808 31554 tablet_copy_source_session.cc:215] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.651348 32509 tablet_copy_client.cc:323] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:36.653208 31404 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet 2673eb8b7e874dc68e3b56393a06a549 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:36.653708 31404 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet 2673eb8b7e874dc68e3b56393a06a549 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-2673eb8b7e874dc68e3b56393a06a549
I20260709 12:23:36.654520 32505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5050cffdfb1414e9bf38e82277f43bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.662344 31404 tablet_copy_source_session.cc:215] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.671087 32505 tablet_copy_client.cc:806] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.671674 32505 tablet_copy_client.cc:670] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.675495 32505 tablet_copy_client.cc:538] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.677217 32509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673eb8b7e874dc68e3b56393a06a549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.684451 32512 ts_tablet_manager.cc:933] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:36.689253 32505 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:36.692956 32512 tablet_copy_client.cc:323] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.193:43521
I20260709 12:23:36.695041 31404 tablet_copy_service.cc:140] P 503bef451a2b424fa35e8e46b8c06f29: Received BeginTabletCopySession request for tablet 2038e3170e644e7e9fb1afa87e11d993 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:47056)
I20260709 12:23:36.695523 31404 tablet_copy_service.cc:161] P 503bef451a2b424fa35e8e46b8c06f29: Beginning new tablet copy session on tablet 2038e3170e644e7e9fb1afa87e11d993 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:47056: session id = 8d38acb9ce494ceb917c8441666104c4-2038e3170e644e7e9fb1afa87e11d993
I20260709 12:23:36.702461 31404 tablet_copy_source_session.cc:215] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.706135 32509 tablet_copy_client.cc:806] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.706663 32509 tablet_copy_client.cc:670] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.709277 32512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2038e3170e644e7e9fb1afa87e11d993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.717430 32509 tablet_copy_client.cc:538] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.717898 32505 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.718755 32505 tablet_bootstrap.cc:492] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:36.719441 32505 ts_tablet_manager.cc:1403] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 12:23:36.729350 32509 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:36.731992 32512 tablet_copy_client.cc:806] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.732575 32512 tablet_copy_client.cc:670] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.736819 32505 raft_consensus.cc:359] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.737783 32505 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:36.738500 32505 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.741024 32505 ts_tablet_manager.cc:1434] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:23:36.743341 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-f5050cffdfb1414e9bf38e82277f43bd received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:36.743734 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-f5050cffdfb1414e9bf38e82277f43bd on tablet f5050cffdfb1414e9bf38e82277f43bd with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:36.749099 32512 tablet_copy_client.cc:538] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.768185 32512 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:36.794968 32509 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.795885 32509 tablet_bootstrap.cc:492] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:36.796530 32509 ts_tablet_manager.cc:1403] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.067s	user 0.029s	sys 0.019s
I20260709 12:23:36.799726 32509 raft_consensus.cc:359] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.800515 32509 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:36.801128 32509 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.805912 32509 ts_tablet_manager.cc:1434] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:23:36.809228 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-2673eb8b7e874dc68e3b56393a06a549 received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:36.809739 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-2673eb8b7e874dc68e3b56393a06a549 on tablet 2673eb8b7e874dc68e3b56393a06a549 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:36.813570 32512 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.814527 32512 tablet_bootstrap.cc:492] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:36.815212 32512 ts_tablet_manager.cc:1403] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.009s
I20260709 12:23:36.818040 32512 raft_consensus.cc:359] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.818783 32512 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:36.819396 32512 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:36.821461 32512 ts_tablet_manager.cc:1434] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:36.823314 31404 tablet_copy_service.cc:342] P 503bef451a2b424fa35e8e46b8c06f29: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-2038e3170e644e7e9fb1afa87e11d993 received from {username='slave'} at 127.0.0.1:47056
I20260709 12:23:36.823747 31404 tablet_copy_service.cc:434] P 503bef451a2b424fa35e8e46b8c06f29: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-2038e3170e644e7e9fb1afa87e11d993 on tablet 2038e3170e644e7e9fb1afa87e11d993 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:36.947942 32081 raft_consensus.cc:1217] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:37.012348 32081 raft_consensus.cc:1217] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
W20260709 12:23:37.084560 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 47357.7us
I20260709 12:23:37.112584 32081 raft_consensus.cc:1217] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:37.134788 32081 raft_consensus.cc:1217] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:37.441256 32520 raft_consensus.cc:1064] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:37.443413 32520 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:37.450587 32081 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.450884 31395 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.450867 31465 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.452164 32520 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.453094 32467 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.453910 32486 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.463995 32486 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.471907 32080 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.478018 31395 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.483860 31291 catalog_manager.cc:5697] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.474561 31465 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.514030 32467 raft_consensus.cc:1064] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:37.516919 32467 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:37.549674 32080 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.550247 31465 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.551669 31395 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.551776 32463 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:37.553108 32520 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.554951 32463 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.568223 32467 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.571089 31395 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.576436 31541 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:37.586104 31465 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:37.595306 32502 raft_consensus.cc:1064] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:37.597774 32502 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:37.602474 32463 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:37.601670 31465 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.592694 32080 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:37.603883 32081 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.606998 32520 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:23:37.616184 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:37.616251 31293 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.638165 32486 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.641876 32084 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.667604 31291 catalog_manager.cc:5697] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.680727 32084 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:37.682121 31465 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:37.689616 31543 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:37.692654 31462 raft_consensus.cc:2955] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.702713 31543 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:37.691438 32515 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:23:37.710829 32502 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.714247 31379 tablet_service.cc:1558] Processing DeleteTablet for tablet 74b96090004c463795628c0134d8ecac with delete_type TABLET_DATA_TOMBSTONED (TS 503bef451a2b424fa35e8e46b8c06f29 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56506
I20260709 12:23:37.727738 32084 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:37.728029 31465 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:37.733733 32520 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:23:37.740883 32467 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:37.745190 32541 tablet_replica.cc:333] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:23:37.749125 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 74b96090004c463795628c0134d8ecac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:37.750200 32463 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:23:37.754981 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 70689us
I20260709 12:23:37.762017 32541 raft_consensus.cc:2243] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.762794 32541 raft_consensus.cc:2272] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.766886 31465 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.776396 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5050cffdfb1414e9bf38e82277f43bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:37.777415 32541 ts_tablet_manager.cc:1916] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:37.782718 32080 raft_consensus.cc:2955] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.791293 31291 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 3 to 4, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.817320 32502 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.818898 31379 tablet_service.cc:1558] Processing DeleteTablet for tablet f5050cffdfb1414e9bf38e82277f43bd with delete_type TABLET_DATA_TOMBSTONED (TS 503bef451a2b424fa35e8e46b8c06f29 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56506
I20260709 12:23:37.845006 32538 raft_consensus.cc:1064] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:37.850276 32538 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:37.870083 32515 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.871831 32541 ts_tablet_manager.cc:1929] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:37.872300 32541 log.cc:1199] T 74b96090004c463795628c0134d8ecac P 503bef451a2b424fa35e8e46b8c06f29: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/wals/74b96090004c463795628c0134d8ecac
I20260709 12:23:37.874148 31277 catalog_manager.cc:5028] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): tablet 74b96090004c463795628c0134d8ecac (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:37.874756 32541 tablet_replica.cc:333] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:23:37.876986 32541 raft_consensus.cc:2243] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.878073 32541 raft_consensus.cc:2272] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.882221 32541 ts_tablet_manager.cc:1916] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:37.891417 31543 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.899576 32541 ts_tablet_manager.cc:1929] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:37.900079 32541 log.cc:1199] T f5050cffdfb1414e9bf38e82277f43bd P 503bef451a2b424fa35e8e46b8c06f29: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/wals/f5050cffdfb1414e9bf38e82277f43bd
I20260709 12:23:37.903630 31277 catalog_manager.cc:5028] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): tablet f5050cffdfb1414e9bf38e82277f43bd (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:37.912923 32084 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.922385 31465 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:37.927693 31389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:37.928359 31389 raft_consensus.cc:606] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:37.930994 31389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:37.931519 31389 raft_consensus.cc:606] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:37.934058 31389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:37.934605 31389 raft_consensus.cc:606] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:37.934012 31290 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:23:37.939821 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 102894us
I20260709 12:23:37.962841 32084 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.964293 32538 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.966547 31465 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.967039 31543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:37.967612 31543 raft_consensus.cc:606] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:37.968834 32538 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:38.005051 31543 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:38.017836 32500 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:38.034353 31465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:38.034910 31465 raft_consensus.cc:606] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:38.040452 31392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a542644bc5014371a0403670d46545d9"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:38.041051 31392 raft_consensus.cc:606] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:38.038295 32515 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.042245 31391 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.044886 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:38.054607 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:38.056020 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:38.065269 31462 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.069901 32081 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:38.071676 32500 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.072348 31469 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:38.074043 32500 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.076067 32398 raft_consensus.cc:993] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:38.076500 32398 raft_consensus.cc:1081] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:38.072703 31543 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.080009 32084 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.080878 32500 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.084399 32081 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.089648 31391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56522
I20260709 12:23:38.091948 31465 raft_consensus.cc:2955] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.092563 31290 catalog_manager.cc:5697] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.107432 32538 raft_consensus.cc:993] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:38.108274 32539 raft_consensus.cc:1081] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:38.111045 32084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a542644bc5014371a0403670d46545d9"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49870
I20260709 12:23:38.111577 32084 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.113893 31391 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.114316 31391 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.111910 32084 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.121270 31391 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:38.121213 31392 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.123941 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:38.124526 31465 raft_consensus.cc:3055] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:38.124795 31465 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:38.125566 31465 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:38.123713 31290 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.121958 32084 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.126818 31465 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.129079 32080 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.131155 31541 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.131156 32084 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:38.133607 32515 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.135470 32515 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.137152 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:38.139277 31392 raft_consensus.cc:3055] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:38.139668 31392 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:38.137868 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:38.141044 31462 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.144456 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2673eb8b7e874dc68e3b56393a06a549 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:38.142135 31392 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.148717 31392 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.150270 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet 2673eb8b7e874dc68e3b56393a06a549 with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:38.159274 32554 tablet_replica.cc:333] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:38.160313 32538 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.165625 31392 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:38.166960 32047 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:38.198397 32508 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:38.203576 31462 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:38.213405 32554 raft_consensus.cc:2243] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.214784 32554 raft_consensus.cc:2272] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.218891 32554 ts_tablet_manager.cc:1916] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:38.220630 32508 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:38.222258 32508 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.233357 31391 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:38.235348 31544 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.239707 31277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2038e3170e644e7e9fb1afa87e11d993 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:38.242225 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:38.243005 31541 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.251642 31291 catalog_manager.cc:5697] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.256610 31541 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:38.258208 31290 catalog_manager.cc:5697] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 1 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.266525 31359 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:38.269904 32554 ts_tablet_manager.cc:1929] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:38.270430 32554 log.cc:1199] T 2673eb8b7e874dc68e3b56393a06a549 P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/2673eb8b7e874dc68e3b56393a06a549
I20260709 12:23:38.271597 32081 raft_consensus.cc:2955] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:38.275032 31465 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:38.282512 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet 2673eb8b7e874dc68e3b56393a06a549 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:38.284212 31453 tablet_service.cc:1558] Processing DeleteTablet for tablet 2038e3170e644e7e9fb1afa87e11d993 with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
I20260709 12:23:38.286787 32500 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:38.290381 32500 raft_consensus.cc:697] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:38.291531 32500 consensus_queue.cc:237] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:38.303015 32539 raft_consensus.cc:993] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:38.303543 32502 raft_consensus.cc:993] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:38.303561 32515 raft_consensus.cc:1081] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:38.304039 32502 raft_consensus.cc:1081] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:38.312963 32084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49870
I20260709 12:23:38.313480 32084 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.313810 32084 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.314177 32081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49870
I20260709 12:23:38.314718 32081 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.315037 32081 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.318078 32557 tablet_replica.cc:333] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:38.319111 32557 raft_consensus.cc:2243] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.319845 32557 raft_consensus.cc:2272] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.322821 32520 raft_consensus.cc:993] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:38.323314 32520 raft_consensus.cc:1081] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:38.325341 32557 ts_tablet_manager.cc:1916] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:38.326875 31290 catalog_manager.cc:5697] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:38.324105 32084 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.328789 31392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56518
I20260709 12:23:38.329329 31392 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.329679 31392 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.332947 32081 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.334766 32081 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:38.336848 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:38.337387 31389 raft_consensus.cc:3055] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:38.337704 31389 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:38.338441 31389 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.339682 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:38.339622 31392 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:38.340302 31465 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.340349 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:38.341550 31391 raft_consensus.cc:3055] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:38.341866 31391 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:38.342088 32557 ts_tablet_manager.cc:1929] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:38.342547 32557 log.cc:1199] T 2038e3170e644e7e9fb1afa87e11d993 P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/2038e3170e644e7e9fb1afa87e11d993
I20260709 12:23:38.342610 31391 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.343734 31391 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.341009 31389 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.344566 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet 2038e3170e644e7e9fb1afa87e11d993 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:38.347775 31465 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:38.346980 32084 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:38.348846 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:38.349757 32508 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:38.350200 32508 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:38.351117 31391 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:38.351043 32508 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.352449 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:38.353626 32555 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:38.354434 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:38.355070 31544 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.355738 31392 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:38.351049 31389 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:38.358533 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:38.359035 31541 raft_consensus.cc:3055] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:38.359359 31541 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:38.360126 31541 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:38.360177 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:38.361310 31541 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.364444 31544 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:38.366734 31465 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.368355 31541 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:38.369387 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:38.370618 32500 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:38.371093 32500 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:38.371809 32500 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:38.376328 32555 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:38.377491 32555 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.380600 31465 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:38.376236 31290 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.390193 31289 catalog_manager.cc:5697] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:38.395174 31290 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.419100 32500 raft_consensus.cc:993] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:38.419595 32537 raft_consensus.cc:1081] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:38.421066 32084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49870
I20260709 12:23:38.421574 32084 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.421921 32084 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.426951 32084 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.428706 32084 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:38.429355 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:38.429968 31391 raft_consensus.cc:3055] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:38.429661 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:38.430315 31391 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:38.430722 31463 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.431123 31391 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.432155 31391 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.436200 31463 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:38.437166 32050 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:38.437899 31391 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:38.438356 32555 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:38.439324 32555 raft_consensus.cc:697] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:38.440109 32555 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:38.447574 31290 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 3 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.613181 31391 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:38.615638 32555 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:38.641232 31465 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:38.642549 32508 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:38.682854 31465 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:38.684018 32500 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.691618 31541 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:38.694450 32539 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.805529 31389 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:38.806886 31389 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:38.806988 32508 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:38.808094 32555 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:38.821856 31465 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:38.823102 32508 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:38.850199 31541 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:38.851500 32555 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:38.877635 31463 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:38.879364 32539 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.888804 31389 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:38.891182 32555 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:38.896857 31541 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:38.898386 32537 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.912873 31463 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:38.915488 32559 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:39.261300 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:39.311971 31391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:39.312585 31391 raft_consensus.cc:606] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:39.315194 31391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:39.315762 31391 raft_consensus.cc:606] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:39.318153 31463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:39.318725 31463 raft_consensus.cc:606] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:39.321871 31463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:39.322422 31463 raft_consensus.cc:606] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:39.327205 31463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:39.327803 31463 raft_consensus.cc:606] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:39.331459 31543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:39.332018 31543 raft_consensus.cc:606] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:39.333123 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:39.334474 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:39.335052 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:39.368566 31341 auto_rebalancer.cc:629] Failed to schedule move for tablet 4d2a9a290e1f42029551de25d5a7932a: Remote error: Service unavailable: leader transfer in progress
I20260709 12:23:39.373109 31541 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:39.376770 32398 raft_consensus.cc:993] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:39.377233 32398 raft_consensus.cc:1081] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:39.378743 31391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56522
I20260709 12:23:39.379331 31391 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.379743 31391 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.395347 31391 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:39.397629 31391 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:39.400599 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:39.401115 31544 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.402993 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:39.403610 31462 raft_consensus.cc:3055] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.403906 31462 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:39.404289 31391 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:39.404409 31510 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17b17789440044608d6b5d4f1b95d09c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.404747 31462 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:39.405468 32463 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.406095 31463 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.406551 31462 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.410835 31544 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:39.411923 31359 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:39.412925 32502 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.413379 32502 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:39.414191 32502 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:39.416085 31462 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:39.417518 32500 raft_consensus.cc:993] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:39.417960 32500 raft_consensus.cc:1081] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:39.417795 32463 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.425843 32081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49870
I20260709 12:23:39.426350 32081 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.426692 32081 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.429415 32520 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.445518 32081 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.448371 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:39.448927 31392 raft_consensus.cc:3055] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.449203 31392 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:39.449954 31392 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.452219 32081 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:39.448382 32537 raft_consensus.cc:993] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:39.452746 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:39.452968 32537 raft_consensus.cc:1081] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:39.453320 31544 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.452785 31392 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.462911 31544 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:39.464203 32048 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:39.465238 31389 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.467638 32508 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.468152 32508 raft_consensus.cc:697] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:39.469132 32508 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.470086 31463 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:39.472934 31290 catalog_manager.cc:5697] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.477979 32084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49870
I20260709 12:23:39.478502 32084 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.478857 32084 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.474794 31291 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.475800 31392 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:39.487136 31462 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.498248 32084 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:39.500705 31436 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34b617a3dcc54fb4b4d2c6cda2c6cc55. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.501721 31541 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.503850 31389 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.505661 32398 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.506412 32451 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.510224 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:39.510748 31389 raft_consensus.cc:3055] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:39.511022 31389 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:39.512701 32084 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:39.514063 31389 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.514897 31389 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.514308 31289 catalog_manager.cc:5697] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.518754 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:39.520470 31462 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.521927 31389 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:39.523061 32047 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:39.523947 32508 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.524463 32508 raft_consensus.cc:697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:39.523389 32451 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.525581 32508 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.534230 31462 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:39.536964 31392 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.548072 31541 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.555152 31462 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:39.578717 31541 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:39.579325 31436 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05d891c1ae594a36bd0f372d87b398dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.580242 32595 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:39.581440 31389 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.582788 32595 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.599551 31292 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.599834 32595 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.607163 31291 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 3 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.622013 31541 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.628473 32589 raft_consensus.cc:993] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:39.629078 32594 raft_consensus.cc:1081] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:39.630705 31389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56522
I20260709 12:23:39.630275 31392 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:23:39.631313 31389 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.631809 31389 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.633678 31290 catalog_manager.cc:5697] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.639258 31389 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:39.641361 31389 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:39.642537 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:39.643078 31544 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.644383 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:39.644905 31462 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.645205 31462 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:39.645913 31462 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:39.646848 31462 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.651696 31544 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:39.652621 31359 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:39.653394 32502 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.653858 32502 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:39.654662 32502 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:39.655190 31462 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:39.688119 32398 raft_consensus.cc:993] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:39.688575 32398 raft_consensus.cc:1081] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:39.689313 31289 catalog_manager.cc:5697] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.690493 32084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49886
I20260709 12:23:39.691148 32084 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.691530 32084 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.696655 32084 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.700125 32084 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:39.701666 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:39.702185 31462 raft_consensus.cc:3055] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.702455 31462 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:39.703104 31462 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.703531 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:39.704155 31392 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.704424 31462 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.709995 31462 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:39.710203 31392 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:39.710938 32050 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:39.711826 32508 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.712284 32508 raft_consensus.cc:697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:39.713500 32508 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.721211 31289 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.771885 32520 raft_consensus.cc:993] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:39.772377 32520 raft_consensus.cc:1081] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:39.774765 32084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49878
I20260709 12:23:39.775364 32084 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.775710 32084 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.786372 32084 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.789377 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:39.789943 31462 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.790472 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:39.791042 31544 raft_consensus.cc:3055] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.791335 31544 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:39.792073 31544 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.793041 31544 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.795379 32084 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:39.796600 31462 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:39.801265 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:39.802394 32508 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.802879 32508 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:39.803776 32508 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:39.802131 31544 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:39.815521 31289 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.862914 31544 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:39.864027 32539 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.881994 31465 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:39.885360 32502 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.906157 32610 ts_tablet_manager.cc:933] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:39.912192 32610 tablet_copy_client.cc:323] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:23:39.913841 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet 17b17789440044608d6b5d4f1b95d09c from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:23:39.914367 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet 17b17789440044608d6b5d4f1b95d09c from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-17b17789440044608d6b5d4f1b95d09c
I20260709 12:23:39.923208 31554 tablet_copy_source_session.cc:215] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.926352 32610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b17789440044608d6b5d4f1b95d09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.931764 31465 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:39.933108 32508 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:39.977569 32610 tablet_copy_client.cc:806] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.978166 32610 tablet_copy_client.cc:670] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:39.985285 32610 tablet_copy_client.cc:538] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:39.988240 31392 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:39.989744 32555 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:39.994199 32610 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:40.020310 32614 ts_tablet_manager.cc:933] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:40.032075 32614 tablet_copy_client.cc:323] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:23:40.034016 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet 05d891c1ae594a36bd0f372d87b398dd from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:23:40.034744 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet 05d891c1ae594a36bd0f372d87b398dd from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-05d891c1ae594a36bd0f372d87b398dd
I20260709 12:23:40.040160 31389 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:40.046119 31480 tablet_copy_source_session.cc:215] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:40.050665 32555 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:40.057575 32618 ts_tablet_manager.cc:933] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:40.060356 32614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d891c1ae594a36bd0f372d87b398dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.061313 31462 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.065582 32500 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.071964 31544 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.072144 32610 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.073405 32610 tablet_bootstrap.cc:492] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:40.073649 32502 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.074278 32610 ts_tablet_manager.cc:1403] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.080s	user 0.029s	sys 0.017s
I20260709 12:23:40.077440 32610 raft_consensus.cc:359] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:40.078285 32610 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:40.079147 32610 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:40.086414 32610 ts_tablet_manager.cc:1434] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:23:40.090440 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-17b17789440044608d6b5d4f1b95d09c received from {username='slave'} at 127.0.0.1:34624
I20260709 12:23:40.090915 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-17b17789440044608d6b5d4f1b95d09c on tablet 17b17789440044608d6b5d4f1b95d09c with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:40.096184 31544 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:40.103085 32618 tablet_copy_client.cc:323] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:23:40.105262 32559 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:40.110188 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:23:40.110730 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-34b617a3dcc54fb4b4d2c6cda2c6cc55
I20260709 12:23:40.118822 31480 tablet_copy_source_session.cc:215] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:40.131013 32618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.133392 32614 tablet_copy_client.cc:806] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:40.137853 32614 tablet_copy_client.cc:670] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:40.141678 32614 tablet_copy_client.cc:538] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:40.169456 32614 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:40.178733 32618 tablet_copy_client.cc:806] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:40.179352 32618 tablet_copy_client.cc:670] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:40.186650 32618 tablet_copy_client.cc:538] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:40.194375 32618 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:23:40.198480 32614 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.199424 32614 tablet_bootstrap.cc:492] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:40.200083 32614 ts_tablet_manager.cc:1403] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.004s
I20260709 12:23:40.203989 32614 raft_consensus.cc:359] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:40.206403 31392 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:40.204800 32614 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:40.208812 32508 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:40.209621 32614 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:40.212241 32614 ts_tablet_manager.cc:1434] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:23:40.220721 32618 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.221721 32618 tablet_bootstrap.cc:492] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:23:40.221994 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-05d891c1ae594a36bd0f372d87b398dd received from {username='slave'} at 127.0.0.1:48410
I20260709 12:23:40.222352 32618 ts_tablet_manager.cc:1403] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.009s
I20260709 12:23:40.222432 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-05d891c1ae594a36bd0f372d87b398dd on tablet 05d891c1ae594a36bd0f372d87b398dd with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:40.225471 32618 raft_consensus.cc:359] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:40.226301 32618 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:23:40.227396 32618 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:40.265815 32618 ts_tablet_manager.cc:1434] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.004s
I20260709 12:23:40.267458 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-34b617a3dcc54fb4b4d2c6cda2c6cc55 received from {username='slave'} at 127.0.0.1:48410
I20260709 12:23:40.267861 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-34b617a3dcc54fb4b4d2c6cda2c6cc55 on tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:40.277081 31462 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:40.278923 32508 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:40.383456 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:40.423780 31465 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:40.425381 32559 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:40.429224 31544 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:40.430627 32555 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:40.438339 32081 raft_consensus.cc:1217] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.446159 32081 raft_consensus.cc:1217] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.465530 31543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46d997871e814deba55c8b52416644f9"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:40.466193 31543 raft_consensus.cc:606] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:40.516209 31392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:40.516773 31392 raft_consensus.cc:606] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:40.523416 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:40.523999 31544 raft_consensus.cc:606] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:40.526595 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:40.527092 31544 raft_consensus.cc:606] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:40.535370 31389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:40.535904 31389 raft_consensus.cc:606] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:40.547641 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:40.549283 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:40.550053 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:40.551615 32463 raft_consensus.cc:993] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:40.552054 32520 raft_consensus.cc:1081] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
W20260709 12:23:40.563730 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 123889us
I20260709 12:23:40.569284 31389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56518
I20260709 12:23:40.569918 31389 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:40.570263 31389 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.577811 31389 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:40.580412 31389 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:40.581298 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:40.581890 31543 raft_consensus.cc:3055] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:40.582190 31543 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:40.582832 31543 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:40.583909 31543 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.590739 31543 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:40.593925 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:40.594748 32081 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.623744 31359 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:40.624607 32539 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:40.625087 32539 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:40.625916 32539 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:40.632488 32081 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:40.649344 32081 raft_consensus.cc:1217] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.693862 31292 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.721148 32640 raft_consensus.cc:993] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower 842fbe33f4144fa69f1fd428652b6998 to start an election
I20260709 12:23:40.721695 32539 raft_consensus.cc:1081] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Signalling peer 842fbe33f4144fa69f1fd428652b6998 to start an election
I20260709 12:23:40.729848 31467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:42112
I20260709 12:23:40.730392 31467 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:40.730733 31467 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.737519 32627 raft_consensus.cc:993] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:40.737986 32627 raft_consensus.cc:1081] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:40.738541 31467 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:40.739848 31391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46d997871e814deba55c8b52416644f9"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56518
I20260709 12:23:40.740378 31391 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:40.740537 31467 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:40.740736 31391 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.741959 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:40.742679 31543 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.743842 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:40.744410 31389 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:40.744697 31389 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:40.745357 31389 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:40.746376 31389 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.750979 31543 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:40.752405 31434 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:40.754289 32398 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:40.754779 32398 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:40.755512 32398 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:40.771296 31292 catalog_manager.cc:5697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 3 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.776527 31391 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:40.778342 31391 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:40.780767 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:40.781466 31542 raft_consensus.cc:3055] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:40.781677 31389 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:40.781745 31542 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:40.782665 31542 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:40.784104 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:40.784608 31467 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.783695 31542 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.791472 31542 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:40.792659 31359 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:40.793464 32539 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:40.793951 32539 raft_consensus.cc:697] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:40.794679 32539 consensus_queue.cc:237] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:40.808116 31467 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:40.808722 31292 catalog_manager.cc:5697] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.868400 32638 raft_consensus.cc:1064] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:40.871052 32638 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:40.877503 32081 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.878621 31389 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.880112 31467 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.880076 32627 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.881685 32463 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.893162 32627 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.930888 32398 raft_consensus.cc:1064] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:40.933349 32398 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:40.947474 32520 raft_consensus.cc:993] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: : Instructing follower 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:40.947966 32520 raft_consensus.cc:1081] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Signalling peer 8d38acb9ce494ceb917c8441666104c4 to start an election
I20260709 12:23:40.948258 32084 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.949846 32084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268"
dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:49878
I20260709 12:23:40.949958 31395 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.950242 31542 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.950340 32084 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:40.950740 32084 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:40.951475 32398 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.952277 32633 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.954353 32633 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.959968 32638 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:40.964074 32081 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:40.969187 31395 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:40.983853 31292 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.000896 32084 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:41.008554 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:41.009111 31467 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.016533 32502 raft_consensus.cc:993] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower 842fbe33f4144fa69f1fd428652b6998 to start an election
I20260709 12:23:41.016968 32502 raft_consensus.cc:1081] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Signalling peer 842fbe33f4144fa69f1fd428652b6998 to start an election
I20260709 12:23:41.021574 31461 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.029047 31462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:42112
I20260709 12:23:41.029657 31462 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.030009 31462 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.034708 32637 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.045637 32084 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:41.047209 31462 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:41.049971 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:41.050460 31467 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:41.053408 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:41.050519 31543 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.054206 31544 raft_consensus.cc:3055] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.054512 31544 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:41.055214 31544 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:41.056247 31544 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.059779 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:41.060314 31395 raft_consensus.cc:3055] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.060485 31541 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:41.060704 31395 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:41.060148 32081 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.061858 32537 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:41.064091 31395 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:41.072530 31544 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:41.073670 32048 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:41.074671 32634 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.065153 31395 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.075129 32634 raft_consensus.cc:697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:41.076978 32634 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:41.091081 31389 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.095564 31461 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:41.094655 31292 catalog_manager.cc:5697] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.103425 31541 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.075785 31543 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:41.114691 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:41.115568 32398 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.116022 32398 raft_consensus.cc:697] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:41.116875 32398 consensus_queue.cc:237] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:41.125437 31467 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:41.131412 32080 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.107692 31462 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:41.137542 32635 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.137732 31292 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.140974 31389 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.142886 31389 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:41.145224 32635 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.145198 32637 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:23:41.147436 31543 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:41.156818 31395 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:41.161284 31389 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.162377 32635 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.167315 32463 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.192646 32084 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.192684 31462 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:41.195154 32520 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.195760 31395 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.205986 32502 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:41.220098 32463 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.223805 32084 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.226069 32398 raft_consensus.cc:1064] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:23:41.228473 32398 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:41.252869 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17b17789440044608d6b5d4f1b95d09c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:23:41.262189 32659 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:23:41.275842 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 81529.6us
I20260709 12:23:41.279496 32084 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:23:41.279462 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 62947.6us
W20260709 12:23:41.287241 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 73546.9us
I20260709 12:23:41.287745 31291 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New cstate: current_term: 1 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.293390 31541 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:41.300422 32084 raft_consensus.cc:2955] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.304189 31388 raft_consensus.cc:2955] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.318694 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05d891c1ae594a36bd0f372d87b398dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.320175 31538 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:41.320922 32081 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.325500 32669 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:41.348685 32660 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:41.352258 32398 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:41.354971 31538 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.355996 31389 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.367048 31453 tablet_service.cc:1558] Processing DeleteTablet for tablet 17b17789440044608d6b5d4f1b95d09c with delete_type TABLET_DATA_TOMBSTONED (TS 842fbe33f4144fa69f1fd428652b6998 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42100
W20260709 12:23:41.368824 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53996.3us
I20260709 12:23:41.367142 31289 catalog_manager.cc:5697] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.375552 31289 catalog_manager.cc:5697] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.378587 32502 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:41.394948 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet 05d891c1ae594a36bd0f372d87b398dd with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:41.376458 32660 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:23:41.429512 32635 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:41.505617 31543 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:41.510973 32559 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:23:41.617122 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 210488us
I20260709 12:23:41.624336 31539 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:41.624994 31461 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:41.627955 32678 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:41.632740 32675 tablet_replica.cc:333] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
W20260709 12:23:41.645260 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 120400us
I20260709 12:23:41.667240 32673 tablet_replica.cc:333] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:23:41.675987 32675 raft_consensus.cc:2243] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.678054 32675 raft_consensus.cc:2272] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.743527 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:41.752557 32673 raft_consensus.cc:2243] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.753751 32673 raft_consensus.cc:2272] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:41.650653 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 97305.9us
I20260709 12:23:41.769362 31390 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:41.787170 32676 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:23:41.806625 32683 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:41.822145 32677 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:23:41.835115 31541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:41.835915 31541 raft_consensus.cc:606] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:41.836829 32673 ts_tablet_manager.cc:1916] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:23:41.839758 32672 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.193s	user 0.003s	sys 0.000s
I20260709 12:23:41.856487 32675 ts_tablet_manager.cc:1916] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.916929 31461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:41.920149 31461 raft_consensus.cc:606] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:41.933624 31388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "b63f042a541248b88888cbd3049b38ca"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:41.934281 31388 raft_consensus.cc:606] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Received request to transfer leadership to TS b63f042a541248b88888cbd3049b38ca
I20260709 12:23:41.937526 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:41.939131 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:41.938153 32635 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.938725 32084 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:41.939898 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:41.956676 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 81865.6us
I20260709 12:23:41.961560 32675 ts_tablet_manager.cc:1929] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.971864 32675 log.cc:1199] T 05d891c1ae594a36bd0f372d87b398dd P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/05d891c1ae594a36bd0f372d87b398dd
I20260709 12:23:41.974213 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet 05d891c1ae594a36bd0f372d87b398dd (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:41.974447 32673 ts_tablet_manager.cc:1929] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.974926 32673 log.cc:1199] T 17b17789440044608d6b5d4f1b95d09c P 842fbe33f4144fa69f1fd428652b6998: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/wals/17b17789440044608d6b5d4f1b95d09c
I20260709 12:23:42.021570 31389 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:42.022662 31280 catalog_manager.cc:5028] TS 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): tablet 17b17789440044608d6b5d4f1b95d09c (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
W20260709 12:23:42.041467 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 73770.3us
I20260709 12:23:42.057044 31290 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:42.090258 32520 raft_consensus.cc:993] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: : Instructing follower 842fbe33f4144fa69f1fd428652b6998 to start an election
I20260709 12:23:42.090728 32520 raft_consensus.cc:1081] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Signalling peer 842fbe33f4144fa69f1fd428652b6998 to start an election
I20260709 12:23:42.093096 31467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:42116
I20260709 12:23:42.093746 31467 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:42.094231 32502 raft_consensus.cc:993] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: : Instructing follower b63f042a541248b88888cbd3049b38ca to start an election
I20260709 12:23:42.095042 32661 raft_consensus.cc:1081] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Signalling peer b63f042a541248b88888cbd3049b38ca to start an election
I20260709 12:23:42.094205 31467 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.107820 31538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
 from {username='slave'} at 127.0.0.1:54126
I20260709 12:23:42.108487 31538 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:42.108963 31538 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.116658 31538 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:42.117666 31467 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:42.120537 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:42.120645 31538 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:42.125028 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:42.125627 31390 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.125901 31390 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:42.126417 31462 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.126577 31390 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:42.120584 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:42.127732 31390 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.128057 31389 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.134693 31390 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:42.137153 31538 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:42.138542 31465 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:42.138994 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:42.139611 31541 raft_consensus.cc:3055] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.139891 31541 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:42.140552 31541 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:42.141500 31541 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.149936 31507 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:42.151333 31389 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:42.152012 31541 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:42.154490 31433 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:42.120558 31467 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:42.155673 32635 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:42.156185 32635 raft_consensus.cc:697] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:42.156862 32638 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:42.157349 32638 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:42.157109 32635 consensus_queue.cc:237] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:42.158176 32638 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:42.158617 31462 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:42.172022 31391 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:42.174464 32633 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:42.176994 32084 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:42.183969 32662 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:42.193267 31291 catalog_manager.cc:5697] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:42.197947 31289 catalog_manager.cc:5697] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.201695 32662 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:42.209757 31391 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:42.226455 32633 raft_consensus.cc:993] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:42.226920 32678 raft_consensus.cc:1081] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:42.235265 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:42.271008 32084 raft_consensus.cc:2955] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:42.303162 31289 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: config changed from index 3 to 4, VOTER b63f042a541248b88888cbd3049b38ca (127.29.131.195) evicted. New cstate: current_term: 1 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:42.310969 31391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56522
I20260709 12:23:42.311684 31391 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:42.312183 31391 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.323521 31391 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:42.325948 31391 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:42.327889 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:42.328544 31462 raft_consensus.cc:3055] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:42.328809 31462 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:42.330579 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:42.331041 31538 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.329718 31462 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:43.790475 31324 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca240 after lost signal to thread 30226
W20260709 12:23:43.791971 31324 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1160 after lost signal to thread 31327
I20260709 12:23:43.906250 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:43.948033 32502 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:43.948601 32502 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:43.949599 32640 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:43.950649 32502 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:43.978319 32502 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:43.982270 32502 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:43.985586 32502 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:43.988690 32502 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:43.991400 32502 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:43.997771 32502 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:43.999948 32502 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.001246 32502 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.004145 32686 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.004302 32502 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.004770 32686 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.008664 32502 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.009225 32502 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.018797 32502 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.022375 32502 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.025027 32502 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.027899 32502 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.030058 32502 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.031085 32502 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.033938 32502 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:43.952011 32640 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.036118 32502 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.037911 32502 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.039310 32640 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.039713 32502 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.039956 31462 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.040190 32502 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.039913 32640 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.042788 32502 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.030516 32662 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.007043 32686 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:44.053685 32502 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.054576 32502 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.055299 32502 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.060781 31462 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:44.052455 32662 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.043104 32640 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.067723 32662 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.056569 32686 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.068696 32686 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.070775 32686 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.071496 32686 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:23:44.078121 31538 consensus_meta.cc:287] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.747s	user 0.016s	sys 0.005s
I20260709 12:23:44.080317 32502 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.088408 32640 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.088999 32640 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.089478 32640 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.092324 32640 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.094079 32502 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.095121 32502 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.095120 32640 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.098153 32640 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.078610 31538 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
W20260709 12:23:44.110535 31360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.008s	sys 0.012s
W20260709 12:23:44.110922 31360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.008s	sys 0.012s
I20260709 12:23:44.120726 32683 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:44.121376 32683 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.123867 32683 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.129128 32520 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:44.130844 32520 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.140802 32520 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:44.151461 32703 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.151682 32711 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.152086 32703 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.152195 32711 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.154546 32708 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.154850 32698 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.155114 32708 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.155400 32698 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.157212 32714 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.157701 32714 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.162238 32704 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:23:44.162384 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1130) took 1831 ms (client timeout 2169 ms). Trace:
W20260709 12:23:44.162781 31538 rpcz_store.cc:269] 0709 12:23:42.328869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.330408 (+  1539us) service_pool.cc:224] Handling call
0709 12:23:44.126322 (+1795914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:44.172117 32707 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.162648 32661 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.172767 32707 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.174214 32661 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.178118 32712 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.178541 32661 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.179229 32661 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.179555 32705 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.179819 32661 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.162755 32704 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.180191 32705 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.072645 32686 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.188454 32686 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:44.178807 32712 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.190954 32712 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.191484 32712 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.191992 32712 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:44.193840 31462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1155) took 1734 ms (client timeout 2169 ms). Trace:
W20260709 12:23:44.194380 31462 rpcz_store.cc:269] 0709 12:23:42.326969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.327662 (+   693us) service_pool.cc:224] Handling call
0709 12:23:44.061293 (+1733631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:44.200323 32709 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.201393 32707 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.184329 32661 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.241915 32699 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.245399 32662 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:44.201036 32709 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.322934 32520 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.323695 32520 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.384660 32716 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:44.384773 32653 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.322628 32662 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.325917 32692 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:44.385427 32716 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.424528 32720 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.423095 32520 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:44.447520 32704 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.493383 32709 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.385557 32640 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.385532 32653 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.500830 32721 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:44.500900 32662 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.365211 32699 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.449434 32692 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.501650 32721 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.500064 32720 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.652815 32720 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.521648 32705 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.655486 32721 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.613610 32653 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.657800 32692 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:44.660084 32699 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.592105 32712 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.591418 32716 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:44.638247 32686 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.685096 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:44.691005 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:44.739578 32080 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:44.691625 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:44.741444 32686 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.744194 32686 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.764632 32732 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.765425 32732 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.768006 32732 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.768625 32732 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.769253 32732 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.771647 32686 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:44.772387 32686 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.774776 32686 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:44.775843 32732 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:44.903004 31434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.000s	sys 0.006s
W20260709 12:23:44.903885 31434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.001s	sys 0.006s
W20260709 12:23:44.911051 31436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.001s	sys 0.000s
W20260709 12:23:44.911623 31436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.002s	sys 0.000s
I20260709 12:23:44.976344 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:44.976799 32463 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:44.979789 32520 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:44.980773 32520 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.981598 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:44.983217 32635 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:44.978268 32463 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:44.985024 32635 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:44.991572 32463 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:44.983026 32082 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
W20260709 12:23:44.996048 31433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.006s	sys 0.003s
W20260709 12:23:45.050132 31433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.007s	sys 0.004s
I20260709 12:23:45.049819 32723 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.059947 32653 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.061233 32653 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.063774 32635 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.065178 32716 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.065338 32699 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.067171 32520 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.066957 32716 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.068646 32704 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.067070 32699 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.070359 32638 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.071455 32638 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.072135 32502 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.072399 32640 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.071883 32716 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.074283 32653 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:45.075043 31435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.008s	sys 0.006s
I20260709 12:23:45.074347 32638 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.063788 32692 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:23:45.078315 31435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.009s	sys 0.006s
I20260709 12:23:45.078647 32692 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.069200 32704 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.075309 32719 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.082473 32640 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.084900 31361 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:45.084892 32717 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:45.091598 31359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 2.169s (SENT)
I20260709 12:23:45.075289 32723 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.079412 32638 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.084307 32692 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:23:45.097234 31360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.009s	sys 0.006s
I20260709 12:23:45.097505 32701 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.099664 32735 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.100762 32640 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.081962 32704 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.109321 32638 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.105792 32701 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.111651 32701 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.108546 32727 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.086025 32719 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.115288 32638 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.116616 32719 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.117690 32699 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:45.107359 31360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.011s	sys 0.006s
I20260709 12:23:45.103047 32717 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.125053 32722 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.104625 32716 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.130820 32738 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.113158 32727 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.107936 32735 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.136366 32724 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.131973 32738 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.139961 32724 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.137142 32520 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.136601 32726 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.130095 32692 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.150242 32699 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.125946 32722 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:45.149331 31508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.016s	sys 0.005s
W20260709 12:23:45.156324 31508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.017s	sys 0.006s
I20260709 12:23:45.142251 32716 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.152565 32717 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.152387 32723 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.151021 32699 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.159528 32692 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.159569 32739 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.161072 32520 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.135121 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.165710 32726 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.166905 32723 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.164228 32640 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.169823 32723 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.166680 31289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38044 (request call id 246) took 2881 ms. Trace:
I20260709 12:23:45.168047 32502 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.174736 32502 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.173365 32724 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.173197 32719 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.176177 32727 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.188916 32731 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.176448 32638 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.189380 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.184963 32640 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.192262 32736 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.200045 32520 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.186123 32079 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:45.203612 31394 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:45.205282 32502 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.195518 32692 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.193365 32736 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.203698 32719 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.193696 32739 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.237483 31391 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:23:45.244555 32726 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.237093 32723 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.193650 32724 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.195559 32744 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.203652 32722 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.201239 32731 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.237260 32746 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.220450 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.173172 31289 rpcz_store.cc:276] 0709 12:23:42.282004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.282285 (+   281us) service_pool.cc:224] Handling call
0709 12:23:45.158930 (+2876645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:42.309617 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:42.310334 (+   717us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:42.310372 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:23:42.310398 (+    26us) tablet.cc:662] Decoding operations
0709 12:23:42.310749 (+   351us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:42.310807 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:42.310845 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:42.311051 (+   206us) tablet.cc:701] Row locks acquired
0709 12:23:42.311070 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:42.311205 (+   135us) write_op.cc:270] Start()
0709 12:23:42.311340 (+   135us) write_op.cc:276] Timestamp: P: 1783599822311167 usec, L: 0
0709 12:23:42.311362 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:43.912083 (+1600721us) log.cc:844] Serialized 535 byte log entry
0709 12:23:43.913401 (+  1318us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540014e454. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912b7e28 00007f6e94cf2581 00007f6e94cf1d58 00007f6e94cf69f1 00007f6e94cf69a9 00007f6e94cf6939 00007f6e94cf6901 00007f6e94cf5b2d 0000000000388634 0000000000388479
0709 12:23:44.690356 (+776955us) op_driver.cc:464] REPLICATION: finished
0709 12:23:44.720938 (+ 30582us) write_op.cc:301] APPLY: starting
0709 12:23:44.721054 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:44.721192 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:44.721232 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:44.721573 (+   341us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:44.721790 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:44.721859 (+    69us) write_op.cc:312] APPLY: finished
0709 12:23:44.722122 (+   263us) log.cc:844] Serialized 23 byte log entry
0709 12:23:44.722350 (+   228us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.722458 (+   108us) write_op.cc:454] Released schema lock
0709 12:23:44.722511 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:44.722926 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.722968 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1685,"reported_tablets":1,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":30297,"apply.run_cpu_time_us":1971,"apply.run_wall_time_us":1970,"num_ops":1,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":17611,"prepare.run_wall_time_us":1603986,"replication_time_us":2378791,"spinlock_wait_cycles":3679517952,"thread_start_us":29899,"threads_started":1}]]}
I20260709 12:23:45.222216 32638 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.207144 32520 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.278441 32738 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.259649 32743 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.288466 32463 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.218926 32662 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.206966 32741 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.292174 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.249648 32692 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.278671 32717 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.282200 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.297609 32716 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.289373 32640 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.299626 32717 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.309559 32463 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.308003 32716 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.311066 32701 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.311342 32716 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.311792 32463 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.313194 32701 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.315743 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.295434 32735 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.294284 32722 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.299758 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.303347 32699 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.313263 32716 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.296576 32743 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.353428 32736 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.373879 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.377712 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.301731 32724 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.375926 32520 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.330428 32744 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.323115 32704 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.308332 32746 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.474275 32722 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.337011 32662 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.322566 32738 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.444924 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.353454 32711 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.488116 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.358985 32742 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.490415 31388 raft_consensus.cc:2393] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:45.491199 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.488340 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.491811 31544 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:45.456882 32719 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.319856 32692 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.379371 32743 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.495424 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.492403 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.456285 32739 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.500526 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.488366 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.500880 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.526090 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1227) took 1480 ms. Trace:
I20260709 12:23:45.526316 32731 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.526546 31390 rpcz_store.cc:276] 0709 12:23:44.045261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.508198 (+1462937us) service_pool.cc:224] Handling call
0709 12:23:45.516595 (+  8397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.525622 (+  9027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.525651 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.525698 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:45.525725 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.525786 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.525908 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.527949 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.472863 31386 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:45.531024 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.528350 32704 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.533167 32738 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.539122 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.533651 32692 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.534240 31535 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:45.545045 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.517374 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.531528 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.537533 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.447000 32741 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.540138 32635 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.550413 32735 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.550825 32635 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.551136 32735 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.551649 32723 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.552323 32723 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.553164 32635 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.553756 32727 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.554629 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.554502 32727 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.544932 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.545790 31536 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:45.555644 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.553231 32735 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.560544 32747 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.553820 32635 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.538667 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.547731 31544 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:45.529125 32047 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:45.556231 31541 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:45.563171 32080 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.561358 32747 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.564801 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.565444 31467 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:23:45.565562 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.568195 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.563407 32726 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.569332 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.568868 31541 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:45.564234 31393 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.566166 32082 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.546160 32722 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.562238 32662 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.545511 32742 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.575150 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.555335 32717 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.562688 32724 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.575737 31544 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:45.566682 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.581034 32727 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.581548 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.569633 32726 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.572818 32743 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.588743 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.592787 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.596235 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.596370 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.600214 31527 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 with delete_type TABLET_DATA_TOMBSTONED (TS b63f042a541248b88888cbd3049b38ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54116
I20260709 12:23:45.600519 32743 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.602447 32082 raft_consensus.cc:1813] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Handling vote request from an unknown peer b63f042a541248b88888cbd3049b38ca
I20260709 12:23:45.602958 32708 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.603478 32082 raft_consensus.cc:2410] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:23:45.604408 31359 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:45.576617 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.612008 32738 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.610217 32715 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.605546 32711 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.587918 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.614344 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.611601 32741 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.616770 32749 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.625600 31536 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:45.625938 32749 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.616804 32744 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.617024 32746 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.617717 32726 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.591109 32635 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.618697 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.621331 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.631724 31535 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:23:45.632555 32635 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.630133 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.632823 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.633443 31389 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:45.634233 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.634414 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.634822 32743 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.635035 31389 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:45.635408 32520 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.636103 32747 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.636272 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.636705 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:45.622907 31390 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:45.628177 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.626626 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.622225 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.624504 32711 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.641500 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:45.662465 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.722771 32520 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.668787 31391 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:45.680153 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.719748 32638 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.663363 32714 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.723783 32520 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.658121 32683 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:45.725308 31324 debug-util.cc:398] Leaking SignalData structure 0x7b080008bc80 after lost signal to thread 31419
I20260709 12:23:45.725528 32520 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.640991 32747 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.721662 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:45.663055 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.642181 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.661623 32744 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.636845 32742 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.743139 32744 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.742350 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.731267 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:45.744980 31324 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d60 after lost signal to thread 31494
W20260709 12:23:45.746395 31324 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d40 after lost signal to thread 31495
I20260709 12:23:45.655107 32743 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:45.748917 32743 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.750032 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.663283 32726 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.706590 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.656260 32741 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.718667 32723 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.729058 32711 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.741776 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.731379 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.655263 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.661963 32730 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.725267 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.773255 32730 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.774883 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.775158 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.775933 31467 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:45.756311 32520 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.706640 32735 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.726895 32747 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.656834 32746 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:45.744122 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 98011.4us
W20260709 12:23:45.723429 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 82030.7us
I20260709 12:23:45.759863 31544 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:45.758792 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.708076 31291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38054 (request call id 248) took 3418 ms. Trace:
I20260709 12:23:45.757604 32741 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:23:45.741110 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 212284us
W20260709 12:23:45.761571 31324 debug-util.cc:398] Leaking SignalData structure 0x7b08001f85a0 after lost signal to thread 31568
I20260709 12:23:45.784634 31469 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:45.784998 31324 debug-util.cc:398] Leaking SignalData structure 0x7b080032e940 after lost signal to thread 32108
W20260709 12:23:45.785320 31324 debug-util.cc:398] Leaking SignalData structure 0x7b08003094c0 after lost signal to thread 32109
W20260709 12:23:45.785754 31324 debug-util.cc:398] Leaking SignalData structure 0x7b080032eb00 after lost signal to thread 32620
I20260709 12:23:45.785635 32735 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:45.786299 31324 debug-util.cc:398] Leaking SignalData structure 0x7b0800231560 after lost signal to thread 32656
W20260709 12:23:45.786590 31324 debug-util.cc:398] Leaking SignalData structure 0x7b0800296e20 after lost signal to thread 32657
W20260709 12:23:45.786944 31324 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcea0 after lost signal to thread 32665
I20260709 12:23:45.761904 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.787271 32741 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.787698 31540 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:45.788805 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.762434 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:45.656394 32635 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.742247 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.763163 32726 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.763562 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.759627 31535 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:45.667057 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.655848 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.659698 32698 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.667855 32703 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.769991 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.771564 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.779680 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.757043 32714 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.781129 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.762519 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:45.789721 31390 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:45.790330 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.791631 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.791168 32520 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:23:45.793359 31324 debug-util.cc:398] Leaking SignalData structure 0x7b08002de660 after lost signal to thread 32670
I20260709 12:23:45.795498 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.795888 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.796875 32726 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.797482 31388 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:45.781673 31291 rpcz_store.cc:276] 0709 12:23:42.290018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.290223 (+   205us) service_pool.cc:224] Handling call
0709 12:23:45.707832 (+3417609us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176470,"reported_tablets":1}
I20260709 12:23:45.800859 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.801067 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.801476 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.803629 31541 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:45.804636 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.796074 32635 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.807917 31544 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:45.802846 31542 raft_consensus.cc:2376] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2. Re-sending same reply.
W20260709 12:23:45.809244 31324 debug-util.cc:398] Leaking SignalData structure 0x7b080033a8a0 after lost signal to thread 32673
W20260709 12:23:45.809536 31324 debug-util.cc:398] Leaking SignalData structure 0x7b0800304300 after lost signal to thread 32675
W20260709 12:23:45.809737 31324 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5620 after lost signal to thread 32676
I20260709 12:23:45.791574 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.799875 32746 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.807152 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.811395 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.776968 32683 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.812861 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.804883 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.821975 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.803280 32714 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.821569 31393 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:45.822659 31392 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:45.823004 31469 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:45.824671 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.825282 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.825426 31464 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.825306 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.826836 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:45.827280 31324 debug-util.cc:398] Leaking SignalData structure 0x7b080033c260 after lost signal to thread 32685
I20260709 12:23:45.824877 31540 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:45.824682 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.827188 31465 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.833868 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.835582 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.832407 32714 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.839195 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.834405 32715 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.826368 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.843819 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.855913 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.823001 32730 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.845499 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.846907 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.850127 31290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45406 (request call id 158) took 3537 ms. Trace:
I20260709 12:23:45.853550 31388 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:45.843044 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.854892 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.851112 31543 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:45.831634 32747 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.840550 31389 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.841954 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.860754 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:45.860903 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.861166 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.851542 32715 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.862182 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.846074 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.862874 31464 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:45.865398 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.856900 31290 rpcz_store.cc:276] 0709 12:23:42.313106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.313254 (+   148us) service_pool.cc:224] Handling call
0709 12:23:43.902601 (+1589347us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540014e454. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91226090 00007f6e912c4f3a 00007f6e9707ae9c 00007f6e9717904e 00007f6e9563a2a4 00007f6e9563a232 00007f6e9563a161 00007f6e9563a0dc 00007f6e95639392 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:45.849939 (+1947338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349590,"reported_tablets":1,"spinlock_wait_cycles":3647406464}
I20260709 12:23:45.840852 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.865090 31466 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:45.854353 32744 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.867797 31393 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:45.866173 31433 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:45.870113 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.872048 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.848336 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.847877 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.878876 31470 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.879349 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.879907 31466 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:45.844096 32749 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.879817 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.876416 31465 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.842810 32743 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.883149 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.883428 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.851970 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.888571 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:45.883805 32746 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.890821 32743 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:45.891214 32743 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.891310 32744 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.846218 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.891703 32743 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:45.891798 32744 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.892284 32744 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.892763 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.893501 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.898360 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:45.900216 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:45.901589 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.902494 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.902711 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.903694 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.893703 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.906082 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.907451 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.912072 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.912174 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.912254 32735 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.913234 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.913276 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:45.914562 32735 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.914951 32735 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.915341 32735 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.913242 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.917665 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.918114 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:45.919536 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.922359 32743 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.917205 32635 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.924261 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:45.924614 31465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:45.925305 31465 raft_consensus.cc:606] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:45.925807 32635 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:45.926223 32635 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:45.926857 32635 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.905287 32047 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:45.868618 32752 tablet_replica.cc:333] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:23:45.925159 31433 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:45.931125 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.931135 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.933369 32683 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:45.934056 32048 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:45.934293 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.934935 31393 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:45.935567 31465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78881770eb254ce191fad6a8664b7430"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "b63f042a541248b88888cbd3049b38ca"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:45.936111 31465 raft_consensus.cc:606] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Received request to transfer leadership to TS b63f042a541248b88888cbd3049b38ca
I20260709 12:23:45.938990 31389 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:45.939997 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.941151 32683 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.943804 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.945027 32048 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:45.948315 32638 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:45.948700 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.949285 31467 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:45.941355 32746 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.950474 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:45.950613 32746 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.947165 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.951035 31544 raft_consensus.cc:606] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:45.951162 32746 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.939677 32753 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:45.945955 32683 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:45.953701 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.955228 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.956547 32683 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.956722 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.955062 32753 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:45.957028 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.926889 32741 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.957504 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.958381 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.966454 31469 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.958660 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.962214 31464 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:45.958137 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:45.964248 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:45.966538 32753 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:45.964619 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.964883 32732 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:45.964280 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.977880 32726 consensus_queue.cc:1059] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:45.979197 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:45.983774 31539 raft_consensus.cc:1240] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:45.984048 32050 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:45.984884 32732 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.988368 32744 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.989324 32743 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:45.991379 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.991989 32726 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.990455 32744 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.992406 32749 raft_consensus.cc:3055] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:45.992558 32726 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:45.993012 32749 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:45.994100 32749 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.994838 32726 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:45.995343 32749 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.996802 32048 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:45.997766 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.002310 32686 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.002633 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.002796 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:46.003168 32752 raft_consensus.cc:2243] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.003518 31464 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:46.003927 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.004050 32752 raft_consensus.cc:2272] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.004261 32747 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:46.004679 32747 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:46.005050 32747 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.972322 32715 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:45.985925 32683 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.007020 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:45.997646 32741 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.009447 32735 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.011525 32735 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.011096 31433 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:46.013450 32750 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.013839 32750 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.013917 32730 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.015254 32750 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.015543 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.016163 31470 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:46.014122 31507 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.017014 32048 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.017663 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.010210 32711 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.019884 32686 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.020951 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.021174 32692 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.021653 32692 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:46.021744 32520 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:46.022053 32692 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.022168 32520 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:46.022637 32520 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.027360 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.029528 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.030303 32724 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.030652 31507 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.030673 32724 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:46.031324 32724 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.031421 32638 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.022924 32741 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.033828 32520 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.028489 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:46.035562 32741 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:46.037983 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.035645 31507 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.040239 32520 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.041252 32638 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.041646 32638 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:46.041860 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:46.042032 32638 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.042986 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:46.043560 32635 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.043833 31359 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.044667 32698 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.045025 32698 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:46.045378 32698 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.045507 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.028363 32711 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.037709 32741 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.055562 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.055883 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.057039 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.058115 32692 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.060940 32683 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.061216 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.061676 32692 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.062949 31469 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:46.063699 32732 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.052184 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.052484 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.064255 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.059489 32753 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.022970 32746 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.066964 31389 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.053833 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.068161 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.068437 32715 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:46.071089 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.072043 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.054436 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.054713 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.055346 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.073966 31462 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:46.056767 32714 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.063604 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.016736 32050 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:23:46.075572 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 67793us
I20260709 12:23:46.076107 32714 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.052604 32710 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.053333 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.066164 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.074258 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.046444 31359 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.078037 31464 raft_consensus.cc:2393] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:46.080452 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.081866 31359 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.047904 32635 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.083648 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.083760 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.084614 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.084242 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.076866 32050 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.085911 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.088785 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.089171 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.087983 32711 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.091423 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.091645 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.091811 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.087641 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.092468 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.092679 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.090562 31434 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.077711 32710 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:46.093529 32710 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.093628 32638 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.095418 31434 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.082334 32714 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.077795 32746 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.095877 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.082628 32715 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.066915 32747 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.097754 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.098253 32715 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:46.099843 31359 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.100045 32750 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.100986 32662 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.101101 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.097453 32727 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.090607 32752 ts_tablet_manager.cc:1916] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:46.103730 32753 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.104322 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:46.105144 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 65556.1us
I20260709 12:23:46.114490 32741 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.107340 32751 consensus_queue.cc:1059] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:46.106572 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.097957 32714 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.111917 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.112286 32715 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.101336 32724 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.112869 32662 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.136304 32662 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.135439 32749 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.113850 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.114084 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.114313 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.114683 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.115193 32727 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:46.117195 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.106122 32732 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.117547 32048 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.118104 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.112789 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.119484 31466 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:46.119812 31386 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.125239 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.125324 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.125602 32751 raft_consensus.cc:3055] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.126099 32711 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.148507 32749 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:46.061565 32698 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.148975 32749 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.150552 32698 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.127840 31434 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.150835 32683 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.151047 32711 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:46.151506 32635 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.127133 32714 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.130404 32638 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.152956 31434 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.150645 31467 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:46.130097 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.116453 32746 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.136472 31359 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.113791 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.131572 32747 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.142452 31465 raft_consensus.cc:2393] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:46.151575 32711 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.140595 32710 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.156358 32727 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.177911 32730 raft_consensus.cc:993] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: : Instructing follower b63f042a541248b88888cbd3049b38ca to start an election
I20260709 12:23:46.154760 31469 raft_consensus.cc:2376] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2. Re-sending same reply.
I20260709 12:23:46.156916 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.153268 32751 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:46.158339 32698 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.158531 31359 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.162043 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.187371 31359 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.187450 32698 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:46.187507 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.188023 32698 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.188261 31359 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.165520 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:46.166139 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:46.167994 32635 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.271072 32638 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:46.271395 32703 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:46.272192 32638 raft_consensus.cc:3055] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.272574 32638 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:23:46.272286 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 84079.6us
I20260709 12:23:46.273567 32638 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.172670 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.172832 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.276253 32741 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.178396 32520 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.180241 32730 raft_consensus.cc:1081] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Signalling peer b63f042a541248b88888cbd3049b38ca to start an election
I20260709 12:23:46.180320 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.183172 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.277880 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.250475 32752 ts_tablet_manager.cc:1929] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:46.163968 32076 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.278806 32752 log.cc:1199] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: Deleting WAL directory at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/wals/34b617a3dcc54fb4b4d2c6cda2c6cc55
I20260709 12:23:46.276847 32520 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.280902 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.281176 32520 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.281718 31535 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:46.281510 31278 catalog_manager.cc:5028] TS b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): tablet 34b617a3dcc54fb4b4d2c6cda2c6cc55 (table test-workload [id=1802af488d51463c82a3b2082c7c894b]) successfully deleted
I20260709 12:23:46.184155 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.200037 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.242734 32702 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.283759 32702 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:46.284322 32702 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.199522 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.133090 32750 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.188268 32699 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.261735 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.252601 31434 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.292366 31434 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.293529 32635 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.294615 31434 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.295339 32635 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.296941 31434 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.264209 32751 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.171954 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.171295 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.275182 32638 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:46.285547 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 101461us
I20260709 12:23:46.252048 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:46.253248 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.297365 32724 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.297693 31470 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:46.303097 31434 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.310549 31434 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.311254 32746 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.311858 32746 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.312136 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.314159 31434 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.315064 32746 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.316277 31434 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.252416 32726 consensus_queue.cc:1059] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:23:46.287740 32686 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.272912 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.243055 32714 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.253113 32747 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:23:46.301142 32730 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.268790 31507 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.253427 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.309162 32635 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.333916 31395 raft_consensus.cc:2393] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:23:46.329928 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 152352us
I20260709 12:23:46.332537 31434 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.336153 32741 consensus_queue.cc:1059] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:46.337452 32724 raft_consensus.cc:3055] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.337877 32724 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:46.338984 32724 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.340626 32724 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.343370 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:23:46.346518 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 72659us
I20260709 12:23:46.323787 32746 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.350308 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:46.348167 31507 raft_consensus.cc:2686] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P b63f042a541248b88888cbd3049b38ca: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:23:46.352887 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 84155.6us
I20260709 12:23:46.353951 31507 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.355011 31507 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.332648 32726 raft_consensus.cc:3055] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.356684 32520 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.345746 32750 consensus_queue.cc:1059] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:23:46.349510 32743 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.347525 32703 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:46.365372 32703 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.366078 32710 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.359522 31507 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.369372 31391 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.369325 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.370247 31469 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:46.352097 32760 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:23:46.369388 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 185588us
I20260709 12:23:46.372087 32638 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.374768 32520 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:46.378631 32714 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.380951 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.383657 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.384150 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.384349 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.399658 32520 raft_consensus.cc:3055] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.384846 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.400038 32520 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:46.357542 32692 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.400763 32746 raft_consensus.cc:3055] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.401252 32746 raft_consensus.cc:740] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.400866 32520 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.402164 32715 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.402275 32746 consensus_queue.cc:260] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.391502 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.386773 32662 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.402968 32760 consensus_queue.cc:1059] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:46.357986 32726 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.397950 31465 raft_consensus.cc:2393] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:46.396950 32050 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.394402 32751 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.402247 32520 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.429944 32083 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.390836 32698 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.432210 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:46.433548 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:46.434154 32715 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.434412 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:46.434650 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:46.435650 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:46.435773 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.439155 32683 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.439297 32050 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.440071 32715 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.440934 32711 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.420024 32662 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.391716 32702 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.446489 31469 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:46.448871 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63136us
I20260709 12:23:46.437740 32746 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.451277 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.419730 32726 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.455328 32698 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.452833 31510 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.457792 32520 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.457650 32727 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.457873 32683 consensus_queue.cc:1059] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:46.458290 32520 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.458643 32520 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.458914 32683 raft_consensus.cc:3055] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.459290 32683 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:46.459842 32727 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.460065 32683 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.455349 32726 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.443293 32732 raft_consensus.cc:3055] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:46.449936 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 74068.4us
I20260709 12:23:46.446461 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:46.432766 32749 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.466967 32749 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.466826 32520 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.468621 32520 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.461381 32683 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.470923 32082 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:46.473160 31434 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.448665 31387 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.478008 31434 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:46.484372 31537 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.485837 31535 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:46.486205 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.487818 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.488363 31538 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.488649 32702 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.490249 31544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78881770eb254ce191fad6a8664b7430"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
 from {username='slave'} at 127.0.0.1:54134
I20260709 12:23:46.490881 31544 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.491211 31544 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.492973 31434 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.500735 31434 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.468124 32732 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:46.501672 32730 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.480998 32711 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.513079   302 consensus_queue.cc:1059] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:46.519680   303 consensus_queue.cc:1059] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:46.505787 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63324.6us
I20260709 12:23:46.492020 32749 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.526187 31436 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.502285 32743 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.505602 32750 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:46.536729 32520 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.536839 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:23:46.540920 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 108874us
I20260709 12:23:46.545593 31467 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.546799 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.547199 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.529007 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.544652 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.548993 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:46.536451 32743 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.559998 31391 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:46.566627 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.567286 31510 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.568640 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.568677 31510 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.570833 32520 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.571192 32520 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.571761 32520 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.574119 31436 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.573349 31544 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.563575 32050 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.560545 32638 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.578145 32638 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:46.578531 32638 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.580386 32762 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.580760 32762 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.581100 32762 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.547477 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.583153 31436 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.563288   304 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.584738 31436 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.585232 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.586302 31544 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.586815 32747 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.587843 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.587960 31393 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.588464 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.589784 31540 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.589982 32520 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.590677 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.591121 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.591514 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:46.565369 32743 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.598719 31395 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.595136 31436 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.595901 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.600899 31436 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:46.585592   306 raft_consensus.cc:993] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: : Instructing follower 842fbe33f4144fa69f1fd428652b6998 to start an election
I20260709 12:23:46.603003 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.562479 32753 consensus_queue.cc:1059] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:23:46.592077   303 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.606523 32520 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.607945 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.608000 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.606556 31510 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.609381 32747 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:46.613149 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.592080 32686 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.612746 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.606799 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.625021 31466 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:46.625622 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.625797 32717 raft_consensus.cc:1081] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Signalling peer 842fbe33f4144fa69f1fd428652b6998 to start an election
I20260709 12:23:46.626017 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.626196 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:46.626731 32717 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.613940 31470 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.608484 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.615868 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.628557 31433 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.630409 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.621268 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.597862 32635 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.639607 32735 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.640961 32746 raft_consensus.cc:993] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:46.641227 32747 raft_consensus.cc:697] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.641455 32744 raft_consensus.cc:1081] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
I20260709 12:23:46.642223 32747 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.626205 31465 raft_consensus.cc:2376] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2. Re-sending same reply.
I20260709 12:23:46.635870 31539 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:46.647670 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.649163 32730 raft_consensus.cc:3055] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.649556 32730 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.650122 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.650357 32730 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.651688 31543 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.651682 31433 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.652819 32744 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.653103 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:46.602897 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.637188 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.650830 32727 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:46.655208 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 107338us
I20260709 12:23:46.606865 32662 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.657155 31436 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.659880 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.660512 31434 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.627125 32717 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.663604 31392 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.643594   304 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.644038   302 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.667312 31395 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.638792 32724 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:46.581848 32732 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.669090   303 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:46.668500   301 consensus_queue.cc:1059] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:23:46.675289   301 raft_consensus.cc:3055] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.673121 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.675678 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:23:46.676200 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 44267us
I20260709 12:23:46.667996 32635 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.676964 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.664803 32717 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:46.679734 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 74913.9us
I20260709 12:23:46.680322 31510 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.677238 32698 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.658962 32744 consensus_queue.cc:1059] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:23:46.684439 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.670325 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:46.670234 32727 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.663372 32751 consensus_queue.cc:1059] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:23:46.656023 32686 consensus_queue.cc:1059] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:23:46.689245 32767 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.691711 32662 raft_consensus.cc:3055] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.692106 32662 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.692010 32743 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.693002 32662 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.693774 32638 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.694113 32743 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:46.672047 32724 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.694175 32662 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.694717 32724 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.696089 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.694976 32732 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.700078 32759 raft_consensus.cc:3055] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:46.700451 32759 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:46.701267 32759 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.685415 32730 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.675702   301 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.694785 31464 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:46.703219 31361 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.689599 31510 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.705751 31510 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.707298 32763 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.705049 32753 raft_consensus.cc:3055] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.708318 32753 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:46.708699 32638 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:46.710150 31510 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.710482 31538 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.711191 31510 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.709431 32763 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.712671 31510 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.713155 32763 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.713915 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.702556 32759 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.715553 31434 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.716140   311 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.716150 32638 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.723520 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.703702   309 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.719044 32749 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:46.706566 32702 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.726872 32757 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.727130 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.724023 32743 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.724036 32638 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.725512 32749 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.727885 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:46.732424 31535 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.721907 32763 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.728586 31538 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.736408 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.709161 32753 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:46.731920 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 72090.4us
I20260709 12:23:46.732079 32638 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.732679 32749 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.729250 32764 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.740978 32757 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:46.741829 32702 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.742292 32763 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.726353   311 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.745265 31469 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:46.750281 31510 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.751096 31359 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.765183 32751 raft_consensus.cc:3055] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:23:46.752202 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 95118.6us
I20260709 12:23:46.751096 31361 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.771761 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.741039 32686 consensus_queue.cc:1059] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:23:46.779582   310 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.780798   306 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:46.778694 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:23:46.823896 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 72882.9us
I20260709 12:23:46.824051 31359 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.787600 32757 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:46.828069 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 49444.5us
I20260709 12:23:46.829950 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.772763   311 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.828099 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.830159 31436 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.830782 32520 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.831580 31510 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.773432 32751 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:46.753077 32743 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:23:46.768054 32702 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:46.837283 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.837622 31538 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.837934 32703 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.838857 32765 consensus_queue.cc:1059] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:46.840849 32520 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.775969 32715 consensus_queue.cc:1059] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:23:46.825121 32753 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.841286 32520 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.845165 32520 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.829334   306 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:46.828732 32711 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.843904 31510 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:23:46.843089 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 54400.3us
I20260709 12:23:46.846426 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.848759 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:46.849696 31387 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56522
I20260709 12:23:46.851585 32638 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.840867 32758 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:46.850401 32726 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.858894 31543 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.853827 31387 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.849829 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:46.859398 31387 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.842466 32702 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.846004 32698 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.857017 32638 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.832178 32767 consensus_queue.cc:1059] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:23:46.859683 32750 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.863399 32735 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:46.867676 31538 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.852188   310 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.849359   306 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.849179 32756 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:46.869959 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.823549   301 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.861200 32741 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.885090 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.874136 32520 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.902980 32726 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.885195 32743 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:23:46.884963 32735 consensus_queue.cc:1059] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:23:46.873390 32710 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:46.915091 32735 raft_consensus.cc:3055] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.915563 32727 raft_consensus.cc:3055] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.916085   302 consensus_queue.cc:1059] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.879325 32749 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.922420 32520 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.925989 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.936460 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.937529 31361 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.921626 32735 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.924461 32727 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:46.891698 32741 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:46.950366 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 101673us
I20260709 12:23:46.951064 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.951331 31510 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.952633 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.954092 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.880746   311 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.949661 32766 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.958338 32520 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.958834 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.908595 32762 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.961246 31510 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.962105 31510 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.942092 32703 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.967509 31361 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:46.879635 32751 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.967783 32698 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:23:46.969463 32727 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.970992 31539 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.911193 32763 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.955389 32741 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.923811 31387 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.971676 31510 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:46.958084 32714 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.967465 32758 raft_consensus.cc:697] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:46.973034   305 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.983577 32692 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.959553 32765 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.974283 31541 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.977494 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:46.964797 32756 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.991386 31540 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.978701 32710 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:46.992070 32710 raft_consensus.cc:697] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:46.992934 32710 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:46.993439 32699 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:46.995931 32724 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:46.965814 32638 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:46.973626 32686 raft_consensus.cc:3055] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.990131 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.990983 32762 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:46.996811 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.997435 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.980400   313 raft_consensus.cc:3055] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.998441 31395 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.999439 31470 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:46.975337 32764 raft_consensus.cc:3055] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.007925 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:47.009091 31466 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.010365 31467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:42116
I20260709 12:23:47.017019 31467 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:47.017357 31467 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.010990 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:46.986665 31291 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 3, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 3 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:47.024240 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 56816.2us
I20260709 12:23:47.024757 31361 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.020596   313 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:47.004124 32686 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:47.026113   313 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.027495   313 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.032497 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.019737 32727 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.015810 32764 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.021799 32751 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.020483   317 consensus_queue.cc:1059] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:23:47.039402   317 raft_consensus.cc:3055] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.039737   317 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.040479 31462 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:47.040589   317 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.041558 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.041790   317 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:47.042848 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.038374 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.031670 31536 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:47.050509 32763 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:47.035204 32692 consensus_queue.cc:1059] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:23:47.052597 32692 raft_consensus.cc:3055] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.053023 32692 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.052634 32735 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.053870 32735 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.023317 32762 consensus_queue.cc:1059] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:47.054848 32762 raft_consensus.cc:3055] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.055163 32762 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.056140 32762 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.057476 32762 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.037348   319 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.074337 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.074252 31467 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.075994 31461 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.077436 31361 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.080382 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.082669 31467 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:47.079509   319 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:47.084569   319 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:47.084677 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:47.084969   319 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.085258 31539 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.085601 31539 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.088128 31539 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.095765 31392 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.096692 31539 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.093736 32703 consensus_queue.cc:1059] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:23:47.095489   311 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:47.101230 32686 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.053871 32692 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.102428 32686 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.102536 32692 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.103073 32766 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.105646 31470 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.108803 31535 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:47.113272 31539 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:47.114743 31361 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.088383 32764 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.116586 32764 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.116636 32699 raft_consensus.cc:3055] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.113564 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.125479 31434 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:47.126178 32698 raft_consensus.cc:3055] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.109555 32080 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:47.127249 31434 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:47.113050   302 consensus_queue.cc:1059] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:47.124202   301 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.155694 31361 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.125579 32710 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.119632 32699 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.165024 31361 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.122723 31387 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:47.123049   318 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.147429 32717 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.092077 32758 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.144019 32749 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.146627 32703 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.141762 32698 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.160169 32735 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.183282 32080 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.119053 32702 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.165934 32767 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.174362 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:47.165798 32724 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:47.174904 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:47.185248 32732 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:47.217706 32732 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.219409   311 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.219771 32732 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:47.219959   311 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.220890 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:47.221074   305 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:47.222127   305 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:47.223371 32756 raft_consensus.cc:3055] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.223726 32756 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.177330 32711 raft_consensus.cc:3055] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.177430 31290 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.181268 32082 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:47.182798   316 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:23:47.183259   312 raft_consensus.cc:3055] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.229801 31541 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.229939   312 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:47.183398 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:47.230690 32083 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.183899 31540 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.173938 32710 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.184305 32698 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.175442 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.192384 31537 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.196673 32765 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.197032 31536 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.197122 32766 consensus_queue.cc:1059] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:47.197763 31341 auto_rebalancer.cc:629] Failed to schedule move for tablet dd5214a2e2a24f0c93da1f05318d0380: Illegal state: Replica 842fbe33f4144fa69f1fd428652b6998 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:23:47.197786 32735 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:47.199692 31361 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.196549 32717 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:47.206773   310 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.213263 32699 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.183132   320 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:23:47.225874 32749 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:47.224576 32756 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.248569 32756 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.172145   318 raft_consensus.cc:697] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.229404 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:47.227857 32638 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.226974 32711 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.234270   302 consensus_queue.cc:1059] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:23:47.243244 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.256640 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:47.244266 32735 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.245664 32710 raft_consensus.cc:3055] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:47.232908   301 consensus_queue.cc:1059] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:23:47.236501 31386 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.253556 32083 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:47.254277 31464 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:47.238449 31535 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.264724   319 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.241662 32703 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.265985 32714 consensus_queue.cc:1059] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:47.266681 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.266968   319 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:47.267414 32662 raft_consensus.cc:3055] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.267867 32662 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:47.259459 32710 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.269361 32766 raft_consensus.cc:3055] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.268831 32662 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.220916   311 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.256893 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:47.258157 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.253916 32638 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.267129 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:47.280457 31470 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:47.282058 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:47.282634 32079 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.283685 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.287817   319 raft_consensus.cc:3055] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.288199   319 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.288952   319 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.289489 31469 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.290105   319 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:47.290446 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.242306   321 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:23:47.298336 32082 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:47.251612 31465 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:47.269778 32710 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.269778 32766 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.269989   312 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.310103   312 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.307184 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:47.280112 32732 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:47.310583 32698 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.315840 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.242551   306 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.307888 32080 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:47.281450 32686 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:23:47.320835 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.320174 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.311936 32662 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.326920 31388 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:47.331126 31395 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.332783 31538 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.306594 32714 consensus_queue.cc:1059] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:23:47.260919 32757 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:23:47.332953 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.332226 31394 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.315186 32732 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.345431   306 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:47.341370 31536 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:47.311455 32711 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.350446 32711 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.329577 32710 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.354255 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.305946 32638 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:47.351492   320 consensus_queue.cc:1175] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b63f042a541248b88888cbd3049b38ca" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:47.330500 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:47.356544 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.348129 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.361074 32703 raft_consensus.cc:3055] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.361366 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.362119 32699 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.362429 31386 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:47.361460 32703 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.368453 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.369226 32638 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.315850 32749 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.370067 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.370329   313 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:47.371389 32703 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.372665 32703 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.352528 32702 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:47.381393 31392 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:47.383807 32765 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.384999 32715 raft_consensus.cc:3055] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.385449 32715 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:47.386258 32715 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.333316 32741 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.388732 31391 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:47.360646 32079 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:47.387163   301 raft_consensus.cc:3055] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.403436   301 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:47.404368   301 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.405642   301 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.407310 32715 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.409801 31393 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:47.399421 31538 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.399474   317 raft_consensus.cc:3055] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.401409 32741 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:47.402240   313 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:47.317937 32766 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.419787 32766 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.420903 31461 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
W20260709 12:23:47.411657 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.422340 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:47.412617 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.414996 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.423132 31465 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:47.422892 31510 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:47.425858 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.426080 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.415606   317 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.363644 32758 consensus_queue.cc:1059] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:23:47.433378 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:47.438279 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:47.439170 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.443011 31361 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.444353 31538 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:47.428887 32762 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.424156 32702 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:23:47.447320 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.437654 32732 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:47.448119 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:47.447686 31390 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:47.450361   310 consensus_queue.cc:1059] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:47.434298 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.453991 31393 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:47.450387 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.431792 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:47.446350 32741 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.432520 32050 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:47.487768 32702 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.488744 32702 raft_consensus.cc:3055] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.489137 32702 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.490227 32702 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.492194 31507 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.493292 32717 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.493436 31507 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.494086 32717 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.494613 32717 raft_consensus.cc:697] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.494655 31507 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.495437 32762 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.495549 32520 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:23:47.495792 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 66969.7us
I20260709 12:23:47.496452 32520 raft_consensus.cc:697] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.496657 32762 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.497414 32520 consensus_queue.cc:237] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:47.499131 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 56197.9us
I20260709 12:23:47.363399   318 consensus_queue.cc:237] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.502666 31507 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.509014 32741 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:47.524569 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 77819.9us
I20260709 12:23:47.536123 31391 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
W20260709 12:23:47.537861 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.539865 32763 raft_consensus.cc:3055] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.550052 32763 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.551031 32763 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.552546 32763 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:47.540192 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.543012 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.546936 32702 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:47.543161 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.561362 31461 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.543820   325 raft_consensus.cc:3055] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.562254   325 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.505741   305 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.563400   325 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.565289   325 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:47.570014   324 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:23:47.576077 32717 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.500756   317 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:47.581467   326 log.cc:927] Time spent T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:23:47.588941 32756 consensus_queue.cc:1059] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:47.589998 32756 raft_consensus.cc:3055] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.590325 32756 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.598585 31388 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:47.591174 32756 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:47.600906   317 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.601707 32756 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.504967 32732 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:47.605146 32732 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:47.605816 32732 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:47.597693 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 69097.8us
I20260709 12:23:47.610574 31361 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.611452 32711 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.611581 32703 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:47.611948 32711 raft_consensus.cc:697] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.612090 32703 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.612782 32711 consensus_queue.cc:237] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.614141 32703 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:47.616780 31361 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.617835 31395 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:47.620790 31389 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:47.615800 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:47.621591 31538 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:47.622843 31359 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:47.628049 32699 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.627905 32766 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.663579 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.662597 32699 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:47.677673 32699 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.685312 32710 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.685953 32699 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.690027 32699 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:47.690773 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:47.674988 32766 raft_consensus.cc:697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.707544 32715 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:47.708032 32766 consensus_queue.cc:237] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.708190 32715 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.717020 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.717649 31462 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:47.720502 31538 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:47.722362 31359 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:47.723953 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:47.724917 31536 raft_consensus.cc:2393] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:47.726051 32076 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:47.728799 31461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:47.729488 31461 raft_consensus.cc:606] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:47.729933 31461 raft_consensus.cc:614] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:47.732301 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:47.733016 31536 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:47.733976 32047 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.734977 32686 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.735260 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.735857 32749 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:47.749801 32082 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:47.760814 32699 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.761520 32699 raft_consensus.cc:697] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.761312 32662 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:47.734701 32732 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.761543   325 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.764448   325 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.765208 32732 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:47.765406   325 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.767578 31539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:47.768430 31539 raft_consensus.cc:606] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.768898 31539 raft_consensus.cc:614] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:47.710999 32715 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:47.784935 31292 catalog_manager.cc:5697] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:47.787739 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 70775us
I20260709 12:23:47.762658 32699 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.790125 32732 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.795042 32715 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:23:47.817051 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 81882.7us
I20260709 12:23:47.818871 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:47.819965 31541 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:47.832353 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:47.835304 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.836756 32703 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.837172 31507 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.837339 32703 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.838358 32703 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.838650 31507 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.840611 31507 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.842326 32756 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.839175 32763 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.844154 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:47.833503 31461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "b63f042a541248b88888cbd3049b38ca"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:47.848205 31461 raft_consensus.cc:606] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Received request to transfer leadership to TS b63f042a541248b88888cbd3049b38ca
I20260709 12:23:47.848353 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:47.849185   306 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:47.849872   306 raft_consensus.cc:697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.851814 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:47.853546 32686 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.854545 32079 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:47.855149 32756 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.856256 32756 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.842146 31507 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.862195 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:47.864481 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:47.821079 32715 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.841921 32702 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.862149 32749 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.861845 31394 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:47.873360 31507 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.850965   306 consensus_queue.cc:237] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.879928 31394 pending_rounds.cc:85] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 1
I20260709 12:23:47.891294 31395 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:47.895634 31394 pending_rounds.cc:107] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:47.878017 32763 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.895668 32715 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:47.891717 31470 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:47.884197 32080 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:47.902073 31462 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:47.885334 31507 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.866011 32717 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:47.896023 31394 raft_consensus.cc:2889] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:47.882555 32762 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.905640 31507 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.879838 32749 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.892711 32702 raft_consensus.cc:697] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:47.910650 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:47.912459 31539 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:47.897362 32765 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:23:47.915580 31541 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:47.925542 32749 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:47.922067 32762 raft_consensus.cc:697] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.927805 32762 consensus_queue.cc:237] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.932760 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:47.933447 31395 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:47.915128 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:47.941275 32520 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.913869   305 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.940696 31433 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:47.947999 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:47.949036 31395 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:47.942548 32520 raft_consensus.cc:697] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.908392   345 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.908134 32763 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.951310 32048 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:47.945453   335 log.cc:927] Time spent T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:23:47.907972 32764 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:23:47.955698 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.954262 32520 consensus_queue.cc:237] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:47.908887 32717 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:47.954819   312 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.993106   312 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.964445 32715 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:47.993577   312 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.965965   305 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.981396 32763 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:47.966331   319 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:23:47.943066 32050 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:23:48.004833   339 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 12:23:48.006433 32717 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:47.984489   342 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.976025   301 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:23:47.953117   345 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.000756 32715 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:23:48.022444 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.026994 31462 raft_consensus.cc:1275] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.027909   312 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.029528   312 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:48.021724   347 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:23:48.020008 32715 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.033425 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:48.037206 31387 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.043421 32763 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.019546 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:48.044605 32079 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:48.046134 31510 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:48.048861   305 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.010550 32702 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.063503   318 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.063941   318 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:48.064285   318 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.068745 31291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38054 (request call id 251) took 1118 ms. Trace:
I20260709 12:23:48.079483 32686 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:48.020325   342 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.091357   342 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:48.035342 32766 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:23:48.084546 32686 raft_consensus.cc:697] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:48.094715   301 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:48.094624 32686 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.095363   301 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.098907 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.099860 31395 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 2: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:48.101881   301 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.069151 31291 rpcz_store.cc:276] 0709 12:23:46.950188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.950360 (+   172us) service_pool.cc:224] Handling call
0709 12:23:48.068664 (+1118304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:47.281568 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:47.419274 (+137706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:47.419321 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:23:47.419339 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:47.419762 (+   423us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:47.419853 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:47.419886 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:47.420386 (+   500us) tablet.cc:701] Row locks acquired
0709 12:23:47.420440 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:23:47.420610 (+   170us) write_op.cc:270] Start()
0709 12:23:47.420841 (+   231us) write_op.cc:276] Timestamp: P: 1783599827420554 usec, L: 0
0709 12:23:47.420866 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:23:47.421572 (+   706us) log.cc:844] Serialized 539 byte log entry
0709 12:23:47.815923 (+394351us) op_driver.cc:464] REPLICATION: finished
0709 12:23:47.993500 (+177577us) write_op.cc:301] APPLY: starting
0709 12:23:47.993607 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:47.993725 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:47.999562 (+  5837us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:47.999889 (+   327us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:48.000131 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:48.000184 (+    53us) write_op.cc:312] APPLY: finished
0709 12:23:48.006065 (+  5881us) log.cc:844] Serialized 23 byte log entry
0709 12:23:48.006227 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:48.006303 (+    76us) write_op.cc:454] Released schema lock
0709 12:23:48.006354 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:48.006707 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:48.006731 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8178,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":177272,"apply.run_cpu_time_us":2342,"apply.run_wall_time_us":13183,"num_ops":1,"prepare.queue_time_us":160004,"prepare.run_cpu_time_us":20289,"prepare.run_wall_time_us":281984,"raft.queue_time_us":451915,"raft.run_cpu_time_us":25474,"raft.run_wall_time_us":134579,"replication_time_us":394879,"spinlock_wait_cycles":73610112,"thread_start_us":483925,"threads_started":4,"wal-append.queue_time_us":130756}]]}
I20260709 12:23:48.118155 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.094822 32732 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:48.094619   318 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.158963 32079 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:48.158983 31290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38044 (request call id 247) took 1263 ms. Trace:
I20260709 12:23:48.173475 31465 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.183219 32080 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:48.191118 31541 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.193691 31470 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.211931 32662 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.212638 32662 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.216430 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.217042 31395 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:48.217312 32662 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.261232 32764 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:23:48.173978 31387 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
W20260709 12:23:48.269646 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 305930us
I20260709 12:23:48.279448 31470 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.246428 32766 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:23:48.271026 32715 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.286355 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.293639 31395 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:48.270705 31465 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.294859 32724 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:48.295531 31468 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.296362   354 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.290720   318 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.290859 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:48.296901 32715 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.296857   354 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.296922 32638 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:48.299078 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:48.309831 31391 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.280412   312 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.350941   345 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.351327   312 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.299178 31387 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.352811 32764 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.353938 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.354547 31388 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:48.316243 31395 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:48.318614 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:48.321710   313 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.327586 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:48.330029 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.360415 31539 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:48.331954 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.333662 32077 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:48.336897 32715 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.342235 31465 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:48.359894 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.342345 31289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45406 (request call id 159) took 1028 ms. Trace:
I20260709 12:23:48.393107 31289 rpcz_store.cc:276] 0709 12:23:47.313901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.316045 (+  2144us) service_pool.cc:224] Handling call
0709 12:23:48.342273 (+1026228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29398,"reported_tablets":7}
I20260709 12:23:48.324536 32083 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:48.163178 31290 rpcz_store.cc:276] 0709 12:23:46.895770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.895969 (+   199us) service_pool.cc:224] Handling call
0709 12:23:48.158927 (+1262958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:47.663422 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:47.677944 (+ 14522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:47.677983 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:23:47.678008 (+    25us) tablet.cc:662] Decoding operations
0709 12:23:47.678411 (+   403us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:47.678460 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:47.678497 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:47.678700 (+   203us) tablet.cc:701] Row locks acquired
0709 12:23:47.678722 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:23:47.678871 (+   149us) write_op.cc:270] Start()
0709 12:23:47.678997 (+   126us) write_op.cc:276] Timestamp: P: 1783599827678826 usec, L: 0
0709 12:23:47.679022 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:23:47.700234 (+ 21212us) log.cc:844] Serialized 544 byte log entry
0709 12:23:48.012997 (+312763us) op_driver.cc:464] REPLICATION: finished
0709 12:23:48.030369 (+ 17372us) write_op.cc:301] APPLY: starting
0709 12:23:48.031441 (+  1072us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:48.046807 (+ 15366us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:48.051344 (+  4537us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:48.051605 (+   261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:48.051751 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:48.051792 (+    41us) write_op.cc:312] APPLY: finished
0709 12:23:48.051967 (+   175us) log.cc:844] Serialized 23 byte log entry
0709 12:23:48.052126 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:48.052195 (+    69us) write_op.cc:454] Released schema lock
0709 12:23:48.052228 (+    33us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:48.052616 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:48.052644 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8190,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":2590,"apply.run_cpu_time_us":1580,"apply.run_wall_time_us":29064,"mutex_wait_us":747,"num_ops":1,"prepare.queue_time_us":425415,"prepare.run_cpu_time_us":3311,"prepare.run_wall_time_us":38956,"replication_time_us":331167}]]}
I20260709 12:23:48.343855 31470 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.344710 31538 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:48.345705 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:48.346014 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.298921   354 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:48.350734 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.357206 31391 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:23:48.400156 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 478388us
I20260709 12:23:48.406870 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.408550 31388 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.361941 31389 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.353506   312 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.394759 31510 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:48.393965 32520 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:23:48.318907 32735 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.403194 31543 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:48.419461 32735 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.426954   305 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:48.429396 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:48.429615   305 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:48.430544 32735 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.400482 32749 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.359047 32724 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:23:48.410933 31537 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.439999 32083 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:48.402123 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.445847 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:48.446628 31470 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:23:48.391441   313 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.430862   305 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.435997 32735 raft_consensus.cc:993] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998: : Instructing follower b63f042a541248b88888cbd3049b38ca to start an election
I20260709 12:23:48.403393 31535 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:48.399471 32715 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.431721   354 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.436445 32686 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.417212 32047 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:48.431669   306 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:23:48.459708 31469 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:48.439617 32749 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.459940 32735 raft_consensus.cc:1081] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Signalling peer b63f042a541248b88888cbd3049b38ca to start an election
I20260709 12:23:48.460404   301 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.453850 31387 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:48.515559   360 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:48.520799   360 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.514729 32766 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.452754 32698 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:23:48.521255   360 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:48.520371 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 63894.1us
W20260709 12:23:48.528687 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 120487us
W20260709 12:23:48.514959 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 112518us
I20260709 12:23:48.461174 32686 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.461256   354 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.513599 32763 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:23:48.544883 32520 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.523408 32077 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:48.555305 32520 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.558136 32520 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.522712 32766 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.523337   301 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.571296 32638 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:48.573737   318 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.563529 32662 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.579165 31541 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:48.559751 32702 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:48.594013 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.595542 31539 raft_consensus.cc:2410] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:48.561808   355 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:48.580487   354 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.628413 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:48.629745 31462 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:48.581702 32638 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.585369 32735 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 12:23:48.635290 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 92557.6us
I20260709 12:23:48.635808   312 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:48.593552   318 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.647609 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:48.648231 31462 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:48.596421 32662 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.634797   313 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.606915 32702 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.651603 31434 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:48.633553   355 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.650933   354 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.658967 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:48.652196 32724 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:48.666515   366 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:23:48.660295 32715 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.659564 32749 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.663174   354 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.700858 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:48.663200 31395 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.678956 32686 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:48.663067   376 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.701593 32080 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:48.679171 31537 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:23:48.679783 32520 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.680157 32638 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.680189 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:48.709702 31462 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:23:48.681880   318 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.659127   357 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.682596 32724 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.683955 32662 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.684911 32766 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.660342   373 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:23:48.660403   313 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.693989 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.649268   312 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.707439 32520 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.715107 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:48.718614   301 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.723210 31433 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:48.707415 32749 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.730549   382 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.748175 32749 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.748412   382 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.748930   355 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:48.750237 32702 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.750348 32749 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.707017   376 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.750995   376 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.750581   382 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.737464 32080 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
W20260709 12:23:48.753726 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 93159.8us
I20260709 12:23:48.760960 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.762912   355 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.757678 31433 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:48.772015 32749 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:48.716131 32717 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:23:48.732118 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:48.779546 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.780306 31395 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:48.780628 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.781765 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.781857 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.782774 31392 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:48.784055 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.785141 31388 raft_consensus.cc:2410] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:48.785926 32766 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:48.786607 32766 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.789381 32766 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.725318   310 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:23:48.798553 32520 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:48.799015 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:48.796840 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:48.747742 31387 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:48.805619 32048 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:48.808845 32520 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.804138 31361 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:48.809249 32520 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:48.809633 32520 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:48.770994 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 77716.6us
I20260709 12:23:48.770337 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:48.816597 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.821349 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.821462 31543 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:48.819741 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:48.822029 31544 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:23:48.822587 31538 raft_consensus.cc:2393] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:48.824301 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:48.828115 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 71330us
I20260709 12:23:48.826615 32048 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:48.729430   357 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.830121 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:48.827167   385 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:48.827191   378 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:48.832599 31539 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:48.820505 32686 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.831607   301 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.846519   325 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:48.853670   301 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.854260   301 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.854048   325 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.854789 31537 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.856071   312 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.856760   312 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:48.857151   312 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.858922   312 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.830684 32758 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:48.860342 32758 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.861816 32724 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:48.862228 32758 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.840827 32081 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:48.829392   345 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:48.834007 31544 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:48.850625 32715 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.851959   386 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.845546   385 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.853230   354 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:48.820557   317 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.799021   360 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:48.840217   384 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:23:48.874300 31433 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:48.883476 31433 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:48.847766 32686 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.886243 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.864717 32047 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:23:48.904570 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 65741.7us
I20260709 12:23:48.908222   385 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.864909   378 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.918757   378 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:48.872605 32715 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.920650   357 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:48.874293   317 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.880244   345 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:48.910984 32686 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.915532 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:48.925535 32662 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:48.926129   381 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:48.879045   386 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:48.927896 32715 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.931032   317 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.938894 32749 raft_consensus.cc:697] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:48.976938 32520 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:48.998505 31538 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:48.941694   381 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.947738 31387 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:49.013830   386 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:49.000725   378 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:48.947837 32662 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.010711   381 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.027581 32749 consensus_queue.cc:237] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.028291   360 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:48.941233   345 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.001381   318 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.028389   386 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.029284   378 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.043752   319 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.052386 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.053244 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.015817   325 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.055008   385 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.057796   386 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.080056 32520 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:49.069463 32702 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.084110   386 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:49.084976 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:49.085758 31387 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.086620   381 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.088438 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:23:49.056916   377 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.377s	user 0.005s	sys 0.000s
I20260709 12:23:49.056316 32741 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.104458 31535 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:49.058703   378 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.124491 32084 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:49.071911   373 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.062791   317 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.089326   385 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.128180   325 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:23:49.057906   374 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:23:49.131855 31544 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:49.056748   318 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.133261 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:49.068795   319 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.092342 32079 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:49.136049 31389 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:23:49.140668   385 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:49.116748   381 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:49.147276   371 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.149624 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:49.151072 32047 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:49.158210   360 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.158567   360 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.095888 32702 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.154562 31359 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:49.150861 31289 catalog_manager.cc:5697] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:49.134179 31537 raft_consensus.cc:1275] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:49.157423 31394 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.161208 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.158694   319 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.168099 31544 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:49.162530 31289 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:49.125016 32741 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:49.158979   360 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.201402   306 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.202090   306 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.203663   374 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.204275   374 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.205470   306 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:49.212010 31543 raft_consensus.cc:2410] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:49.212992 32741 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:49.136945   373 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.167060 32698 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.216267 32698 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:49.216764 32698 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.170609 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:49.175626 31289 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 3 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.176522   387 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:49.156262   371 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.226843 31289 catalog_manager.cc:5697] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:23:49.187357   318 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:49.191156 32662 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:49.234318 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 63819.3us
I20260709 12:23:49.189740   301 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.250212 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.251075 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.237797 32766 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:49.238008   371 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.235972   325 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:23:49.294216 31434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.008s	sys 0.078s
W20260709 12:23:49.294564 31434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.008s	sys 0.078s
W20260709 12:23:49.292496 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 465952us
W20260709 12:23:49.253974   305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.015s	sys 0.044s
I20260709 12:23:49.298934 31434 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:49.303583 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:49.262208 32710 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.270368 32766 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.255064 32662 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.240681   387 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.304165 31543 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.304301 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.283015 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.324045 31544 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:49.255841 32703 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:23:49.308993 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:49.305178   305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.015s	sys 0.047s
W20260709 12:23:49.325760 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 496965us
I20260709 12:23:49.260691   378 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.319099 32766 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.361757 32764 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.362639 32764 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.365572 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:49.367589 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:49.368098 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:49.377554   387 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.380180 32048 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:49.303901 32050 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:49.332885   306 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.330263   319 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.397601   301 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.299383   325 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.319519 32710 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.341158 32741 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:49.379725   354 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.374533   317 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:49.325098 32662 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.388301   387 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:49.416890 32078 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.011s	sys 0.022s
W20260709 12:23:49.427609 32078 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.011s	sys 0.022s
I20260709 12:23:49.428488   373 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:49.424141 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.402606   306 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.426992 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:49.409091 31436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.005s	sys 0.018s
W20260709 12:23:49.436306   391 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:23:49.423911   313 consensus_meta.cc:287] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.001s
I20260709 12:23:49.438030   395 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:49.435459 31543 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:49.417938   388 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:49.418562   301 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.454649   388 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:49.458832 31436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.005s	sys 0.018s
I20260709 12:23:49.426245 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:49.463569 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 738292us
I20260709 12:23:49.412727   319 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.491036   319 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.442010   387 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.450759   306 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.470043 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.470927   355 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.463141 32715 consensus_meta.cc:287] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.005s
I20260709 12:23:49.493439 32715 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.460355 31540 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:23:49.474345   325 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.474591 32698 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.496760 31394 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:23:49.496971   355 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.497726 32715 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.498737 32083 raft_consensus.cc:2368] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3.
I20260709 12:23:49.420055 32741 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.477886 31359 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:49.462393   388 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.462190   360 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.484054 32662 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.485857   378 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.422978   354 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.448771 32702 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.488610   397 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:49.452500 31536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
 from {username='slave'} at 127.0.0.1:54134
W20260709 12:23:49.460955 32686 consensus_meta.cc:287] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.001s
W20260709 12:23:49.459395   376 consensus_meta.cc:287] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.004s
W20260709 12:23:49.432060 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 135717us
I20260709 12:23:49.495069 31544 raft_consensus.cc:2410] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:49.499958 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.500519 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.557677 31539 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:49.501653 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.558710 31542 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:49.497951 32698 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:49.503489 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 459169us
I20260709 12:23:49.455384   313 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:49.536041 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.560628 31469 raft_consensus.cc:2368] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5.
I20260709 12:23:49.560634 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:49.521867 31462 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.494933 32764 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.502141   387 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.498004 32047 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:49.562006 31359 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:49.503454 32076 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:49.569716 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:49.570556 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:49.582365 31538 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:49.541895   325 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.461349   301 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.573498   397 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.588867 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:49.589506 31389 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:49.543262   374 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.577512 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:49.578317 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:49.578465 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:49.589802 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:49.589833 31359 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:49.592602 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 94688.4us
I20260709 12:23:49.593113   395 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:49.604435 31433 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:49.539201 32766 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.598073 31388 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.598505 31395 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.599076 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.599181 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.599514 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.598482 31392 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 2: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:49.604583 31539 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:49.624003 31466 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:49.624876 31469 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:49.616710 32764 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.567567 31536 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.628579 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.636752 31467 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:49.568776 31387 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:23:49.630137 31359 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:49.613396 31462 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:49.623095 31463 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:49.634821 31464 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:49.639354 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.590233 32698 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:49.595351 32762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.018s	sys 0.018s
I20260709 12:23:49.589033   397 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:49.693976 31390 raft_consensus.cc:2368] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4.
I20260709 12:23:49.567515 32686 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.651624 31469 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:49.567380   376 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.596354   381 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:49.636493 32764 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.708824 31388 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
W20260709 12:23:49.709776   345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.003s	sys 0.059s
I20260709 12:23:49.653153 31536 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.617316   325 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:49.749182 31395 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:23:49.692920 32765 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:23:49.647964 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 66261.1us
I20260709 12:23:49.741683 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:49.717451   355 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:49.629218 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:49.742571   374 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.749011 32698 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:49.816370 32702 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:49.816954 32702 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:49.818583   371 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.001s
I20260709 12:23:49.693174 32703 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:49.662506   360 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:23:49.692265   390 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.771799 31464 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.773128 31469 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.773958 31467 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.773456   376 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.851094 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:49.770735   345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.006s	sys 0.059s
I20260709 12:23:49.774501 31462 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.783138   378 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:49.636807   395 raft_consensus.cc:697] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:49.637205 32662 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.792721 32082 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.819578 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:49.723033 32762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.020s	sys 0.020s
I20260709 12:23:49.722005   397 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.770483 32764 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:49.811579 31358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.015s
W20260709 12:23:49.791961 32075 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.022s	sys 0.032s
I20260709 12:23:49.877867 31469 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:49.819536 32698 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.819088   371 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.846591   396 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:49.875221 31394 raft_consensus.cc:2393] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:49.875355 32741 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:49.847116   318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.010s	sys 0.018s
I20260709 12:23:49.931764 31462 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:49.794322 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 495407us
I20260709 12:23:49.946117   354 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:49.954744 31358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.006s	sys 0.016s
I20260709 12:23:49.898905 32710 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.877826   390 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:49.973945 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.915683   319 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:49.974211 31467 raft_consensus.cc:1275] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:49.819510   374 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:49.975175 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.009s	sys 0.028s
I20260709 12:23:49.919772   394 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:49.934302 32047 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:50.007004 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.007961 31467 raft_consensus.cc:2393] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:23:50.008658 32084 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.013s	sys 0.020s
W20260709 12:23:50.009055 32084 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.013s	sys 0.020s
I20260709 12:23:49.946041 32766 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.919528   355 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:49.946578 32702 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:49.946048 32662 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:49.957392 31387 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.819360 32765 raft_consensus.cc:697] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:23:49.949975 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 100356us
W20260709 12:23:49.959084 32075 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.023s	sys 0.033s
W20260709 12:23:49.991528 31541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.029s	sys 0.037s
W20260709 12:23:50.147039 31541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.030s	sys 0.037s
I20260709 12:23:50.147125 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.993070 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.149286 31462 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:49.956923 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:49.995388 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:49.946993   378 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:49.984172   407 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:23:49.947275   381 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:49.998476 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.009s	sys 0.028s
I20260709 12:23:49.998271 31469 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:23:49.983464   318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.010s	sys 0.019s
I20260709 12:23:50.003566   319 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:50.070391 31537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.007s	sys 0.018s
W20260709 12:23:49.998222   385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.015s	sys 0.016s
I20260709 12:23:50.100327 31433 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:50.104271 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:50.175390 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:50.067991 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 189552us
I20260709 12:23:50.102839 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:50.139006 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:50.143802 32082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 336) took 1365 ms. Trace:
I20260709 12:23:49.869160 32703 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:49.981667   396 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:50.148320   301 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:50.095270 32662 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:50.093056   354 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:50.011868   394 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:50.164902 32686 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.102912 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:50.176019 31467 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:49.983570   325 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:50.176805 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 76558us
I20260709 12:23:50.067572   395 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:50.165571 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 860217us
I20260709 12:23:50.218683   409 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:50.150825 32741 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.305452 32741 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:50.170819 31537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.007s	sys 0.018s
W20260709 12:23:50.174975   385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.015s	sys 0.016s
I20260709 12:23:50.210662   382 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:50.212258   319 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.066975   355 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.151021   310 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:50.309373   382 raft_consensus.cc:697] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:50.309451   310 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.310627   382 consensus_queue.cc:237] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.283058 32710 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:50.319754 32710 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.170527   381 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.175674 31544 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.223272 31539 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:50.224303   354 raft_consensus.cc:697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:50.181378 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:50.197052 32077 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.020s	sys 0.028s
I20260709 12:23:50.169909 32715 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:50.228042 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:50.335171 31433 leader_election.cc:400] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4.
I20260709 12:23:50.234833 31464 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:50.335534 31433 leader_election.cc:403] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:50.336309 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.336916 31464 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
W20260709 12:23:50.067195 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.014s	sys 0.020s
I20260709 12:23:50.178911 31469 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.236403 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:50.237841 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 252247us
I20260709 12:23:50.185377 32082 rpcz_store.cc:276] 0709 12:23:48.729089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.729268 (+   179us) service_pool.cc:224] Handling call
0709 12:23:49.037776 (+308508us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:23:49.037958 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.946386 (+908428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.094386 (+148000us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400530cd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:50.094648 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741549184}
I20260709 12:23:50.171267 31461 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:50.329051 31359 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:50.344334 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 108396us
I20260709 12:23:50.302806 32766 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:23:50.373188 31466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.007s
W20260709 12:23:50.400434 31465 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.025s	sys 0.016s
W20260709 12:23:50.488850 31543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.005s	sys 0.023s
W20260709 12:23:50.448637 31391 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.000s	sys 0.032s
W20260709 12:23:50.558555 31463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.003s	sys 0.015s
W20260709 12:23:50.284518 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 68236.4us
W20260709 12:23:50.710655 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 366916us
I20260709 12:23:50.354271 31469 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:50.530611 31544 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
W20260709 12:23:50.713828 31466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.024s	sys 0.020s
I20260709 12:23:50.713114 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:50.349844 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:50.715330 31463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.008s	sys 0.015s
I20260709 12:23:50.713783 31433 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:50.714926 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:23:50.714735 31543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.016s	sys 0.029s
W20260709 12:23:50.714957 31391 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.000s	sys 0.037s
I20260709 12:23:50.459318   345 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:50.558342 31470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.007s	sys 0.010s
W20260709 12:23:50.595353   311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.017s	sys 0.000s
I20260709 12:23:50.714620 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:23:50.763058 31470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.007s	sys 0.014s
I20260709 12:23:50.765764 31464 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:23:50.335083 32077 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.020s	sys 0.028s
W20260709 12:23:50.711611 31510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.786s (SENT) [suppressed 16 similar messages]
W20260709 12:23:50.714484 31465 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.029s	sys 0.021s
I20260709 12:23:50.322466   373 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:23:50.350800   398 log.cc:927] Time spent T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 12:23:50.345141 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.015s	sys 0.020s
W20260709 12:23:50.386906 32048 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.000s	sys 0.041s
I20260709 12:23:50.763245 31434 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:50.766167 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 52462.2us
I20260709 12:23:50.721220 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:50.601163   378 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.764915 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.345265 31394 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:50.717453   306 consensus_meta.cc:287] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.213s	user 0.006s	sys 0.007s
W20260709 12:23:50.472726   312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.032s	sys 0.058s
W20260709 12:23:50.350193   402 log.cc:927] Time spent T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 12:23:50.349406   406 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:23:50.351553   405 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:23:50.495476   411 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.819123   411 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:50.720304 31468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.005s	sys 0.039s
W20260709 12:23:50.428712 31540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.001s	sys 0.024s
I20260709 12:23:50.343412   390 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:50.769618   311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.018s	sys 0.000s
I20260709 12:23:50.348527   301 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:23:50.512094 32079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.020s	sys 0.045s
W20260709 12:23:50.833220 32079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.028s	sys 0.054s
W20260709 12:23:50.792709 32048 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.412s	user 0.000s	sys 0.062s
I20260709 12:23:50.712975   385 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:50.666680   417 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:50.833515   393 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:50.499269 31536 consensus_meta.cc:287] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.000s
I20260709 12:23:50.328749   409 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.807446 31469 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:50.345896 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.797953 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.771642   404 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:50.767253 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:50.809886 32083 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:50.439546   319 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:50.710449   355 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:50.743880 32710 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.352946   371 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.765595 32766 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.791340 32741 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:50.347400 32715 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:50.791602   373 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.810304   306 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:50.330696 32765 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.820668 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1322) took 1047 ms. Trace:
I20260709 12:23:50.868391 31394 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
W20260709 12:23:50.811981   312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.045s	sys 0.066s
I20260709 12:23:50.771149   345 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:50.348435   354 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:50.824117   411 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.826478 32075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 337) took 2093 ms. Trace:
W20260709 12:23:50.826191 31540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.001s	sys 0.047s
I20260709 12:23:50.831118   374 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.813794   396 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:50.834225 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 1.45398e+06us
I20260709 12:23:50.930380 32048 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:50.352669 32703 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:50.821554 32078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 341) took 2049 ms. Trace:
I20260709 12:23:50.856305 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1319) took 1197 ms. Trace:
W20260709 12:23:50.867897   318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.006s	sys 0.000s
W20260709 12:23:50.869335 32084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.007s	sys 0.001s
W20260709 12:23:50.868990 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 539985us
W20260709 12:23:50.935556 32084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.007s	sys 0.001s
I20260709 12:23:50.935761 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:50.871707   395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.008s
I20260709 12:23:50.936275 32084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 344) took 1590 ms. Trace:
I20260709 12:23:50.917487 32702 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.879639 31464 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:50.880705 31461 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:50.874032   387 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:50.882885 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:50.460961 32698 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.864135   394 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:50.882014   404 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:50.933833 31466 rpcz_store.cc:276] 0709 12:23:49.636168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.639875 (+  3707us) service_pool.cc:224] Handling call
0709 12:23:49.640334 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.640752 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.640787 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.701399 (+ 60612us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.765463 (+1064064us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:50.765503 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.765565 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.832664 (+ 67099us) raft_consensus.cc:1685] finished
0709 12:23:50.832678 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.833852 (+  1174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47445,"raft.queue_time_us":91,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":44781,"thread_start_us":977469,"threads_started":1,"wal-append.queue_time_us":1077669}
I20260709 12:23:50.881299   437 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:50.924928   435 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:50.907426 32710 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:50.863276   385 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:50.926728 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1328) took 1152 ms. Trace:
I20260709 12:23:50.918040 32076 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 2: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:50.912637 31463 rpcz_store.cc:276] 0709 12:23:49.772782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.775426 (+  2644us) service_pool.cc:224] Handling call
0709 12:23:49.775791 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.776211 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.776236 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.776780 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.764827 (+988047us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:50.764863 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.764931 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.820414 (+ 55483us) raft_consensus.cc:1685] finished
0709 12:23:50.820432 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.820612 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":987639,"threads_started":1,"wal-append.queue_time_us":1041877}
I20260709 12:23:50.865845 31536 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.937597 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.005510 31542 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:50.874405 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.929649   434 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:50.939749 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:50.939778 31392 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:50.863704   417 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:50.885293   319 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.096218 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:51.096872 31464 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:50.941095 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:50.957568 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.936625 32084 rpcz_store.cc:276] 0709 12:23:49.346241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.346344 (+   103us) service_pool.cc:224] Handling call
0709 12:23:49.346612 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.346783 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:50.009483 (+662700us) log.cc:844] Serialized 14 byte log entry
0709 12:23:50.935948 (+926465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.936007 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:50.936046 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.936124 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.936226 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":458147,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":1556063,"threads_started":2,"wal-append.queue_time_us":860003}
I20260709 12:23:50.940732 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:50.906224 31387 consensus_meta.cc:287] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.753s	user 0.007s	sys 0.004s
W20260709 12:23:50.939385   395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.000s	sys 0.010s
W20260709 12:23:51.000495   423 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:23:50.941198   400 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 1.094s	user 0.003s	sys 0.014s
I20260709 12:23:50.949407 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:50.949788 32710 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:50.949152   419 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260709 12:23:51.157845 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1239) took 1908 ms. Trace:
I20260709 12:23:50.951622 31462 rpcz_store.cc:276] 0709 12:23:49.774636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.159915 (+385279us) service_pool.cc:224] Handling call
0709 12:23:50.160285 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.209774 (+ 49489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.209818 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.209873 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:50.209916 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.926529 (+716613us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5400414954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:50.926568 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.926678 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75844992}
I20260709 12:23:51.088559 31388 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:50.942184 32702 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.136698 31387 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:51.162792   310 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:51.163563   345 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.957971   435 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.145896 32703 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:51.164770 32703 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:51.165943   435 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:50.931896   396 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:51.166694   396 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.168633   396 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:50.951764   430 log.cc:927] Time spent T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 12:23:50.949980   422 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:23:51.122105 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 184224us
W20260709 12:23:51.146530   414 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.685s	user 0.016s	sys 0.014s
I20260709 12:23:51.138017 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:51.171867 31359 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:51.172091 31461 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:50.947664 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1237) took 1800 ms. Trace:
W20260709 12:23:51.127118 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 415501us
I20260709 12:23:51.173081   409 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:51.162847 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 133) took 1372 ms. Trace:
I20260709 12:23:51.173838 31387 rpcz_store.cc:276] 0709 12:23:49.790269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.791865 (+  1596us) service_pool.cc:224] Handling call
0709 12:23:51.162764 (+1370899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:51.174371   409 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:51.135277 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1239) took 1615 ms. Trace:
W20260709 12:23:50.940413   318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.006s	sys 0.000s
W20260709 12:23:51.002990   431 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:23:50.949036   394 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.940330   357 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.951485 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:50.943449   387 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.151368   444 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:51.152520   413 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.692s	user 0.003s	sys 0.017s
I20260709 12:23:51.002336   385 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:23:51.156569   438 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.283s	user 0.000s	sys 0.002s
I20260709 12:23:51.136845   411 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:51.165650 32703 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:51.171938   381 consensus_meta.cc:287] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.000s
I20260709 12:23:51.179603 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.179915 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:50.950906   397 consensus_meta.cc:287] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.002s
W20260709 12:23:51.281905 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 94133.5us
I20260709 12:23:51.120076   434 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:50.953254   437 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.283958 31510 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:23:50.952073   429 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:23:51.175377 31465 rpcz_store.cc:276] 0709 12:23:49.519955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.520083 (+   128us) service_pool.cc:224] Handling call
0709 12:23:49.520406 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.520635 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:50.772180 (+1251545us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.134848 (+362668us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:51.134916 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:51.134969 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.135052 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.135206 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":376690,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":129,"spinlock_wait_cycles":8710016,"thread_start_us":1588580,"threads_started":2}
I20260709 12:23:51.182200 31464 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:51.285601 31433 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:51.171048   301 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4.
I20260709 12:23:51.140167   355 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:51.209399 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1244) took 1673 ms. Trace:
W20260709 12:23:51.209702   427 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:51.159966 32710 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:51.216035 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 452855us
I20260709 12:23:51.276991 31436 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:51.196497   311 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
W20260709 12:23:51.285741 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 50005us
I20260709 12:23:51.208264 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1246) took 1697 ms. Trace:
I20260709 12:23:51.306315 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:51.227377 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1314) took 1637 ms. Trace:
I20260709 12:23:51.285915 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:51.181896   409 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.214185   444 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.215677 31394 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.182557   310 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:51.215176   312 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.285149   395 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:51.349702 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 419378us
I20260709 12:23:51.197707   390 consensus_queue.cc:1059] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:23:51.299834 31470 rpcz_store.cc:276] 0709 12:23:49.535960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.541173 (+  5213us) service_pool.cc:224] Handling call
0709 12:23:49.553429 (+ 12256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.553692 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:50.769212 (+1215520us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.208908 (+439696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:51.209007 (+    99us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:51.209073 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.209160 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.209325 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":343859,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":2156,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":62514,"thread_start_us":1619961,"threads_started":2}
I20260709 12:23:51.285003 32077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 341) took 1930 ms. Trace:
I20260709 12:23:51.356389 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.347919 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1237) took 1882 ms. Trace:
I20260709 12:23:51.376467 31539 raft_consensus.cc:2393] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:51.348753 31391 rpcz_store.cc:276] 0709 12:23:49.576282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.576397 (+   115us) service_pool.cc:224] Handling call
0709 12:23:49.576647 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.576828 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:50.765059 (+1188231us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.212967 (+447908us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:51.213035 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:51.213090 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.213170 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.213305 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6825,"prepare.queue_time_us":1302643,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3158,"raft.queue_time_us":8466,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":66407,"thread_start_us":1588763,"threads_started":2,"wal-append.queue_time_us":527535}
W20260709 12:23:51.357666 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 67279us
I20260709 12:23:51.377324 31433 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:51.349589 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1300) took 1884 ms. Trace:
I20260709 12:23:51.362608   373 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:51.378537   373 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:51.377998 31543 rpcz_store.cc:276] 0709 12:23:49.465191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.468120 (+  2929us) service_pool.cc:224] Handling call
0709 12:23:49.468583 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.469060 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.469095 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.541268 (+ 72173us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.766287 (+1225019us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:50.766348 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.766429 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.349348 (+582919us) raft_consensus.cc:1685] finished
0709 12:23:51.349371 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.349508 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":1190707,"threads_started":1,"wal-append.queue_time_us":1267379}
I20260709 12:23:51.379096   373 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.379967 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:51.380497 31543 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.173035 31535 rpcz_store.cc:276] 0709 12:23:49.143675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.145325 (+  1650us) service_pool.cc:224] Handling call
0709 12:23:49.151779 (+  6454us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:23:49.151970 (+   191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.152308 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.152339 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.152844 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.716821 (+563977us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:49.741737 (+ 24916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.768398 (+ 26661us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.912008 (+1143610us) raft_consensus.cc:1685] finished
0709 12:23:50.912029 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.941683 (+ 29654us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3163,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5658,"spinlock_wait_cycles":5063424,"thread_start_us":496048,"threads_started":1,"wal-append.queue_time_us":981327}
I20260709 12:23:51.381470   373 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:51.382050 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:51.383679 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:51.384207 31539 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.281400   382 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:23:51.367901 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 91010.6us
I20260709 12:23:51.370939 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:51.372022 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:51.373039 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:51.374325 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.354315   409 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.289592   411 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.349206 32758 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.312048 32698 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:51.470940 31544 raft_consensus.cc:2368] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:51.288371   381 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.387880   446 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.312052   396 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:51.372655   325 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:51.289312   385 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 12:23:51.213487   394 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.382622 31535 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.391165 31436 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:51.384610 31387 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:51.357385   444 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:51.475668 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 189794us
I20260709 12:23:51.384394   306 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:51.289975   397 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.310566 32715 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:51.499217 31539 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:51.523837 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.385110   301 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:51.509853 31543 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:23:51.469707 32083 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:51.348903   355 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:51.511781 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 120743us
I20260709 12:23:51.386226   345 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:51.515980 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:51.211695   404 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.390483   318 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:51.519575 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1226) took 2695 ms. Trace:
I20260709 12:23:51.365872   310 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.370829   312 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.563611 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.569509 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.376125 32077 rpcz_store.cc:276] 0709 12:23:49.351096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.364159 (+ 13063us) service_pool.cc:224] Handling call
0709 12:23:49.364537 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.364750 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:50.791740 (+1426990us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.175617 (+383877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:51.194513 (+ 18896us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:51.197053 (+  2540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.210364 (+ 13311us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.281168 (+ 70804us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32393,"prepare.queue_time_us":512422,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":19900,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":1679802,"threads_started":2}
I20260709 12:23:51.512543   378 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.614500 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.547495   319 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:51.442551   382 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.376804   395 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.548329   411 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:50.933638 32078 rpcz_store.cc:276] 0709 12:23:48.772623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.776552 (+  3929us) service_pool.cc:224] Handling call
0709 12:23:48.823447 (+ 46895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.831668 (+  8221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:49.428070 (+596402us) log.cc:844] Serialized 14 byte log entry
0709 12:23:50.793920 (+1365850us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.806711 (+ 12791us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:50.810448 (+  3737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.813738 (+  3290us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.820648 (+  6910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":884,"prepare.queue_time_us":887950,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2889,"raft.queue_time_us":78289,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4520,"thread_start_us":1959544,"threads_started":2}
I20260709 12:23:51.550087 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:51.610654 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 233398us
I20260709 12:23:51.635658 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.636237 31539 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:51.517330 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:51.613241 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:51.543810   373 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.616698 32048 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:51.480616 32758 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:51.627756 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 197089us
I20260709 12:23:51.628594 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:23:51.629465 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 114926us
I20260709 12:23:51.550007   311 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:51.649170 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:51.649510 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.650043 31464 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:51.647212 32080 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
W20260709 12:23:51.634871 32662 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.412s	user 0.011s	sys 0.001s
I20260709 12:23:50.920042 32075 rpcz_store.cc:276] 0709 12:23:48.732992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.751942 (+ 18950us) service_pool.cc:224] Handling call
0709 12:23:49.141362 (+389420us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:23:49.141589 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.141991 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.142028 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.142558 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.165566 (+1023008us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:50.176030 (+ 10464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.191771 (+ 15741us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.824469 (+632698us) raft_consensus.cc:1685] finished
0709 12:23:50.824499 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.826408 (+  1909us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3387,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":8232832,"thread_start_us":1004033,"threads_started":1,"wal-append.queue_time_us":1025693}
W20260709 12:23:51.632472 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 90038.2us
I20260709 12:23:51.650130 31543 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:23:51.516521   396 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.513934   325 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:51.642643 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 84368.8us
I20260709 12:23:51.643633 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:51.644105 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:51.662362 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:51.662695 31462 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.662955 31466 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.644454 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:51.630100   306 raft_consensus.cc:3055] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:51.665248 31465 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:23:51.665247   306 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:51.647007 31470 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:51.640281   390 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.158252 31537 rpcz_store.cc:276] 0709 12:23:49.249401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.252611 (+  3210us) service_pool.cc:224] Handling call
0709 12:23:49.436305 (+183694us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:23:49.436526 (+   221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.454276 (+ 17750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.454313 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.454816 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.307892 (+853076us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:50.307956 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.308052 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.157540 (+849488us) raft_consensus.cc:1685] finished
0709 12:23:51.157567 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.157782 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11882,"raft.queue_time_us":14910,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":47630592,"thread_start_us":852664,"threads_started":1,"wal-append.queue_time_us":1122154}
I20260709 12:23:51.551923 31541 rpcz_store.cc:276] 0709 12:23:48.815710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.815837 (+   127us) service_pool.cc:224] Handling call
0709 12:23:48.816136 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.292856 (+476720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.292901 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.301584 (+  8683us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.147522 (+845938us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:50.147576 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.147675 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.151936 (+1004261us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:23:51.487315 (+335379us) raft_consensus.cc:1685] finished
0709 12:23:51.487333 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.510733 (+ 23400us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34928,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"spinlock_wait_cycles":6533888,"thread_start_us":1214769,"threads_started":2,"wal-append.queue_time_us":1127690}
I20260709 12:23:51.659922 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.682441 31539 raft_consensus.cc:2368] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4.
I20260709 12:23:51.682742   434 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:51.683822 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.644419   403 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.556598   345 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.680330 31436 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:51.645220   378 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.644454 32715 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.663496   454 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:51.647784 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:51.661392   445 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:51.688149 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:51.646440   421 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.648806   311 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:51.520403   446 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.647675   373 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.688968 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:51.742520 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.850623   355 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:51.851065 31539 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 2: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:51.851517 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:51.852748 31464 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.761399 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:51.856891 31543 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:51.728415 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:51.686010 32082 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:51.746692 31542 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:51.866837 31466 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:51.347528 31540 rpcz_store.cc:276] 0709 12:23:49.499408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.502588 (+  3180us) service_pool.cc:224] Handling call
0709 12:23:49.558775 (+ 56187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.620784 (+ 62009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.629124 (+  8340us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.787177 (+158053us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.933520 (+1146343us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:51.003858 (+ 70338us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.137107 (+133249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.145136 (+  8029us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.161517 (+ 16381us) raft_consensus.cc:1685] finished
0709 12:23:51.161542 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.196724 (+ 35182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8533,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":46892,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":42633,"thread_start_us":1135377,"threads_started":1,"wal-append.queue_time_us":1026260}
I20260709 12:23:51.659116   411 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.852805   393 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:51.893607 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.009s
I20260709 12:23:51.876287 31464 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
W20260709 12:23:51.908385 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.000s	sys 0.010s
I20260709 12:23:51.741253 31462 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
W20260709 12:23:51.909433   450 log.cc:927] Time spent T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:23:51.940114 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:51.940798 31393 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:51.922940 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:51.936481 31388 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:51.937019 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:51.778304 32764 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.804s	user 0.013s	sys 0.000s
I20260709 12:23:51.910190 31391 raft_consensus.cc:1275] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:51.941798 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:51.659215   417 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:51.942293 31392 raft_consensus.cc:2393] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:51.937703 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:51.942723 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:51.855006   458 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.777941   385 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.661068 32662 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.871819   311 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:51.836364   412 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 1.317s	user 0.012s	sys 0.015s
W20260709 12:23:51.874581 32741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.003s	sys 0.016s
I20260709 12:23:51.760360   452 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:51.971809 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 291529us
I20260709 12:23:52.012812 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:51.760816   440 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:51.759166 32079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 343) took 2391 ms. Trace:
I20260709 12:23:52.011870 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:51.684279   447 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.760499   462 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:51.874693 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:51.386690 31468 rpcz_store.cc:276] 0709 12:23:49.465185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.543045 (+ 77860us) service_pool.cc:224] Handling call
0709 12:23:49.573624 (+ 30579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.618057 (+ 44433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.629232 (+ 11175us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.792170 (+162938us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.835470 (+1043300us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:50.837262 (+  1792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.874959 (+ 37697us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.304735 (+429776us) raft_consensus.cc:1685] finished
0709 12:23:51.310724 (+  5989us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.347822 (+ 37098us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9657,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11373,"thread_start_us":873267,"threads_started":1,"wal-append.queue_time_us":1017170}
I20260709 12:23:52.014467   454 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.683820 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:51.688926   390 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:51.910992   394 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:51.936933   381 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.055934 31436 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:52.018023 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.118119 31393 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:52.119313 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.034719   385 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:52.060263   451 log.cc:927] Time spent T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.486s	user 0.001s	sys 0.000s
I20260709 12:23:51.761221   403 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.061965 31463 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:52.014961   466 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.065440 31389 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:52.130798 32715 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:52.130908 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.131402 32715 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.131718 31389 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:52.132859 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.133479 31389 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:52.133637 32715 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:51.837682   306 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:52.134477 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.134788   306 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.083482 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:23:52.135946 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 52551.6us
I20260709 12:23:52.012418   393 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:52.045014 32702 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.138674 32702 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:52.139541   393 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.140375   393 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.141105   393 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:52.141669   393 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.139123 32702 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:52.143702 32702 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.046152   357 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:52.145874   357 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:51.935063   411 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:52.147094 32047 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:52.148321 32047 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:52.149152   411 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.072350 32766 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.015121   459 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.219s
I20260709 12:23:52.051276   312 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.150940   417 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:52.151521   417 raft_consensus.cc:697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:52.062538 31536 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:52.152968 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54134 (request call id 1295) took 2729 ms. Trace:
I20260709 12:23:52.152686   417 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.153340 31536 rpcz_store.cc:276] 0709 12:23:49.423317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.431450 (+  8133us) service_pool.cc:224] Handling call
0709 12:23:51.855561 (+2424111us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b4c001cc5c0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8f588a20 00007f6e8f599a29 00007f6e8f59a13f 00007f6e8f55e2ab 00007f6e8f58bf3c 00007f6e8f58c3fe 00007f6e8f81988b 00007f6e91218495 00007f6e9126930f 00007f6e912b3a55 00007f6e96283cd0
0709 12:23:52.152879 (+297318us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":132129,"spinlock_wait_cycles":9164160}
I20260709 12:23:52.032078 32764 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:52.155607 31387 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:52.155879 32764 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.061255   447 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.157538 32702 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.158524   447 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:52.066521   437 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.120674 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.160691 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.161569 31393 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:23:52.059973   439 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.460s	user 0.001s	sys 0.000s
I20260709 12:23:52.066288   440 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:52.080408   310 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:52.127110 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 73088us
I20260709 12:23:52.168434 31436 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:51.935490   421 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.131675 31539 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:52.150108   354 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:52.082959   382 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:52.117170 31461 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.071110   458 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:52.179738 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.110538 31386 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:52.074523   452 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.090782 32765 consensus_queue.cc:1059] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:23:52.226497   354 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:52.268939   354 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.269786 32662 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.270694 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.226799   447 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.271853 31462 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:52.271981   396 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.123567 32758 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.126535   325 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.135149 31389 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
I20260709 12:23:52.194391   440 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.326144 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:52.326282 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 157906us
I20260709 12:23:52.332801 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.359390 31466 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:52.329622 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.361565 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:52.362011 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1265) took 1183 ms. Trace:
I20260709 12:23:52.362272 31543 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.328615 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1333) took 2371 ms. Trace:
I20260709 12:23:52.306200   395 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.327078 31393 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:52.379556 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:52.378975 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.381055 31470 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:52.362488 31538 rpcz_store.cc:276] 0709 12:23:51.178940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.180399 (+  1459us) service_pool.cc:224] Handling call
0709 12:23:51.180685 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.549859 (+369174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.549886 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:51.549927 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:51.549957 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.361784 (+811827us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54003be054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:52.361821 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.361961 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142729,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":34472,"spinlock_wait_cycles":848365824}
I20260709 12:23:52.381609 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.325555   357 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:52.382521   457 log.cc:927] Time spent T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.445s	user 0.000s	sys 0.001s
I20260709 12:23:52.121455   462 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:52.386292 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:52.387717 31466 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:52.385511 31359 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:52.363807   448 log.cc:927] Time spent T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.603s	user 0.006s	sys 0.011s
W20260709 12:23:52.327476   301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.005s	sys 0.012s
W20260709 12:23:52.393846   456 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.645s	user 0.006s	sys 0.012s
I20260709 12:23:52.395319 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:52.370939   441 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.510s	user 0.000s	sys 0.008s
I20260709 12:23:52.378314 31467 rpcz_store.cc:276] 0709 12:23:49.957244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.323943 (+366699us) service_pool.cc:224] Handling call
0709 12:23:50.324264 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:50.324644 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.324683 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:50.712321 (+387638us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.144409 (+432088us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:51.144466 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.144532 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.328413 (+1183881us) raft_consensus.cc:1685] finished
0709 12:23:52.328432 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.328562 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1840,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":15273,"thread_start_us":431718,"threads_started":1,"wal-append.queue_time_us":496928}
I20260709 12:23:52.409837 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:52.513968 32083 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:52.322691   345 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.364488   403 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:52.395041 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:52.517414 31433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.010s	sys 0.017s
W20260709 12:23:52.517714 31433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.010s	sys 0.017s
W20260709 12:23:52.517953 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 510198us
W20260709 12:23:52.355574 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 73496.4us
I20260709 12:23:52.500782 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.382882   467 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.420s
I20260709 12:23:52.534307 31466 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
W20260709 12:23:52.535353 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 398306us
I20260709 12:23:52.519986 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:52.552243 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.412977 31359 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:52.507296 31465 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
W20260709 12:23:52.474872   301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.007s	sys 0.013s
I20260709 12:23:52.575147 31464 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:52.508663 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.364105   436 raft_consensus.cc:3055] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:52.569356 31467 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:52.493456   382 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.570472 32081 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
W20260709 12:23:52.571727 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 158852us
I20260709 12:23:52.581072 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.583997 31434 leader_election.cc:400] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:52.587818 31434 leader_election.cc:403] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:52.515686   452 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.519798 32764 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:52.527166   447 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:52.625591   462 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:52.626595   478 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.577147   301 raft_consensus.cc:697] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:52.648420 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1334) took 2664 ms. Trace:
I20260709 12:23:52.500746   449 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.545s
I20260709 12:23:52.588637   436 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:52.682816 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.683642 31466 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
W20260709 12:23:52.653537 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 53785.4us
I20260709 12:23:52.585357   411 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.520141   312 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:52.664980 31469 rpcz_store.cc:276] 0709 12:23:49.984484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.087531 (+1103047us) service_pool.cc:224] Handling call
0709 12:23:51.087867 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.088192 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.088228 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.155064 (+ 66836us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.503032 (+347968us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:51.503073 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.503158 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.648193 (+1145035us) raft_consensus.cc:1685] finished
0709 12:23:52.648213 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.648357 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":43075,"thread_start_us":288000,"threads_started":1,"wal-append.queue_time_us":447492}
I20260709 12:23:52.628003 31468 raft_consensus.cc:2393] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:52.627027   463 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:52.702044 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:52.704272 31469 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:52.665546 31535 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.121s	user 0.007s	sys 0.004s
I20260709 12:23:52.648845   390 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:52.605273   382 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:52.647516 32047 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:52.719369 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.718230 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:53.095433 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 524845us
I20260709 12:23:53.066161 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:52.915527 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.000720 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 124) took 1058 ms. Trace:
I20260709 12:23:53.101162 31434 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.008001 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 122) took 1282 ms. Trace:
I20260709 12:23:52.943930 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1317) took 1578 ms. Trace:
I20260709 12:23:53.121876 31539 rpcz_store.cc:276] 0709 12:23:51.365032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.853488 (+488456us) service_pool.cc:224] Handling call
0709 12:23:51.853766 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.193159 (+339393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.943613 (+750454us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54002b5a54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:52.943855 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638389120}
I20260709 12:23:52.669862   446 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.113543 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.131188 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.733636   411 raft_consensus.cc:697] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:53.002038   385 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:52.701433 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:53.114913 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 89) took 1745 ms. Trace:
W20260709 12:23:52.938339   453 log.cc:927] Time spent T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.434s	user 0.001s	sys 0.000s
W20260709 12:23:53.115737 32082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 349) took 1744 ms (client timeout 1550 ms). Trace:
W20260709 12:23:53.143913 32082 rpcz_store.cc:269] 0709 12:23:51.371661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.371782 (+   121us) service_pool.cc:224] Handling call
0709 12:23:53.115511 (+1743729us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54005fd054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.115652 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495487872}
I20260709 12:23:53.132961 31434 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:52.998018   409 consensus_meta.cc:287] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.497s	user 0.002s	sys 0.006s
I20260709 12:23:53.117226 31535 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:23:53.117715   454 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.709342 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:53.136305   311 consensus_meta.cc:287] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.092s	user 0.007s	sys 0.009s
I20260709 12:23:53.102784   371 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:53.123991 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.055204 32079 rpcz_store.cc:276] 0709 12:23:49.345959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.373301 (+ 27342us) service_pool.cc:224] Handling call
0709 12:23:49.415724 (+ 42423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.625653 (+209929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.630052 (+  4399us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.788230 (+158178us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.833599 (+1045369us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:50.833643 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.551765 (+718122us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54006aed54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:51.634183 (+ 82418us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.639975 (+  5792us) raft_consensus.cc:1685] finished
0709 12:23:51.639992 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.719954 (+ 79962us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21783,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":31988,"spinlock_wait_cycles":341291648,"thread_start_us":1044879,"threads_started":1,"wal-append.queue_time_us":1026553}
W20260709 12:23:52.995421 32080 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 350) took 1622 ms (client timeout 2085 ms). Trace:
I20260709 12:23:53.126446 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:52.802770 31469 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:23:53.128324 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.173226 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.142589   484 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:53.104964 31462 rpcz_store.cc:276] 0709 12:23:51.942382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.942505 (+   123us) service_pool.cc:224] Handling call
0709 12:23:53.000514 (+1058009us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b540029a9d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.000617 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596137216}
W20260709 12:23:53.171989 32080 rpcz_store.cc:269] 0709 12:23:51.372694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.372818 (+   124us) service_pool.cc:224] Handling call
0709 12:23:52.995194 (+1622376us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400690354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:52.995332 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410103552}
I20260709 12:23:53.177850 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.178036 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.142782   395 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:53.133996 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:23:53.135269 31463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1347) took 2775 ms (client timeout 2497 ms). Trace:
W20260709 12:23:53.184180 31463 rpcz_store.cc:269] 0709 12:23:50.347750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.957335 (+609585us) service_pool.cc:224] Handling call
0709 12:23:53.123062 (+2165727us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b540004d3d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.123156 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215658368}
I20260709 12:23:53.185400 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:53.089777 31394 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.713s	user 0.011s	sys 0.001s
W20260709 12:23:53.078186 31461 consensus_meta.cc:287] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.805s	user 0.005s	sys 0.004s
W20260709 12:23:53.083379   444 consensus_meta.cc:287] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.540s	user 0.011s	sys 0.001s
I20260709 12:23:53.172747   311 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.145926   466 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.188361 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.188248   444 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:53.168684 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 548468us
I20260709 12:23:53.142107   460 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:23:53.076069   440 consensus_meta.cc:287] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.002s
W20260709 12:23:53.063185 32710 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.698s	user 0.011s	sys 0.003s
I20260709 12:23:53.137717 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.197010 31467 raft_consensus.cc:2368] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4.
I20260709 12:23:53.197938 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.198593 31467 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:53.139004 31543 rpcz_store.cc:276] 0709 12:23:51.369686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.857585 (+487899us) service_pool.cc:224] Handling call
0709 12:23:52.361994 (+504409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.362903 (+   909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.114651 (+751748us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54003be050. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.114840 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820350848}
I20260709 12:23:53.139542 31436 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:52.772375   301 consensus_queue.cc:237] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.203667   318 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.204154   318 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:53.204595   318 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:53.205437   478 consensus_meta.cc:287] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 12:23:52.654877   447 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.205821   478 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:53.207115   447 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.145409 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:53.146024 31434 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:53.207826 31538 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.211393   403 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.211779   403 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.212092   403 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.214022 31462 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:53.171952   482 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:53.069054 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:53.124766   354 consensus_meta.cc:287] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.855s	user 0.004s	sys 0.005s
I20260709 12:23:53.009321 32702 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.189946   311 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:23:53.134585 31361 connection.cc:256] RPC call timeout handler was delayed by -2.2664307290001489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 12:23:52.701557 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:53.229733 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.119220 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1339) took 1082 ms. Trace:
I20260709 12:23:53.229892 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:53.230366 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1920544059998974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2497s for a response
I20260709 12:23:53.231001 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:52.944217   355 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:53.153429   382 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.148574   409 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.232025 31468 raft_consensus.cc:2393] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:53.231696   411 consensus_queue.cc:237] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.232174   355 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.233485   409 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.234230 31386 raft_consensus.cc:2393] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:53.153842 32662 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:53.230743 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1169955519999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:23:53.156463 31535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1311) took 1797 ms (client timeout 1615 ms). Trace:
W20260709 12:23:53.235301 31535 rpcz_store.cc:269] 0709 12:23:51.359115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.381803 (+ 22688us) service_pool.cc:224] Handling call
0709 12:23:53.156358 (+1774555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:53.236598 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:53.236886 31507 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.538s (SENT)
I20260709 12:23:53.161733 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.286238 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1345) took 1214 ms. Trace:
I20260709 12:23:53.286617   311 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:53.286948 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 50093.1us
W20260709 12:23:53.287319   489 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.094s	user 0.011s	sys 0.000s
I20260709 12:23:53.287230   311 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.290663 31538 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:53.291339   421 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:53.291586 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:53.292109 31538 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.286715 31386 rpcz_store.cc:276] 0709 12:23:52.071982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.270426 (+198444us) service_pool.cc:224] Handling call
0709 12:23:53.282172 (+1011746us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400231c54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.286173 (+  4001us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213930880}
I20260709 12:23:53.294214   390 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.294605 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1323) took 1385 ms. Trace:
I20260709 12:23:53.123466   378 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:53.296965   378 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.297425   385 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:53.298065   385 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.168671 31395 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:23:53.299953 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:53.300185   385 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.300650 31395 raft_consensus.cc:2368] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:53.301448 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:52.755053   463 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:53.128485 31390 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:53.302459 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.302965 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.303758 31390 raft_consensus.cc:2393] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:53.304749 31390 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:53.175576 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.174041 31469 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:53.298990   378 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:53.142414   417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.004s	sys 0.016s
I20260709 12:23:53.120905 31465 rpcz_store.cc:276] 0709 12:23:51.733551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.922611 (+189060us) service_pool.cc:224] Handling call
0709 12:23:53.007799 (+1085188us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400191754. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.007931 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288574336}
I20260709 12:23:52.804746   436 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.187487 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.187546 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:23:53.187089 31510 connection.cc:256] RPC call timeout handler was delayed by -1.2884965789999114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:23:53.322392 31510 connection.cc:256] RPC call timeout handler was delayed by -1.1172569589998602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33010000000000006s for a response
I20260709 12:23:53.190631 31541 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.189411 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.191648 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:53.199962 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 60531.3us
I20260709 12:23:53.202467 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:52.946230   373 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.218024 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:53.216420 32710 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.218448   387 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:52.933745   325 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:53.188679   466 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:52.718143   312 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:53.224009 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 78095.7us
W20260709 12:23:52.993683   469 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 12:23:53.189183   484 raft_consensus.cc:697] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:53.223909 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:53.225078 31361 connection.cc:256] RPC call timeout handler was delayed by -2.1279942510000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 12:23:53.225742 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1338) took 1193 ms. Trace:
I20260709 12:23:53.228435 32075 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:53.228703   447 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:53.149283 31466 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:53.385571 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.386350 31466 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
W20260709 12:23:53.386376 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 94798.9us
I20260709 12:23:53.230192 31391 rpcz_store.cc:276] 0709 12:23:52.036521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.036724 (+   203us) service_pool.cc:224] Handling call
0709 12:23:53.118431 (+1081707us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:23:53.118640 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.118842 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.118879 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:53.118930 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:53.118969 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.119033 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.119148 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2660096}
I20260709 12:23:53.388463 31391 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:53.152943 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:53.234409   355 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:52.671571 32764 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.358831 31538 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:23:53.190713 31394 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:53.190229   460 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.214407   440 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.175078   371 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.240039   444 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.275372   393 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.238086   482 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.237489   458 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.225169   354 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.263752 31536 raft_consensus.cc:2410] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:53.294373 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:53.140683   319 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.312s	user 0.013s	sys 0.028s
W20260709 12:23:53.124522 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 535208us
I20260709 12:23:53.315320 31464 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:53.339452 31539 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:53.339663 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.346057 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.297310   397 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:53.318625   417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.004s	sys 0.017s
W20260709 12:23:53.354764 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 229874us
I20260709 12:23:53.355965 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.416213   355 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.398836 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.319164   463 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:53.370599 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:23:53.378014 31361 connection.cc:256] RPC call timeout handler was delayed by -1.8021942509999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 12:23:53.375921 31541 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:53.369869 31434 leader_election.cc:400] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4.
I20260709 12:23:53.377802 31543 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:53.383810 31388 raft_consensus.cc:2393] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:53.391777 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.378085 31392 rpcz_store.cc:276] 0709 12:23:52.032844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.033070 (+   226us) service_pool.cc:224] Handling call
0709 12:23:52.947896 (+914826us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:23:52.948136 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.948353 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:52.984978 (+ 36625us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.225384 (+240406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:53.225451 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:53.225488 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.225549 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.225665 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32686,"prepare.queue_time_us":40237,"prepare.run_cpu_time_us":7618,"prepare.run_wall_time_us":65341,"raft.queue_time_us":110,"raft.run_cpu_time_us":4753,"raft.run_wall_time_us":70598,"spinlock_wait_cycles":31560448,"thread_start_us":239290,"threads_started":1,"wal-append.queue_time_us":304234}
I20260709 12:23:53.352293 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:53.428148   385 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:23:53.393700   447 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:23:53.397387 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 48282.4us
I20260709 12:23:53.190541 31461 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:23:53.399181 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:53.369781   436 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:53.431871   319 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.644s	user 0.014s	sys 0.028s
I20260709 12:23:53.431929   444 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:23:53.405810 31394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1324) took 2469 ms (client timeout 1616 ms). Trace:
I20260709 12:23:53.358812 31540 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:53.436113 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.457432 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:53.457580 31464 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:53.458153 31538 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:53.458765 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.460602 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:53.369041   454 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:23:53.434103 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:53.462417   454 consensus_queue.cc:1243] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer 503bef451a2b424fa35e8e46b8c06f29 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:53.462738 31536 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:53.463130   454 raft_consensus.cc:3055] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:53.463670   454 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:53.464663   454 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.466070   454 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.355468 32076 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:53.444217 32710 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:53.445549 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 75842.7us
I20260709 12:23:53.470358 31434 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:53.383021   311 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:53.295360 31387 rpcz_store.cc:276] 0709 12:23:51.909722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.934506 (+ 24784us) service_pool.cc:224] Handling call
0709 12:23:52.014771 (+ 80265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.156099 (+141328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.267272 (+1111173us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540006f9d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:53.294550 (+ 27278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323294592}
I20260709 12:23:53.429461 31470 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:53.429993 31463 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:53.164494 32048 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:53.369369   325 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.456940 31462 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:53.409153   312 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.411954   466 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.436779 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:53.461242 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:53.414146 32075 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 351) took 1747 ms (client timeout 1733 ms). Trace:
W20260709 12:23:53.455408 31394 rpcz_store.cc:269] 0709 12:23:50.936152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.940386 (+  4234us) service_pool.cc:224] Handling call
0709 12:23:53.403607 (+2463221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:53.439857 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:53.586467 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.443221 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 87) took 2074 ms. Trace:
I20260709 12:23:53.581712   444 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:53.587405 31544 rpcz_store.cc:276] 0709 12:23:51.369135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.855706 (+486571us) service_pool.cc:224] Handling call
0709 12:23:51.856001 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.873507 (+ 17506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.873557 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.911368 (+ 37811us) log.cc:844] Serialized 26 byte log entry
0709 12:23:53.155126 (+1243758us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b180008a220. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:23:53.350370 (+195244us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:53.350423 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.350515 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.442950 (+ 92435us) raft_consensus.cc:1685] finished
0709 12:23:53.442975 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.443166 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":176017,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":26868480,"thread_start_us":195047,"threads_started":1,"wal-append.queue_time_us":1383475}
I20260709 12:23:53.468529 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:53.444427 31361 connection.cc:256] RPC call timeout handler was delayed by -1.6033309559998088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260709 12:23:53.445171 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 86) took 2076 ms. Trace:
I20260709 12:23:53.589135 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:53.434825 32077 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:53.446178 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:53.447269 31388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1334) took 1507 ms (client timeout 1802 ms). Trace:
I20260709 12:23:53.447548 31466 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:53.448246 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:53.591907 31392 raft_consensus.cc:2376] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3. Re-sending same reply.
I20260709 12:23:53.438158 31469 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:53.593428 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:53.593989 31469 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.440819 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.487515 31359 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.449481 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.504987 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.595430 31391 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
W20260709 12:23:53.595546 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 108146us
I20260709 12:23:53.595638 31395 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:53.595590 32081 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:53.596297 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:53.596670 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.596829 31391 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:53.450289 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:23:53.514530 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.597162 31395 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:53.525358 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.433148   371 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.433303   354 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:53.597739 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 147515us
I20260709 12:23:53.535409 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1257) took 1193 ms. Trace:
I20260709 12:23:53.446677 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.542042 32082 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:53.599952 31470 rpcz_store.cc:276] 0709 12:23:52.342130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.394998 (+ 52868us) service_pool.cc:224] Handling call
0709 12:23:53.535196 (+1140198us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b5400414954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.535356 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2106192128}
I20260709 12:23:53.473537   397 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.541290 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:53.601392 31542 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.431327   495 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:23:53.474123   378 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:53.603615   506 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.608040   378 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:53.608438 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.608764   378 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.436033 32764 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.434541   440 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.449489   447 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:53.436944 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:53.450567 31461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 116) took 1807 ms (client timeout 1594 ms). Trace:
I20260709 12:23:53.448355   460 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.437713   395 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:23:53.524191   446 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:53.439432   355 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.452351   403 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.437141 32050 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:53.452044   463 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.534508 32662 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:23:53.559161 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 171812us
I20260709 12:23:53.647876 31507 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.436271   484 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.553403 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:53.580960 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 416517us
I20260709 12:23:53.651935 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:53.586596 31467 raft_consensus.cc:3055] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:53.654398 31467 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:53.468160 31433 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:23:53.589706 31361 connection.cc:256] RPC call timeout handler was delayed by -1.5395895480000945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 12:23:53.656127 31361 connection.cc:256] RPC call timeout handler was delayed by -1.4458309560000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 12:23:53.587085 31464 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:23:53.589958 31539 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.589773 31541 rpcz_store.cc:276] 0709 12:23:51.368835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.851259 (+482424us) service_pool.cc:224] Handling call
0709 12:23:53.445025 (+1593766us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540021e154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.445121 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3078289152}
I20260709 12:23:53.383327   318 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.599929 31436 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:23:53.660983 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 61151.5us
I20260709 12:23:53.661602   318 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:23:53.662667   504 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:23:53.663005 31361 leader_election.cc:400] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5.
I20260709 12:23:53.663339 31361 leader_election.cc:403] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:53.663250 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:53.663678   507 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:23:53.664459   417 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:53.664705 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.665263 32703 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5.
I20260709 12:23:53.650606   460 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:53.601540 31359 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.612550 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:53.613035 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.611618 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.616919 31469 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:53.590827   444 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:53.616954 31542 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:53.680626 31537 raft_consensus.cc:2410] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:23:53.585170 32075 rpcz_store.cc:269] 0709 12:23:51.667267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.746917 (+ 79650us) service_pool.cc:224] Handling call
0709 12:23:53.413899 (+1666982us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540054f954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.414066 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541925248}
I20260709 12:23:53.604085 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.634676 31543 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:53.608036   506 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:53.625109   482 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:53.612390   397 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:53.639982   502 log.cc:927] Time spent T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:23:53.714812   444 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:53.656972 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 52764.9us
I20260709 12:23:53.737087 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.738230 31510 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.665982 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:53.739555   520 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:23:53.739732   390 raft_consensus.cc:2764] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:23:53.590883 31388 rpcz_store.cc:269] 0709 12:23:51.939574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.941827 (+  2253us) service_pool.cc:224] Handling call
0709 12:23:53.447087 (+1505260us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001a22d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.447199 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3047048064}
I20260709 12:23:53.655472 31467 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.741865 31467 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:53.744728 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:53.745882   390 raft_consensus.cc:2764] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:53.669723 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.747546 31510 leader_election.cc:400] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4.
I20260709 12:23:53.681912 31390 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:53.653870 32048 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:53.748816 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 95033.2us
W20260709 12:23:53.679996 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 211903us
I20260709 12:23:53.683341   460 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.681232   440 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:53.679864 32662 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:53.694989   355 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:53.696111 31539 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:53.696512   403 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.696951 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:53.759667 31392 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:53.680164   354 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:53.698043   325 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.700285 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:53.764024 32081 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.689328   510 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.703999 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 126) took 1185 ms. Trace:
I20260709 12:23:53.764883 31462 rpcz_store.cc:276] 0709 12:23:52.518745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.296245 (+777500us) service_pool.cc:224] Handling call
0709 12:23:53.456534 (+160289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.582005 (+125471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.703804 (+121799us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003a89d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:53.703928 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367698816}
I20260709 12:23:53.682044 31544 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:53.704203 31436 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:53.680751 31389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:23:53.706292 31463 raft_consensus.cc:2368] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4.
I20260709 12:23:53.768537 31389 raft_consensus.cc:606] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
W20260709 12:23:53.707791 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 106304us
W20260709 12:23:53.624378 31461 rpcz_store.cc:269] 0709 12:23:51.643494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.644591 (+  1097us) service_pool.cc:224] Handling call
0709 12:23:53.450488 (+1805897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:53.603794   411 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:53.715890 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:53.668426 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 231334us
I20260709 12:23:53.642823   446 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.713951   436 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:53.655452 31391 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:53.726291 31535 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:53.705099   318 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:23:53.684213 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:53.749540 32048 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:53.778981 32048 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:53.780061 32048 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:53.752476 31467 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:53.750474 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:53.749423 31510 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:23:53.780745 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 96614.2us
I20260709 12:23:53.781476 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:53.723675   506 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:53.801086 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 51797.6us
I20260709 12:23:53.725996 31394 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:53.812772 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:53.813763 31539 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:53.724707   378 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.760790 31466 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
W20260709 12:23:53.771711 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 67598.7us
I20260709 12:23:53.770221 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.756968   395 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:53.775830   312 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.786938 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:53.802325 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.837366 31510 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.787744   454 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:53.772316   510 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:53.826390 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.811826   482 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.774313   460 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.759471 32662 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:53.778632   436 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:53.776196   354 raft_consensus.cc:697] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:53.838201 31510 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:53.806624 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 56206.9us
I20260709 12:23:53.814082   437 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 12:23:53.843691 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 56857.2us
I20260709 12:23:53.838070 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1356) took 1320 ms. Trace:
I20260709 12:23:53.811635 32764 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.805389 32710 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:53.814677   440 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:53.847847 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.816828 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.869717 32082 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:53.821022   385 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.821272   417 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.857173 31433 leader_election.cc:400] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:53.878006 31433 leader_election.cc:403] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:53.857684   436 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.810801 32703 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:23:53.846149   515 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:53.888264   515 raft_consensus.cc:697] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:53.889160   515 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.863096   397 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:53.895403 32081 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:53.896603   444 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.900139 31436 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:53.813781   505 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:23:53.862005 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:53.836473   312 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:53.780112   411 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:53.850052   373 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:53.915797   373 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.916193   373 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.916406   444 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.846710   325 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:53.850386   455 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.849838 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.854038   390 raft_consensus.cc:2764] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:23:53.847646   510 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.828711   447 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.851624   482 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:53.846341 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 45497.8us
I20260709 12:23:53.856163 32662 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:53.876200 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.880085 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:53.900225   393 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
W20260709 12:23:53.884315   516 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:23:53.862756 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:53.870788 32764 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.866056   463 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:53.914333 31289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38054 (request call id 252) took 5137 ms. Trace:
I20260709 12:23:53.914935   411 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:53.915378 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53466us
I20260709 12:23:53.876057   440 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:53.875406   385 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.940466 31289 rpcz_store.cc:276] 0709 12:23:48.772346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.772727 (+   381us) service_pool.cc:224] Handling call
0709 12:23:53.909446 (+5136719us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:50.215350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:50.360212 (+144862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:50.360260 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:23:50.360285 (+    25us) tablet.cc:662] Decoding operations
0709 12:23:50.500144 (+139859us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:50.548009 (+ 47865us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:50.575716 (+ 27707us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:50.767995 (+192279us) tablet.cc:701] Row locks acquired
0709 12:23:50.771548 (+  3553us) write_op.cc:260] PREPARE: finished
0709 12:23:50.792912 (+ 21364us) write_op.cc:270] Start()
0709 12:23:50.809066 (+ 16154us) write_op.cc:276] Timestamp: P: 1783599830792858 usec, L: 0
0709 12:23:50.810767 (+  1701us) op_driver.cc:348] REPLICATION: starting
0709 12:23:50.903114 (+ 92347us) log.cc:844] Serialized 1708 byte log entry
0709 12:23:53.155873 (+2252759us) op_driver.cc:464] REPLICATION: finished
0709 12:23:53.559220 (+403347us) write_op.cc:301] APPLY: starting
0709 12:23:53.561115 (+  1895us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:53.564446 (+  3331us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:53.564575 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:53.603952 (+ 39377us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:53.626135 (+ 22183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:23:53.640288 (+ 14153us) write_op.cc:312] APPLY: finished
0709 12:23:53.644017 (+  3729us) log.cc:844] Serialized 41 byte log entry
0709 12:23:53.645372 (+  1355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:53.645501 (+   129us) write_op.cc:454] Released schema lock
0709 12:23:53.645557 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:53.646042 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:53.646097 (+    55us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4460,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":392321,"apply.run_cpu_time_us":4496,"apply.run_wall_time_us":93520,"num_ops":4,"prepare.queue_time_us":892123,"prepare.run_cpu_time_us":61468,"prepare.run_wall_time_us":952121,"raft.queue_time_us":1064007,"raft.run_cpu_time_us":31093,"raft.run_wall_time_us":268978,"replication_time_us":2344909,"thread_start_us":1292585,"threads_started":5,"wal-append.queue_time_us":290192,"wal-append.run_cpu_time_us":66388,"wal-append.run_wall_time_us":2427501}]]}
W20260709 12:23:53.921696 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 271778us
I20260709 12:23:53.877827   417 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:53.887133   503 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.956584   503 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.956979   503 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.957186 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:23:53.838933 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 68784.3us
I20260709 12:23:53.930478 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:53.940102 32764 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.920053   312 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:53.932324 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 52345.9us
I20260709 12:23:53.917953   460 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:53.922178   319 raft_consensus.cc:2764] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:23:53.934617 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 78327us
I20260709 12:23:53.996376 31510 leader_election.cc:400] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4.
I20260709 12:23:53.996804 31510 leader_election.cc:403] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:23:53.921295   325 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.997502   325 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.926450   482 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.939431 31470 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:53.936275   395 raft_consensus.cc:697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:54.005074   395 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:53.930006 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 101433us
I20260709 12:23:53.937974   378 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:53.947156   440 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.956171   417 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.960858 31544 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:53.897883   354 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:53.960335 31359 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:53.966233   455 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:54.015714 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 55452.1us
I20260709 12:23:54.015771   455 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.016637 31359 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:54.017378 32703 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.017760 32703 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.018096 32703 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.018273 31359 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:54.018822 31544 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:53.944223 32078 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:54.019783   437 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:54.019878   434 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:54.020328   437 raft_consensus.cc:697] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:53.967128 32077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 294) took 1594 ms. Trace:
I20260709 12:23:54.021302   437 consensus_queue.cc:237] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.967834 32050 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:53.977152   446 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:54.021319   434 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:54.022989   434 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:54.023516 31436 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:54.023833   434 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.025135 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:53.987008 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:54.021471 32077 rpcz_store.cc:276] 0709 12:23:52.372573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.379712 (+  7139us) service_pool.cc:224] Handling call
0709 12:23:52.528231 (+148519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.592536 (+1064305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.966856 (+374320us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54001d24d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:53.967065 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950432128}
I20260709 12:23:53.967413   527 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.027805   527 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:54.028327   527 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.029452 32703 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.978775   447 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:54.031636 32703 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:54.034029   440 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:53.948803   385 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.036857 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:23:54.039899 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 72693.6us
W20260709 12:23:54.044584 32050 connection.cc:256] RPC call timeout handler was delayed by -1.8341517579997344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 12:23:54.053083 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 56889us
W20260709 12:23:54.042546 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 59829.8us
I20260709 12:23:54.054823 32662 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.057304 31464 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:54.053865 31510 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:54.036162   403 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.062470 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:54.037287   460 raft_consensus.cc:697] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:54.068233 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:54.063407 31467 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 1.
W20260709 12:23:54.067298 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.062111 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:54.075855 32080 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:54.077061 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:54.035722   371 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:23:54.057476   454 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:54.083514 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 46748.9us
I20260709 12:23:54.059300   515 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4.
I20260709 12:23:54.096581 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:54.097163 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 110302us
I20260709 12:23:54.108605 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:23:54.148242 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 65243us
I20260709 12:23:54.149674 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:53.864701 31468 rpcz_store.cc:276] 0709 12:23:52.517784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.232658 (+714874us) service_pool.cc:224] Handling call
0709 12:23:53.232971 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.361714 (+128743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.369630 (+  7916us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:53.412784 (+ 43154us) log.cc:844] Serialized 26 byte log entry
0709 12:23:53.565517 (+152733us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:53.574035 (+  8518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.770716 (+196681us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b54002c5e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:53.773252 (+  2536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.778406 (+  5154us) raft_consensus.cc:1685] finished
0709 12:23:53.778425 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.832513 (+ 54088us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2380,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":11773,"spinlock_wait_cycles":9936256,"thread_start_us":150190,"threads_started":1,"wal-append.queue_time_us":177616}
I20260709 12:23:54.079715   397 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:54.100016   301 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:54.073822   505 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.062929   319 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.157418 31464 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:54.159950 32048 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:54.163550 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:54.171869 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 153654us
I20260709 12:23:54.180341 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:54.185653 31461 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:54.079386   529 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:54.099967   454 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:54.187857 31433 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:54.155704 32662 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:54.076159   403 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.171880 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:23:54.209044 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 45561.3us
I20260709 12:23:54.210320 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:54.211563   542 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.211966   542 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:54.213204 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:54.216725 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.216922 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.220609 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.220993 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.221959 31539 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:54.223356 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.163053   458 consensus_queue.cc:1059] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:23:54.196126   454 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:54.190862   319 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.230391 31361 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:54.230616 31466 raft_consensus.cc:2368] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3.
I20260709 12:23:54.237221 31361 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:54.238391 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:54.228773 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:54.244519 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.250758   319 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.251654   440 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:54.253095   482 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.253693   325 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.190187   397 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.255205 32710 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:54.208205   529 raft_consensus.cc:697] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:54.212795   463 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:54.184814   436 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.217286   542 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.267819 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.230063   395 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:54.270323 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:54.264587 31292 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:23:54.200757   505 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.275362 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.255888   434 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.259104   437 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.259269 32662 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.259047   534 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:54.274849 31292 catalog_manager.cc:5697] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:54.260402 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.315311 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:54.315834 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 98640.8us
I20260709 12:23:54.212621   460 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.293193   434 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:54.267174 32703 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:23:54.284247 32710 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.315311 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.300071   395 raft_consensus.cc:697] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:23:54.328925   544 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 12:23:54.299280   437 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:54.318040 32662 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:54.450600 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 290730us
I20260709 12:23:54.501120 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:54.416177 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.409745 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.562038 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.563088 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.330972   301 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.342280 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:54.575018 31542 raft_consensus.cc:2376] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5. Re-sending same reply.
W20260709 12:23:54.410158 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.564388 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:54.580283 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:54.581151 32083 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:54.564582 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.415305 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:54.579358 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:54.587217 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:54.362449 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:54.588758 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:54.585407 31436 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:54.613063 32703 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.614125 32703 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.342315 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:54.587569 31538 raft_consensus.cc:2368] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4.
W20260709 12:23:54.463904   547 log.cc:927] Time spent T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:23:54.464996   541 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:23:54.488065   543 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:23:54.380831   528 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.438s	user 0.003s	sys 0.000s
I20260709 12:23:54.382310 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:54.626971 31536 raft_consensus.cc:2368] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:54.584677   542 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:54.490739   506 consensus_meta.cc:287] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.004s
I20260709 12:23:54.629002   506 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.631394 31544 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:54.350090 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:54.382019 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:54.583868 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:23:54.488775   551 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:23:54.464897   373 consensus_meta.cc:287] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.006s
W20260709 12:23:54.470062   517 log.cc:927] Time spent T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:23:54.493366   510 consensus_meta.cc:287] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.001s
W20260709 12:23:54.464376   536 log.cc:927] Time spent T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 12:23:54.646083   373 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.339944   434 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.646790   510 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:54.649071   510 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:54.488281   538 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
W20260709 12:23:54.489290   535 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:23:54.646061 31393 raft_consensus.cc:2368] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:54.340299   482 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:54.463789   397 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:54.487391   395 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.500154   455 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.343145 31535 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:54.381083 31540 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:23:54.573980   437 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.463932 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:54.418033   529 consensus_queue.cc:237] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.486362 31394 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:54.665125 31540 pending_rounds.cc:85] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 2
I20260709 12:23:54.532918   319 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.532758   403 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:54.560454 32710 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:54.319674   503 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.464529 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:54.665689   552 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:54.410451   325 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:54.684525   454 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.499032   385 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.724251 32710 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.724460   552 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.726316   385 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:54.655160 32662 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:54.493800   312 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.728705   312 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:54.478400   417 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.729776   454 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:54.507367 32764 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.731073   417 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:54.676966   455 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:54.731390   503 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:54.670941   505 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:54.671666 31539 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:23:54.659487 31390 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
W20260709 12:23:54.667505 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 467141us
W20260709 12:23:54.678908   523 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:23:54.739691   527 consensus_meta.cc:287] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.004s
I20260709 12:23:54.686158 31540 pending_rounds.cc:107] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:23:54.764642 32703 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:54.765781 31540 raft_consensus.cc:2889] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:54.749136   506 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:23:54.787284 31508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.011s	sys 0.012s
W20260709 12:23:54.788544 31508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.012s	sys 0.012s
I20260709 12:23:54.800686   434 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:54.765573 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 57620.1us
I20260709 12:23:54.775738   527 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.790712 32078 raft_consensus.cc:2393] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:54.807942   458 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.808581 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:54.777577 31467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.003s	sys 0.016s
W20260709 12:23:54.815518 31467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.004s	sys 0.016s
W20260709 12:23:54.778079 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.006s	sys 0.013s
I20260709 12:23:54.735180 32710 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.726949   552 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:54.824560   393 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.825348   437 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:54.826381   393 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:54.826838   393 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.808465   458 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:54.807842 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:54.777236 31469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.009s	sys 0.010s
W20260709 12:23:54.777848 31462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.015s
W20260709 12:23:54.817119 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.006s	sys 0.013s
W20260709 12:23:55.185004 31462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.006s	sys 0.018s
I20260709 12:23:54.932323 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:55.186534 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 1.0032e+06us
W20260709 12:23:54.837246 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.835608 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:55.188122 31538 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:54.916550 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:54.837496 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:55.187492 31434 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.189082 32083 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:23:55.124737 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.000s	sys 0.034s
I20260709 12:23:55.189508 31470 raft_consensus.cc:2393] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:55.188212 31542 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:23:55.184799 31359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.000s	sys 0.023s
W20260709 12:23:55.190646 31359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.000s	sys 0.023s
I20260709 12:23:55.190714 32081 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:55.191210 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.184481 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:54.860368 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:55.191841 31542 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.184060 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:55.193379 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:55.187103 31433 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:55.194054 31464 raft_consensus.cc:2376] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5. Re-sending same reply.
W20260709 12:23:55.189932 31469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.019s	sys 0.013s
I20260709 12:23:55.194846 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:55.182446 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:55.195385 31464 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:55.189672 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.000s	sys 0.036s
W20260709 12:23:55.196739 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 958335us
I20260709 12:23:55.197651 31361 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.199047 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.199961   555 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:55.200412 31361 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.200435   555 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.201130   555 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.201666 31361 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.207015   573 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:55.207468 32703 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:55.209144 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.218850 31510 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:55.220885 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.212236 31466 raft_consensus.cc:2393] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:54.836002 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:55.222584   371 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.226944 31461 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:55.228911 31510 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:55.226830 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:55.235837 31542 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:23:54.829246   378 raft_consensus.cc:3055] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:55.160188   562 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.383s	user 0.001s	sys 0.001s
I20260709 12:23:54.985822 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:55.229398 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:54.868602 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:54.834417 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:55.252806 31464 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:54.831480   403 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:55.211755   534 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:54.936499   506 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:54.832317   458 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:55.223403   440 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.228562   395 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:55.227774   527 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:55.210628   482 consensus_queue.cc:1059] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:23:55.246419   378 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:55.241509   455 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:55.241881 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.283339   458 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:55.245741   371 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:55.211097   393 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.244204   503 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.222348   444 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:23:55.258121   460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.017s	sys 0.040s
I20260709 12:23:55.256750 32075 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.290163   570 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:55.289763   455 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:55.303719   570 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.280468   506 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:55.300122   556 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.557s	user 0.003s	sys 0.000s
I20260709 12:23:55.291050   505 consensus_queue.cc:1059] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 12:23:55.300735   460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.017s	sys 0.041s
I20260709 12:23:55.295157   557 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.299005   503 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.310129   455 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.285441   569 consensus_queue.cc:1059] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:23:55.310781   570 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.324745   555 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.311044   574 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.325747   574 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:55.326195   574 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.323294   557 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.326810   555 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.329026   529 raft_consensus.cc:3055] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:55.329439   529 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:55.330289   529 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.335917   574 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.337347   506 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:55.338807   574 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:55.290344 31535 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.370870 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1338) took 1082 ms. Trace:
I20260709 12:23:55.373175 31543 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:55.285336 31537 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:55.257421 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.375789 31540 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.371621 31541 rpcz_store.cc:276] 0709 12:23:54.288269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.590911 (+302642us) service_pool.cc:224] Handling call
0709 12:23:54.592943 (+  2032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.595726 (+  2783us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:23:54.595767 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.708566 (+112799us) log.cc:844] Serialized 26 byte log entry
0709 12:23:55.135596 (+427030us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:55.135664 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.135758 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.369708 (+233950us) raft_consensus.cc:1685] finished
0709 12:23:55.369829 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.370462 (+   633us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2252,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":77475,"thread_start_us":426692,"threads_started":1,"wal-append.queue_time_us":554059}
I20260709 12:23:55.378623 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:23:55.372167 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 180872us
W20260709 12:23:55.382004 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.386123 32075 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:55.387094 32079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 358) took 1325 ms. Trace:
I20260709 12:23:55.438651   440 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.296358   371 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.439512   440 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.440006   371 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.305120   378 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.286480   395 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.261255   403 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.390627   381 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.321875   503 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.396039   460 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.396266   393 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:55.396054 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:55.398777 31535 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:55.410281 32048 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:55.412242 31540 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
W20260709 12:23:55.413115 31507 leader_election.cc:336] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.702s (SENT)
I20260709 12:23:55.416620 32078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 357) took 1355 ms. Trace:
I20260709 12:23:55.422142 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:55.429735 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.430011   434 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.432142   455 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:55.449749 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 228794us
W20260709 12:23:55.458863 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 49020.7us
I20260709 12:23:55.459678 31538 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:55.461221 32048 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:55.465871   577 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.465888 31507 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:55.467882   378 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.468381   582 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:55.469409 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 56457.5us
W20260709 12:23:55.472697 31507 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.802s (SENT)
W20260709 12:23:55.471302 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 279510us
I20260709 12:23:55.480176 31433 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.481333   393 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.481755   393 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.482158   393 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.438511 32079 rpcz_store.cc:276] 0709 12:23:54.061659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.067958 (+  6299us) service_pool.cc:224] Handling call
0709 12:23:54.467149 (+399191us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:23:54.467381 (+   232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.467646 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.467675 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.468221 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.608558 (+140337us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:54.608600 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.608681 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.988286 (+379605us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:23:55.298210 (+309924us) raft_consensus.cc:1685] finished
0709 12:23:55.299960 (+  1750us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.386821 (+ 86861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118135936,"thread_start_us":139928,"threads_started":1,"wal-append.queue_time_us":308987}
I20260709 12:23:55.456794 32078 rpcz_store.cc:276] 0709 12:23:54.061260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.067884 (+  6624us) service_pool.cc:224] Handling call
0709 12:23:55.416112 (+1348228us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54001fb3d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:55.416427 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235201280}
I20260709 12:23:55.488229   319 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:55.490432   565 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.712s	user 0.011s	sys 0.003s
I20260709 12:23:55.473892   403 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:55.478618 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1324) took 1263 ms. Trace:
I20260709 12:23:55.491212 31537 rpcz_store.cc:276] 0709 12:23:54.215580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.220659 (+  5079us) service_pool.cc:224] Handling call
0709 12:23:54.467632 (+246973us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197eee 000000000036eb39 00007f6e9620b1e0 00007f6e962d40c4 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:23:54.467785 (+   153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.374660 (+906875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.478147 (+103487us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54003feb54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:55.478412 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837280896}
I20260709 12:23:55.492116   437 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.494571   527 raft_consensus.cc:3055] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:55.494768 31537 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:55.495632   506 raft_consensus.cc:3055] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.495316   381 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.496140   460 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.466459   577 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:55.461896 31539 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:55.499847 31538 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:55.503445 31433 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.463858 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:55.508490   460 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.510957   381 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.501610   506 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:55.512900   506 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.515411 31536 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:55.517884 31540 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:55.518162   301 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.518815   301 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.520143 31543 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:55.521559   595 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:55.528744 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.529500   570 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.530366 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.532022   570 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.533834   395 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.533576   371 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:55.534605 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.504518   577 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.535138 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1377) took 1452 ms. Trace:
I20260709 12:23:55.536480   436 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.499506   527 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:55.537535   588 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:55.540890 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 68271.9us
I20260709 12:23:55.542444 32710 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.538846 32764 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.549587   373 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.550666   557 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.551666 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.552119 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.553570 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.553972   455 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:55.554344   595 raft_consensus.cc:697] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:55.562191 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.562589   393 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.563565 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.564761 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.566304 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1382) took 1484 ms. Trace:
I20260709 12:23:55.588040 31462 rpcz_store.cc:276] 0709 12:23:54.081309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.162009 (+ 80700us) service_pool.cc:224] Handling call
0709 12:23:54.162264 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.262809 (+100545us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:54.273369 (+ 10560us) log.cc:844] Serialized 14 byte log entry
0709 12:23:55.211031 (+937662us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:55.211081 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:55.211124 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.565892 (+354768us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54002c6354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:23:55.565954 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.566131 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1574,"prepare.queue_time_us":10845,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5445,"raft.queue_time_us":26255,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":16693,"spinlock_wait_cycles":230741888,"thread_start_us":911906,"threads_started":1,"wal-append.queue_time_us":1026865}
I20260709 12:23:55.590097   371 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.567163   542 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.591532 31436 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:23:55.593765 31507 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.857s (SENT)
I20260709 12:23:55.594220   529 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.594763 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.592415   506 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.595248   527 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.582623   460 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.597098   527 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.597748 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:55.598515   588 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.599361 31538 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:55.599529   542 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:55.600039   542 raft_consensus.cc:697] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:55.601043   588 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.601393 31535 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:55.601217   542 consensus_queue.cc:237] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.572856 31469 rpcz_store.cc:276] 0709 12:23:54.074530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.074720 (+   190us) service_pool.cc:224] Handling call
0709 12:23:54.074960 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.075136 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:54.099880 (+ 24744us) log.cc:844] Serialized 14 byte log entry
0709 12:23:55.451670 (+1351790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:55.451768 (+    98us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:55.465408 (+ 13640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.502102 (+ 36694us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.526522 (+ 24420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26720,"prepare.queue_time_us":108924,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":5101,"raft.queue_time_us":49458,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":9541,"thread_start_us":1263591,"threads_started":2,"wal-append.queue_time_us":1137110}
I20260709 12:23:55.603693   381 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.604373   381 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.605744 32048 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:55.606808   552 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:55.607313   560 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:55.608140   595 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.608886   552 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:55.609575   552 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:55.610327   381 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.610769   552 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:55.611369 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 352819us
I20260709 12:23:55.612437 31510 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:55.613102   559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.004s	sys 0.013s
W20260709 12:23:55.613415   559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.004s	sys 0.013s
W20260709 12:23:55.614307 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 277199us
I20260709 12:23:55.614480 31535 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:55.621223   503 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.622829 31541 raft_consensus.cc:2393] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:55.625186 32077 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:23:55.625514 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:23:55.627744 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 148846us
W20260709 12:23:55.630535 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 129252us
I20260709 12:23:55.607182 31359 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:55.628999 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:55.636884   592 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.637959   505 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:55.637794   592 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.636981   403 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:55.638376   505 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:55.651800   505 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.652292 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:55.652787 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:55.653735 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:55.641053   570 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:55.641949 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:55.642092   436 consensus_queue.cc:1059] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:55.643028 31433 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.643265   587 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:55.646848 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:55.647858 31392 raft_consensus.cc:3055] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.647992 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:55.646900 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:55.663297 31392 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:55.667830 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:55.668140 31389 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:55.668711 31388 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:23:55.660668   588 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:55.670163   592 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:55.670569   588 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.671036   436 raft_consensus.cc:3055] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:55.671437   436 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:55.672780   588 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.672627   436 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.665655   587 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.674563   587 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.673976 31392 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.675361   403 raft_consensus.cc:697] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:55.675813 31392 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.676787   403 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.674012   436 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.681123 31394 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:55.682633 31433 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.627914   440 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.665773 32075 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:55.708503 31392 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:55.683476   557 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:55.717341 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.718261 32077 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:55.718786 31433 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.720284 31392 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:55.721792 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:55.721947 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:55.722313 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:55.723483   460 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.713277 31434 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.743294 31510 leader_election.cc:400] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3.
I20260709 12:23:55.743621 31510 leader_election.cc:403] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:55.741596 31433 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.687304   577 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.751495   591 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.752188   591 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.729048   503 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:55.734436   460 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.770488 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.761180 31540 raft_consensus.cc:2410] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:23:55.771517 31538 raft_consensus.cc:1240] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:55.773125   393 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.773669   557 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:55.775291 31433 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.775640   593 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:55.771996   460 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.776113   589 consensus_queue.cc:1059] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:55.776933 31507 leader_election.cc:336] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.527s (SENT)
I20260709 12:23:55.778378   591 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:55.717191   301 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.788004 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:55.788245 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:55.788779 31469 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.789484   301 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.789690 31535 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:55.780141   599 log.cc:927] Time spent T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:23:55.781008 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 121216us
I20260709 12:23:55.758111   371 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:23:55.796134 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.887s (SENT) [suppressed 31 similar messages]
I20260709 12:23:55.797621 31433 leader_election.cc:400] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:55.804157 31433 leader_election.cc:403] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:55.798722   589 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:55.806231 32079 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:55.799552   397 raft_consensus.cc:3055] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.807076   397 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:55.799731 31541 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:55.787539   593 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.780566 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:55.791543 32078 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:55.810587 31469 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:55.823274   440 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:55.824337   397 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.826333   397 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.818728   371 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:55.828061 31433 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.828552 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:55.828953 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.829234 31462 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.828255   371 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.830914   378 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.831436   301 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:55.831713 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:55.832449 31507 leader_election.cc:336] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.079s (SENT)
I20260709 12:23:55.831851   301 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.833001 31507 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:55.833072   301 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:55.834401 31507 leader_election.cc:336] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.136s (SENT)
I20260709 12:23:55.835541   589 consensus_queue.cc:1059] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.836036   503 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.836882   589 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.837016   373 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.837330   570 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:55.838310   373 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.817878   593 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.839221 32764 raft_consensus.cc:3055] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:55.836254 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:55.830678 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.844519 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:55.839599 32764 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:55.844745   589 raft_consensus.cc:3055] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:55.865020 32081 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.868172 32047 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:23:55.873684 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 123385us
W20260709 12:23:55.874918 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44308us
I20260709 12:23:55.883181 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:55.860702   589 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:55.884599   595 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:55.885100   595 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:55.885531   595 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:55.889356 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 224943us
I20260709 12:23:55.889473 31462 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:55.874683 32047 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.864934   440 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:55.893743   552 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:55.893801 32764 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:55.869258 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:55.896297 32078 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:55.897656 31436 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:55.874497 31536 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:55.904227 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.906342 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 70190.1us
I20260709 12:23:55.912166 31389 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:55.912238 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:55.901460 32764 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.904245   403 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.910943   568 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.937096 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.903961   552 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:23:55.942860 32081 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
W20260709 12:23:55.946296 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 153213us
I20260709 12:23:55.953222 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:55.953837   594 consensus_queue.cc:1059] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:23:55.954293 32710 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:23:55.954895   594 raft_consensus.cc:3055] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:55.955251   594 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:55.955327 32710 raft_consensus.cc:3055] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:55.932819   403 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.935415   577 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:55.912730   542 consensus_queue.cc:1059] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:23:55.958453 32048 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.940167   529 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3.
I20260709 12:23:55.961114 31436 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:55.962277   594 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.939424   440 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.921228   570 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:23:55.953222 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:55.964090   403 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.957773 32710 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:55.971935   557 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:55.978696   557 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:55.978977   587 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.979636   557 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:55.980737 31463 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:23:55.981215   587 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:23:55.981348   598 log.cc:927] Time spent T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.208s	user 0.001s	sys 0.005s
I20260709 12:23:55.966643   560 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:23:55.973903   381 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:55.975486 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:23:55.988965 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 54380.9us
I20260709 12:23:55.993089 32048 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:55.995061 31434 leader_election.cc:400] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4.
I20260709 12:23:55.995193   417 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:55.995465 31434 leader_election.cc:403] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:23:55.999567 31468 raft_consensus.cc:1275] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:55.999737 31469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:23:56.000775   540 raft_consensus.cc:3055] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.996410   436 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.001240   540 raft_consensus.cc:740] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:56.001515   436 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.002229   540 consensus_queue.cc:260] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.003662   436 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.003813   540 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:56.006423   605 log.cc:927] Time spent T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260709 12:23:55.998512   505 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.009272   393 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4.
I20260709 12:23:55.994172   568 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.010227   568 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.010713 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.012363   568 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:56.013499   609 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:23:55.992192   594 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.020171 32710 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.021130 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.022042 31469 raft_consensus.cc:606] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:56.022410 31434 leader_election.cc:400] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:56.026014 31469 raft_consensus.cc:614] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:56.048700 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 116489us
I20260709 12:23:56.059607 31433 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:23:56.058815 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.066262 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 44036.8us
I20260709 12:23:56.066495 31433 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:56.067066 31434 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:56.067703   588 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.067997   557 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:56.068441   557 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:56.068807   557 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:56.071429   600 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.219s	user 0.003s	sys 0.000s
I20260709 12:23:56.072549   591 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:56.063856   393 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:23:56.074098   591 consensus_queue.cc:1059] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:56.088464 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.061713 32710 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.099368 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.100154 31392 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:56.101850 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.102905 31393 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:56.060938   301 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:56.105612   603 log.cc:927] Time spent T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:23:56.107178   301 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.082427 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.107822   301 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:56.108278   301 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:56.108355 31386 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 1.
I20260709 12:23:56.109112   301 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.109860 31391 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:56.113691 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:56.114738 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 62785.3us
I20260709 12:23:56.116362 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.116945   573 raft_consensus.cc:3055] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:56.117318   573 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:56.062852   460 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:56.124672 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 55187.6us
I20260709 12:23:56.136118 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.152426 31464 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.153699 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:56.154414   616 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:23:56.154779 31388 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:23:56.156190   602 log.cc:927] Time spent T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.376s	user 0.000s	sys 0.005s
W20260709 12:23:56.159351 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.160982 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:56.161638 32083 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:56.162564 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:56.170728 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:56.174649 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 48215.1us
I20260709 12:23:56.139623   397 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:56.179328 31434 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:56.182546 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.186721 31392 raft_consensus.cc:2393] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:23:56.190083 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.191109   615 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.197s	user 0.000s	sys 0.002s
I20260709 12:23:56.191340 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.192135 31464 raft_consensus.cc:2393] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:56.192274 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.195106 31461 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:56.196043 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:56.196630 31544 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.198709 31393 raft_consensus.cc:3055] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:56.199035 31393 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:56.200035 31538 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:56.202625   617 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 12:23:56.207423 31467 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:56.211884 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.213634 31469 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.219617 31461 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:23:56.219691   611 log.cc:927] Time spent T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:23:56.150713   593 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.221760 31464 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:56.222465   593 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.224526 32083 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:56.225905 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.236344 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.236820 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:56.237179 31461 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:56.237722 31535 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:56.237387 31393 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.238410 31393 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.238543 31464 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:56.238564 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.256556 31538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:56.259327 31538 raft_consensus.cc:606] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
W20260709 12:23:56.261062 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.226306   505 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:56.204627   397 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.212651   557 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.283458 31463 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:23:56.280032 31507 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.755s (SENT)
I20260709 12:23:56.230363   393 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:23:56.277661 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 103184us
W20260709 12:23:56.288934 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.288533 31507 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:56.271212   588 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.294998 31469 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
W20260709 12:23:56.300988   614 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:23:56.304154 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:56.306977 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:56.288017 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:56.318287 31544 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:23:56.295950   588 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:56.323153 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.311573   378 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3.
I20260709 12:23:56.325696 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:56.326045 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 46040.6us
I20260709 12:23:56.308475   417 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:23:56.327729 31469 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:23:56.330071 31507 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.777s (SENT)
I20260709 12:23:56.322165   505 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:56.332782 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:56.331346 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 49783.5us
I20260709 12:23:56.331547   460 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.312150   403 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.323212   588 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.334610 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:56.338960 32050 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:56.327188   397 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.348199   552 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:56.358726 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.359333 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.366715 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.373060   301 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.373306 31544 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.373477 31389 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:56.374409   595 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.374683   589 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.376612 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.385130 31466 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:56.386401 31466 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.387990 31466 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:56.377509 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.379796   403 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:56.355330 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:56.391372 32050 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:56.392984 32050 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:56.380863 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:56.346020 31361 connection.cc:256] RPC call timeout handler was delayed by -2.6307637300001261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3003s for a response
I20260709 12:23:56.394057 31469 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:56.394385 31361 connection.cc:256] RPC call timeout handler was delayed by -1.5727755399998387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 12:23:56.394804 31361 connection.cc:256] RPC call timeout handler was delayed by -1.1641755400000875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 12:23:56.395195 31361 connection.cc:256] RPC call timeout handler was delayed by -1.1623755400000846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260709 12:23:56.398298 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:56.399783   395 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.400767   395 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:56.384001 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 53944.6us
I20260709 12:23:56.401741   395 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.402275   395 raft_consensus.cc:697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:56.402954 32710 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.404469   395 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:56.408360 31507 leader_election.cc:336] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.085s (SENT)
I20260709 12:23:56.413451   560 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:56.400695 31361 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:56.420014 32710 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:56.420426 32710 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:56.421288 32710 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:56.420930 31507 leader_election.cc:336] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.323s (SENT)
I20260709 12:23:56.424234 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:56.428113   505 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.420327 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:56.435320   594 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:56.441511   633 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:23:56.441823 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.441953   573 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.442685 31391 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:56.443656 31394 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.444200   557 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.380301 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.445231 31470 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:56.357577 31536 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:56.448323   595 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.450977 32077 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:56.451808 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:56.454789   560 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:56.455837 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:56.456255   589 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.456805 32082 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:56.459393 31394 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:56.459827 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:23:56.460222 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 78463.1us
I20260709 12:23:56.439191 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:56.462921 31359 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:56.466514 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 121273us
I20260709 12:23:56.474260 31469 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:56.443068   573 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.523329 31393 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:23:56.523869 31393 pending_rounds.cc:85] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 4
I20260709 12:23:56.532526 32082 raft_consensus.cc:1240] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.476331 32764 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:56.524128 31393 pending_rounds.cc:107] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:23:56.537209 31393 raft_consensus.cc:2889] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:56.470656   582 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.544354 32710 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.545727 32764 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:56.550133 32075 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:56.550427 31468 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:56.483943   417 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:23:56.530687   529 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.539345 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:56.570297 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 133125us
I20260709 12:23:56.584301 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.584885 31393 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.585222 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.585593 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.584705 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.586802 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.587550 31395 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:56.588761 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.588937 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.590742 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.591329 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.596057 31393 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:56.601606 31510 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:56.608163 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.612039 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.609237 31389 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:56.564446   436 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:56.622325 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.568194   529 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.608390 31394 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:23:56.625648 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 69747.9us
I20260709 12:23:56.569226   455 consensus_queue.cc:1059] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:23:56.611686   440 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:56.635365 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 318298us
I20260709 12:23:56.636312 31433 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:56.639278 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.639889 31389 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:56.634677 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.641745 31390 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:56.622551   636 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.645913   463 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:23:56.653313 32079 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:56.654479   645 raft_consensus.cc:3055] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:23:56.663195 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 195935us
I20260709 12:23:56.663980 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.646629 31386 raft_consensus.cc:2393] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:56.661046   645 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:56.665941 32710 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:56.667913 31389 raft_consensus.cc:2393] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:56.644084   644 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:23:56.656797   436 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:23:56.679173   593 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.681752 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.682418 31389 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:56.683364 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.683902 31391 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:56.684307   529 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:56.685083 31387 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:56.685554 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.686220 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:56.666059   626 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 12:23:56.694862 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 58609.2us
I20260709 12:23:56.697018 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:56.714134 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:56.718338 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:56.669696   588 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.697549   455 raft_consensus.cc:3055] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:56.638799 32764 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.738865   455 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:56.739890 31389 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:56.739781   455 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.740948   455 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.692132   505 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:56.743688 31464 raft_consensus.cc:1240] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.698064   593 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:56.729945 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:56.743304 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 112935us
I20260709 12:23:56.728422 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:56.742627 31544 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:56.746928 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.744685 31467 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.748461 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.750257 31395 raft_consensus.cc:2410] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:56.750751 31470 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.750937 31539 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:56.755635 31470 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.755533 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:56.753841 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:56.756151 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.758940 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.759159 31462 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.759526 31467 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.759631 31538 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:23:56.760270 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 158746us
I20260709 12:23:56.759459 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:56.761256 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 64275.5us
I20260709 12:23:56.744429   460 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.768893 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:56.769254   640 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:23:56.765586 31470 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.746296   593 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.770967   593 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.766139 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:56.772178 31462 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:56.772681 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:56.773598 32710 raft_consensus.cc:3055] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:56.773732   436 consensus_queue.cc:1243] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:56.774035 32710 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:56.774161 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:23:56.775795 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.777194 31390 raft_consensus.cc:1240] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.778144 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.778868 31462 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.779197 31387 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.779834 31391 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:56.779891 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.780190 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.780599 31462 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.780836 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.781476 31392 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.781848 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.783097 31388 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.768958   460 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.784240 31290 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 3, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 3 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.785319   460 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.783598 31292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45406 (request call id 160) took 7988 ms. Trace:
I20260709 12:23:56.786070 31290 catalog_manager.cc:5697] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.787320 31466 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.788470 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:56.789103 31469 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:56.789712 31462 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:23:56.760669 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:56.764750 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:56.791319 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.794163 31465 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.795848 31469 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.797216   570 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:56.797503   506 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:56.797802   570 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.799268 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:56.799821 32081 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.800139   570 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:56.801105 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.802356   591 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.802688 31467 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
W20260709 12:23:56.804150 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.804291 31433 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:56.808295 32081 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:23:56.808355 31290 catalog_manager.cc:5697] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.780727 31387 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.810460 31469 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:56.817763 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.818856 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.819754 31392 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:56.821565 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.788115 31537 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:56.825145 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.829140 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:56.802968   589 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.836153   529 consensus_queue.cc:1059] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:56.837193   623 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:56.836185 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.803591   627 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:56.836418 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.826925 31290 catalog_manager.cc:5697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.841051 31392 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:56.841176 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.818590   582 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.843889 31290 catalog_manager.cc:5697] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.856825 31388 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:56.841708 31462 raft_consensus.cc:1240] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.845266   506 raft_consensus.cc:3055] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.849463 31466 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:56.775000 32710 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.802830   591 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:56.861881 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 56226.2us
I20260709 12:23:56.870824 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:56.911830 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.842754 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:56.913853 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.824920   397 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:23:56.860335   594 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:56.861109   506 raft_consensus.cc:740] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:56.914088 31290 catalog_manager.cc:5697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 3 to 4, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 4 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.926011   440 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.858536   582 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:56.927940 31393 raft_consensus.cc:1240] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:56.929927 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.925137 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.933079 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:56.846989   589 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:56.936208 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.913486 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:56.934743 31392 raft_consensus.cc:2376] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2. Re-sending same reply.
I20260709 12:23:56.785876 31292 rpcz_store.cc:276] 0709 12:23:48.795465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.795603 (+   138us) service_pool.cc:224] Handling call
0709 12:23:56.783387 (+7987784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:54.585050 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:54.673407 (+ 88357us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:54.673442 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:23:54.673465 (+    23us) tablet.cc:662] Decoding operations
0709 12:23:54.673878 (+   413us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:54.673998 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:54.674030 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:54.766480 (+ 92450us) tablet.cc:701] Row locks acquired
0709 12:23:54.776998 (+ 10518us) write_op.cc:260] PREPARE: finished
0709 12:23:54.808013 (+ 31015us) write_op.cc:270] Start()
0709 12:23:54.808140 (+   127us) write_op.cc:276] Timestamp: P: 1783599834802490 usec, L: 0
0709 12:23:54.808168 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:23:54.822516 (+ 14348us) log.cc:844] Serialized 925 byte log entry
0709 12:23:55.556919 (+734403us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e8e1b20ac 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b
0709 12:23:56.070397 (+513478us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:23:56.224697 (+154300us) op_driver.cc:464] REPLICATION: finished
0709 12:23:56.564315 (+339618us) write_op.cc:301] APPLY: starting
0709 12:23:56.601163 (+ 36848us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:56.632136 (+ 30973us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:56.639571 (+  7435us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:56.653725 (+ 14154us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:56.654003 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:23:56.654067 (+    64us) write_op.cc:312] APPLY: finished
0709 12:23:56.654434 (+   367us) log.cc:844] Serialized 29 byte log entry
0709 12:23:56.654646 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:56.654752 (+   106us) write_op.cc:454] Released schema lock
0709 12:23:56.662784 (+  8032us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:56.665865 (+  3081us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:56.665904 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":300894,"apply.run_cpu_time_us":2931,"apply.run_wall_time_us":126603,"num_ops":2,"prepare.queue_time_us":185819,"prepare.run_cpu_time_us":22264,"prepare.run_wall_time_us":1082578,"raft.queue_time_us":103182,"raft.run_cpu_time_us":41467,"raft.run_wall_time_us":135397,"replication_time_us":1416332,"spinlock_wait_cycles":94842112,"thread_start_us":1093539,"threads_started":4,"wal-append.queue_time_us":940320}]]}
I20260709 12:23:56.944859 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.945258   591 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:56.945550 31391 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:56.946676 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.947558 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:56.947942   588 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:56.931656   460 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.961251 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.964388 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.965435 31394 raft_consensus.cc:2393] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:23:56.972577 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.975497 31290 catalog_manager.cc:5697] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 3 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.977989 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.978860 31392 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:56.982048 31290 catalog_manager.cc:5697] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.968540 32710 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.984140 31290 catalog_manager.cc:5697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 2 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.989079 31469 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.989648 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:56.994527 31469 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.000099 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:57.000723 31290 catalog_manager.cc:5697] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 3 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.005893 31361 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:57.008136   638 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:23:57.009783 31464 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:23:57.010183 31464 pending_rounds.cc:85] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 2
I20260709 12:23:57.010453 31464 pending_rounds.cc:107] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:23:57.010716 31464 raft_consensus.cc:2889] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:57.011435 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:57.011554 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:57.012432   656 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.961596   593 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:57.015333 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 103411us
I20260709 12:23:57.015198 31390 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:57.019647   506 consensus_queue.cc:260] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.025863   582 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:57.026382   506 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.966421   460 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.030339 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:57.031124 31469 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:23:57.041864 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:56.992445   659 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.044911 31470 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.050302 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:57.052983 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.053602 31394 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:23:57.061188 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.061923 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.025190 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:57.066843 31462 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:57.072641 31391 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:57.054311   403 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.073653 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:23:57.075070 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 57250.8us
I20260709 12:23:57.076579 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:57.076713 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.079037 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.080293 31395 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:57.083536   670 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:23:57.085104 31394 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.086555 31394 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.086867 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:57.089275 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:57.078486   659 raft_consensus.cc:697] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.092638 31537 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:57.064291   371 raft_consensus.cc:3055] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:57.093151   371 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:57.095518   403 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:57.097108   647 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:23:57.098134   403 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:57.101361 31387 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
W20260709 12:23:57.102280   660 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.183s	user 0.010s	sys 0.000s
I20260709 12:23:57.103691   589 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.103969 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1288) took 1093 ms. Trace:
I20260709 12:23:57.104398 31468 rpcz_store.cc:276] 0709 12:23:56.010243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.010456 (+   213us) service_pool.cc:224] Handling call
0709 12:23:57.103797 (+1093341us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540036c254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:57.103895 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748160256}
I20260709 12:23:57.105182   460 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:57.074107   568 consensus_queue.cc:1059] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:23:57.098150 31392 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.092219   659 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.110532 31394 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.112175 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.112293 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:57.112818 31390 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:57.114437   582 consensus_queue.cc:1059] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.114822   667 consensus_queue.cc:1059] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:57.115278   582 consensus_queue.cc:1243] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer 842fbe33f4144fa69f1fd428652b6998 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:23:57.115772   582 raft_consensus.cc:3055] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:57.116128   582 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.117059   582 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.118227   582 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.119591   668 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:57.124250 31542 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.127832 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:57.128513   623 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:57.111687   656 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.132339 32047 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.135181 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:57.139395 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:57.140389 31469 raft_consensus.cc:2393] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:23:57.142295 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.142731 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.144064 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.131959   463 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:57.145536 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:57.145736 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:57.135979 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:57.147249 31388 raft_consensus.cc:3055] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.147598 31388 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.146265 31466 raft_consensus.cc:2368] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4.
I20260709 12:23:57.148353 31388 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.149387 31388 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.158506 31544 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:23:57.164536 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:57.164956 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.166615 31462 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:57.168731 31464 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:57.172303 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.173959 31394 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.136708   653 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.178519 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:57.171272 32050 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:57.183045 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:57.184278   455 consensus_queue.cc:1059] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:23:57.204074   455 raft_consensus.cc:3055] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:57.204422   455 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.205281   455 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.206362   455 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.184592   625 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:23:57.180922 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:57.212092 31468 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:57.190177   529 consensus_queue.cc:1059] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.190652   674 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.191519   676 raft_consensus.cc:3055] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.152709   593 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.198513   667 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.215576 31388 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:57.219492 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 56973.8us
I20260709 12:23:57.224258 32050 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.194114   594 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.217043   676 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.233537   676 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.235775 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:57.241356 32075 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:57.227103   667 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:57.242897   667 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.251150 31394 raft_consensus.cc:3055] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:57.251565 31394 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.252346 31394 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.253268 31394 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.251174 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:57.234951   676 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.255419 31539 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:57.193254 31461 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:23:57.258404 32050 leader_election.cc:400] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4.
I20260709 12:23:57.263446 32050 leader_election.cc:403] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:23:57.258796   417 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.262501 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:57.265132 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 86648.3us
I20260709 12:23:57.267740 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:57.215777   623 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.281404 31394 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:57.287108   595 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4.
I20260709 12:23:57.289047 31510 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:57.291579 31510 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:57.295433 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:57.313405 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 55144.8us
I20260709 12:23:57.314821   653 consensus_queue.cc:1059] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:57.314941 32050 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.317166   552 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.316658 32050 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:57.324927 31510 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:57.297425 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:57.292577   594 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:23:57.293725   529 consensus_queue.cc:1059] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:23:57.325156   381 raft_consensus.cc:3055] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:57.336760 32083 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.325431   582 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:57.317698   552 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:57.319416   681 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:57.332963   417 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.342954 31539 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.339150   595 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:23:57.337671 32078 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.351424   582 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.351562   659 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.352408   659 raft_consensus.cc:697] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.352393   582 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.353554   659 consensus_queue.cc:237] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.355450 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:57.356283 32079 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 2: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:23:57.342092   653 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.358441   653 raft_consensus.cc:697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:57.339386   381 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:57.372141 32082 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.367165 32083 pending_rounds.cc:85] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Aborting all ops after (but not including) 4
I20260709 12:23:57.350083   568 raft_consensus.cc:3055] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:57.378579 32083 pending_rounds.cc:107] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:23:57.380621 32083 raft_consensus.cc:2889] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:57.342490   552 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.379372 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:57.349362   681 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:57.375669 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:57.401700 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:57.409332   371 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.411144   371 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.430718 32082 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:57.432842 32075 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:23:57.434852 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.435904 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.439703 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:57.444912 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:23:57.447340 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.455989 31436 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:57.380198   568 raft_consensus.cc:740] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:23:57.466378 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 203943us
I20260709 12:23:57.476318 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.481056   371 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.481631   371 raft_consensus.cc:697] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:57.482182   542 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.482587   371 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:23:57.483855   683 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:23:57.485425 32078 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:23:57.486591   682 log.cc:927] Time spent T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:23:57.488978 32710 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.489643 32710 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.366321   667 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.394583   681 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.500484 31436 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:23:57.503630 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 178750us
I20260709 12:23:57.513366 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.506108   393 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:23:57.515030 31463 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:57.518999 31544 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.520491 31539 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:57.509565   675 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.526196   656 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.509927   659 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:23:57.529613   693 raft_consensus.cc:3055] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.529978   693 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.530805   693 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.531388   589 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:23:57.531729 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.532053   693 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.532006   589 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.534579 32710 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.535111   403 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:57.535794 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.537139 31434 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.538584   663 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.539405   440 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.540187   397 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:57.541533   505 raft_consensus.cc:3055] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.541953   505 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.542546   592 raft_consensus.cc:3055] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:57.542903   505 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.544261   505 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.546356   645 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.517558   668 consensus_queue.cc:1059] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:23:57.525939   373 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.510190   582 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:23:57.512647   301 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:57.513250   573 consensus_queue.cc:1059] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:23:57.551604   667 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:57.558377   373 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.517732   636 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:23:57.518173   381 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.512480   625 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.510560   540 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.535807   403 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.563191   645 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:57.563587 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.564570   403 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:57.565294   689 raft_consensus.cc:3055] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:57.565733   689 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.566646   689 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.567947   689 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.567696   625 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:57.568308 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.508525   653 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.557524 31434 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.517644 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:57.509239   664 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:23:57.561678 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 48416.8us
I20260709 12:23:57.577945 31361 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:23:57.575176 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.576603 31434 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.561115   301 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.580466   677 raft_consensus.cc:3055] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.580809   677 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.581609   677 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.582096   301 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.582567   677 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.582779   568 consensus_queue.cc:260] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.583549 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:57.583971   568 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.584312 32078 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:57.585914   373 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.543012   592 raft_consensus.cc:740] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.526125   623 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:23:57.579598   381 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.606058 31434 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.511819 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:57.594502   650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.006s	sys 0.032s
I20260709 12:23:57.588630   403 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.569804   625 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.621210 31434 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.619835 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.624670   371 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.625272   675 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:57.626672 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 114952us
I20260709 12:23:57.627393 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:57.627746 31434 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.628911   625 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.630172 31434 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.631206   625 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.632566 31434 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.633486   627 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.634799 31434 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.635895   627 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.636927   652 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:57.606269   301 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.641360   552 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.645058   667 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.645466   667 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.645817   592 consensus_queue.cc:260] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.647218   592 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.649946   540 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:57.624439   650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.006s	sys 0.035s
I20260709 12:23:57.650331 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.651532 31434 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.622895   668 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:23:57.653949 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 74784.4us
I20260709 12:23:57.607954   681 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.654032 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:57.655157 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.655000 31434 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:57.657047 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.645818   667 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:57.657542 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.658272 31361 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.658972 31434 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.660540 31434 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.648351   652 raft_consensus.cc:697] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.662122   627 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.657735 32764 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.655830   668 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.664037   674 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.667009   589 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.669693 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.670099 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:57.652948   463 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:23:57.696882   668 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.655095   675 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.660838   301 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.690691 31470 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.708576 32764 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.708849 31461 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.709854 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:57.709774 32764 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.712278 31539 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.691603 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.704489 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.705361 31542 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:57.670415 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.714627 31390 raft_consensus.cc:2393] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 2: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:57.716756 31463 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.691385   529 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.653173   371 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.712225 31540 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:23:57.701056 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.723912   702 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:23:57.692516   676 consensus_queue.cc:1059] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:23:57.704818   636 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.731035   676 raft_consensus.cc:3055] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.731448   676 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.732239   676 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.733374   676 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.733554   573 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.734345   573 consensus_queue.cc:1059] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.731078   440 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.735889   573 raft_consensus.cc:3055] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.726544 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:57.736326   573 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.736822 31387 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:57.726745   455 consensus_queue.cc:1059] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:23:57.738005   582 raft_consensus.cc:3055] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.737542   573 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.724093 31386 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:57.739391   693 raft_consensus.cc:3055] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:57.739568 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.739878   573 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.738461   582 raft_consensus.cc:740] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:23:57.745489 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 53975.9us
I20260709 12:23:57.747929 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.697147   393 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:23:57.728530   371 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.786278 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:57.780700 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.798305 31539 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:57.801860 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 55220us
I20260709 12:23:57.802922 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.800952 31359 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:57.751933   693 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.753010   529 raft_consensus.cc:697] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:57.814285   542 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.804554   593 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:57.804994   656 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.751859   540 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:23:57.827531   542 raft_consensus.cc:697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.813741   652 consensus_queue.cc:237] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.817580   654 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.811405 32710 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:23:57.847178   417 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.858857   570 consensus_queue.cc:1059] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.860692   587 raft_consensus.cc:3055] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:57.861129   587 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.836959   552 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.838819 31463 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
W20260709 12:23:57.839669   696 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:23:57.878981 31393 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:57.831332   706 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:57.899869 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 87303us
I20260709 12:23:57.852897 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.853802   693 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.870196   645 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.871949 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1370) took 1190 ms. Trace:
I20260709 12:23:57.863386 31461 raft_consensus.cc:1240] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.875777   681 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:57.876184   667 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.876973 31470 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:57.878991 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:57.841249 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:57.851835   403 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.851920   593 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:57.906584 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:57.817339   644 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:57.852130   654 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:57.911458 31466 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:57.913904 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 61107.1us
I20260709 12:23:57.914660 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:23:57.916540 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 75363.2us
I20260709 12:23:57.842531   582 consensus_queue.cc:260] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.911543   650 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:57.922834 32764 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:57.909993 31386 rpcz_store.cc:276] 0709 12:23:56.681796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.685922 (+  4126us) service_pool.cc:224] Handling call
0709 12:23:57.871745 (+1185823us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540033d1d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:23:57.871876 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2357436800}
I20260709 12:23:57.915510 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:57.925613 32710 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.937958   582 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.939560 32077 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:57.913187   706 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.915880   654 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.918643   568 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.947327 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.879196   417 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.949163 31466 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:23:57.950906 31464 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:57.929801   650 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.918725   593 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:57.958998   716 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:23:57.960235   371 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.961002   417 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:57.948658   542 consensus_queue.cc:237] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.931931   529 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:23:57.963640 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:57.963989 31507 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:57.948028   711 consensus_queue.cc:1059] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:23:57.968232 31535 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:23:57.968557 31542 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.969085   667 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:57.970543 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:57.981259 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:57.981943 32078 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.982124   582 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.980456 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:57.984902   644 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.956426   625 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:57.986799   636 raft_consensus.cc:3055] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:57.987033 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:57.987833 32077 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:57.976176   650 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:57.990594   650 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.951221   592 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:23:58.002624 31466 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.979758 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:57.987284   636 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:57.978206   706 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:58.002923 31510 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:58.003713 31464 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:58.004652 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:58.007669   676 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:58.008189   676 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:58.009061   676 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:58.014047 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.014979 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:58.019922 31468 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:58.021087 32075 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:58.022413 32081 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:58.025880 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:58.022652   706 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:58.028385   706 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:58.035653 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.037232 31462 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:23:58.028791   706 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.038904 31361 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:58.017454 32764 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:58.040508 31466 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:58.039400   593 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:58.016551   506 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:23:58.016281   711 consensus_queue.cc:1243] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:23:58.005417   582 consensus_queue.cc:1059] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:23:58.043131 32050 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:58.050750 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:58.051044 31388 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:58.052569 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:23:58.041888 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 77990.9us
I20260709 12:23:58.060491 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:58.038403   573 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:58.061815   417 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:58.062359   417 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:58.063325   417 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.065382   573 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:23:58.066243 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.066311   573 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.041320   542 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.045936 32764 raft_consensus.cc:697] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:58.054180 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:58.090858 32764 consensus_queue.cc:237] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.094368   506 raft_consensus.cc:3055] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:58.094794   506 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:58.094920 32083 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:58.095722   506 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.096966   506 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.097409 31507 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:58.098492 31507 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:58.109368 31507 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:58.077781   582 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.044863   717 consensus_queue.cc:1059] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:23:58.120462 31507 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:23:58.124307 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.115906   711 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.139809   711 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.141966   711 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:58.142547   706 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.143879   395 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.147993 31507 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:58.110028 31461 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
W20260709 12:23:58.148361 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.153867   395 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.155813 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:58.102567   667 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.122203   568 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:58.166698 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.102438   676 raft_consensus.cc:2764] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:58.067677   636 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.149024   681 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:58.108868   542 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:23:58.139000   668 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.111518   675 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:23:58.198468   720 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:23:58.190761   706 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:58.199541   668 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:58.191053 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:58.200985   395 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:58.201076 31507 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:58.203044   706 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.203549   706 raft_consensus.cc:697] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:58.204393   706 consensus_queue.cc:237] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.208137 31507 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:23:58.190217   721 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 12:23:58.192198   718 log.cc:927] Time spent T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:23:58.188141   529 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:58.227895 31507 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:58.211186   681 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.227602 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:58.230336 31468 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:23:58.231600 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:58.208791 31535 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:58.235692   395 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:58.236114   395 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.236467   395 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.238255   636 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.232944   506 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.244272   395 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.245324 32078 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:58.247855 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:58.248443 31468 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.248998   582 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.256039 31468 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:23:58.257455 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:58.258267   658 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:58.258925   658 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:58.259613 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:58.259972   658 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.260628   582 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:58.259748 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44516.2us
I20260709 12:23:58.258205 31359 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:58.261734   582 raft_consensus.cc:697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:58.262583   582 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.263166 31507 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:23:58.263970   506 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.264446   542 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:58.264838   542 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.265235   542 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.269644   395 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:58.270350 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:23:58.211470   668 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:58.285187 31361 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:23:58.281879   506 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.294112 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:58.294600 31470 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:58.295954   540 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:58.296365   540 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.296700   540 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.297101   373 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:58.293023 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:58.299216 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:58.299623 32079 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:23:58.299419   667 consensus_queue.cc:1059] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.300094   592 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.304450 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:58.305131 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:58.305809 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:58.305156 31390 raft_consensus.cc:2376] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3. Re-sending same reply.
I20260709 12:23:58.306334 31463 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.308131 31390 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:58.311828 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:58.312157 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:58.312862 31394 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:58.316148 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:58.316808 31390 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:23:58.314070 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:58.319880 31462 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:58.320523 31434 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:58.320696 31466 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:58.322778 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:58.323318 31390 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.158195 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:58.325038 32047 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:58.324294 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:23:58.300627   592 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.333575   658 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:58.338410 31463 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:58.339407 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:23:58.340176 31462 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:23:58.340801 31394 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:23:58.318794   568 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.341122 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:58.343251   689 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.300968   373 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.342984 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:58.332535   659 consensus_queue.cc:1059] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:23:58.328992   463 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:23:58.318120   595 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:23:58.331463   505 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:58.332293   623 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.582566 31390 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:23:58.341986   506 raft_consensus.cc:3055] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:23:58.591503 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 279949us
I20260709 12:23:58.596138 31538 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:58.597677 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:23:58.587273 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 251495us
I20260709 12:23:58.595890 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:58.596855 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:58.611976 31543 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:23:58.581089   654 consensus_meta.cc:287] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.006s
W20260709 12:23:58.616331 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 282200us
I20260709 12:23:58.581295   667 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:58.622340 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:58.581380   568 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:58.579640   301 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:58.636108   659 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:58.587698 31461 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.599663   506 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:58.402932   675 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.271s
I20260709 12:23:58.587845 31468 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:23:58.652186 31462 raft_consensus.cc:1275] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:58.588084   505 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.669869 31543 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:23:58.673921 31543 pending_rounds.cc:85] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 4
I20260709 12:23:58.674221 31543 pending_rounds.cc:107] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:23:58.674468 31543 raft_consensus.cc:2889] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:58.625820   654 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.605163   623 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.648026   667 raft_consensus.cc:697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:23:58.666695   664 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.692361   623 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:58.694267   505 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:58.694847   727 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 12:23:58.673415   653 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.699213 31392 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:58.677796   659 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.703876   506 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.712170   659 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:58.698623   664 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.720186   667 consensus_queue.cc:237] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.698421   589 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:23:58.684815   568 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:58.789420   728 log.cc:927] Time spent T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:23:58.699170   542 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.792142   542 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:58.792400   654 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:58.705603   653 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.795414   653 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:58.781679   693 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.783340   664 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:58.783504   732 log.cc:927] Time spent T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:23:58.786216   636 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 12:23:58.786852   676 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.780383   373 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:58.774323   738 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:23:58.816977   659 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.839684   659 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.841862   659 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:23:58.836508   540 consensus_meta.cc:287] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.007s
I20260709 12:23:58.844050   540 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.845057 31393 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:58.846057   540 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:58.848318 31387 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:58.816943   676 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.853698   676 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:58.868049 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:58.869012 32077 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:58.870350   587 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.878439 31461 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:58.881556 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:58.883149 32764 raft_consensus.cc:3055] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:58.899611 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.803361 31389 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:23:58.907323   653 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:58.895676 32764 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:58.907989   653 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.908492 32764 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.909565 32764 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.910358   653 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:58.916488 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:58.898988   693 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:58.925832   677 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.915009   676 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:58.922607   693 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.929646 31290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38064 (request call id 248) took 10166 ms. Trace:
I20260709 12:23:58.927525 31291 catalog_manager.cc:5697] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.930970   693 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.927845   677 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.940169 31291 catalog_manager.cc:5697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:58.941725 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.930823   676 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.930110 31290 rpcz_store.cc:276] 0709 12:23:48.754851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.770092 (+ 15241us) service_pool.cc:224] Handling call
0709 12:23:58.921413 (+10151321us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:57.316217 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:57.317105 (+   888us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:57.317177 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:23:57.317205 (+    28us) tablet.cc:662] Decoding operations
0709 12:23:57.347390 (+ 30185us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:57.347533 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:57.347576 (+    43us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:23:57.348777 (+  1201us) tablet.cc:701] Row locks acquired
0709 12:23:57.367991 (+ 19214us) write_op.cc:260] PREPARE: finished
0709 12:23:57.394795 (+ 26804us) write_op.cc:270] Start()
0709 12:23:57.462983 (+ 68188us) write_op.cc:276] Timestamp: P: 1783599837380103 usec, L: 0
0709 12:23:57.463023 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:23:57.463969 (+   946us) log.cc:844] Serialized 4059 byte log entry
0709 12:23:57.862612 (+398643us) op_driver.cc:464] REPLICATION: finished
0709 12:23:57.969441 (+106829us) write_op.cc:301] APPLY: starting
0709 12:23:57.969572 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:57.978005 (+  8433us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:57.978136 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:57.981607 (+  3471us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:57.981859 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:23:57.981910 (+    51us) write_op.cc:312] APPLY: finished
0709 12:23:57.982188 (+   278us) log.cc:844] Serialized 77 byte log entry
0709 12:23:58.003935 (+ 21747us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:58.007738 (+  3803us) write_op.cc:454] Released schema lock
0709 12:23:58.007787 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:58.008180 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:58.008219 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56543,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":106527,"apply.run_cpu_time_us":3834,"apply.run_wall_time_us":38733,"num_ops":10,"prepare.queue_time_us":148946,"prepare.run_cpu_time_us":6339,"prepare.run_wall_time_us":177810,"replication_time_us":380458,"thread_start_us":135390,"threads_started":2}]]}
I20260709 12:23:58.939299   689 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:23:58.961395 31510 consensus_peers.cc:597] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab7bbda785db43a8a40b2bbd07b0c97a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.963687 31291 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 2 to 3, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.958791   681 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.970077 31291 catalog_manager.cc:5697] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 2 to 3, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.974228 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:58.978447 31395 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.978335 31291 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 2 to 3, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.981415   654 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.981876   654 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.983863   654 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:58.984038   739 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.984887 32077 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:58.984706   739 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.985610   689 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:58.983981   741 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:58.986963   739 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:58.963661   659 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:58.988835 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 365493us
I20260709 12:23:58.987556   542 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.992208 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:58.994241 31434 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:58.993688 31395 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:58.995921 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:58.996258 32047 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:59.002398 31540 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:59.004478 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:58.999994   542 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:58.987591   676 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:58.989106   717 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:59.014645 31540 raft_consensus.cc:1217] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 12:23:59.015182 31540 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:59.018340 31540 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.975780   681 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.023416   735 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.024394   733 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.024876   733 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.026525 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:59.027067   744 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.027304   676 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.027846   676 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.029831   676 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:59.027104   733 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:23:59.032193   737 log.cc:927] Time spent T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:23:59.032336 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:59.033195 31544 raft_consensus.cc:2410] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:59.033690 31543 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:59.033963 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:23:59.035331   744 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.000095   371 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.036533 31434 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:59.039336 31434 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:23:58.996958   654 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.040995 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.041630 31388 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
W20260709 12:23:59.037349   663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.003s	sys 0.018s
I20260709 12:23:59.045053 31388 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:59.046933 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.047700 31395 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:59.048180 31464 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:59.049263 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.001513   659 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.044448 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:59.055564 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:58.992231   741 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.059406   741 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:59.049212   733 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:23:59.016229   381 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:23:59.047379   663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.004s	sys 0.018s
I20260709 12:23:59.062558 31543 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:23:59.040989   393 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.067884 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.068559 31388 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:59.043660   731 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.071328 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:59.076948 31540 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.081012 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:59.045099   654 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.083786 31464 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:59.081634 31539 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:23:59.086789 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:59.060657   733 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.090754 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.094620 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:23:59.095816 31540 raft_consensus.cc:2410] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:59.075941   677 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:59.022419   717 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.097787 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.100239 31464 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:23:59.044867   744 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:23:59.101291 31544 raft_consensus.cc:606] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:59.130939 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:23:59.131331 31544 raft_consensus.cc:614] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:59.098822 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.086336   653 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:59.077641   373 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:23:59.144088 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.144810 31390 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:23:59.131783 31542 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.133111 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:59.146400 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44112.9us
I20260709 12:23:59.150175 31464 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:23:59.174115 31433 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:59.183643   542 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.192062   743 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.198205 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.200913   668 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:59.202616   676 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:59.229137 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:59.229981 31464 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.144112   748 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:23:59.171775 32077 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:59.190510   301 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.146111   653 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.233951 31392 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:59.273123 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:23:59.283179 31463 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.238543 31469 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.206779   752 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:23:59.279312 31466 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:59.227144   381 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.233873   681 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:59.278167   677 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.238657   301 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.292127 31465 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:59.170418   745 consensus_queue.cc:1059] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.138s
I20260709 12:23:59.309171 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.310768 31466 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:59.304677 31463 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:59.316573   745 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.317193   745 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.319720   734 raft_consensus.cc:3055] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:59.320215   734 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:23:59.321182   734 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.322744   734 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.336638   373 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.337409   373 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.315439 31465 raft_consensus.cc:1217] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 12:23:59.349251 31465 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:59.369434   644 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:59.370244   644 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.373519   644 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:59.396749   373 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.405277 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.406157 31392 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:23:59.407927   745 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.444737   573 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.445590   573 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.448817   573 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.456044   745 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.456826   745 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.460594 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.461333 31392 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
W20260709 12:23:59.583670   737 log.cc:927] Time spent T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.298s	user 0.000s	sys 0.000s
I20260709 12:23:59.585647   733 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.586709 31465 raft_consensus.cc:1275] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:59.590287   729 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:59.463150   745 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.591487   744 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.591729   745 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.293736   659 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:59.592223   744 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.309226   301 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.642508 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.645411 31466 raft_consensus.cc:2393] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:23:59.653486 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:59.612433 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.316040   664 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.657948 31465 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:23:59.592175   753 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.309s	user 0.000s	sys 0.000s
I20260709 12:23:59.235194   743 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.295478   381 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.314697   677 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.680667 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.306195 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.313933   693 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.681478 31465 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:59.691077 31361 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:59.691243 31388 raft_consensus.cc:1275] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.696147 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.698642 31510 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:23:59.592767   745 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:23:59.781325 31464 consensus_meta.cc:287] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.018s
I20260709 12:23:59.784520 31464 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:23:59.783512 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.782738 31461 raft_consensus.cc:2393] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:23:59.676797   752 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:23:59.666646   664 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.790141 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.833995 31466 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:23:59.701635   540 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
W20260709 12:23:59.818532 32050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.007s	sys 0.024s
I20260709 12:23:59.691007   717 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:59.789237   711 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:59.690637   681 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:59.643210   761 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
W20260709 12:23:59.864641 31542 consensus_meta.cc:287] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.000s
I20260709 12:23:59.865252 31542 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
W20260709 12:23:59.837776 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 146761us
I20260709 12:23:59.690649   748 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 12:23:59.831781   659 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.828964 31465 raft_consensus.cc:2410] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:59.844638 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:23:59.841615   753 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:59.701717   568 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:23:59.850821 32075 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:59.853283   675 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.853343 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:59.702215   440 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
W20260709 12:23:59.903347 31390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.012s	sys 0.026s
W20260709 12:23:59.903776 31390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.012s	sys 0.026s
I20260709 12:23:59.870664   711 raft_consensus.cc:697] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:23:59.866436 31361 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:23:59.872727 31463 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:59.701208   455 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 12:23:59.874246 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.873265   560 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:23:59.882424   743 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.883589   677 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:23:59.884253   653 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.877259 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:59.876562 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:59.872891   659 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.933461 32082 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:23:59.840247   752 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.849489   717 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:23:59.902182   393 consensus_meta.cc:287] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.834s	user 0.007s	sys 0.004s
I20260709 12:23:59.930289 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1383) took 1584 ms. Trace:
I20260709 12:23:59.954299 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:23:59.955075 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.866708   681 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.934222 31466 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:59.928598 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.917896 32080 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:59.836946 32050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.014s	sys 0.024s
I20260709 12:23:59.918517   775 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:59.900381   777 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.929399   764 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:23:59.935076   773 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.904348   747 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:59.932816 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.953889   677 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:59.966677 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.901962   675 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.958591 32080 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:23:59.935259   659 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:59.964323 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 748432us
I20260709 12:23:59.906220 32078 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:59.955868   676 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.967341 31463 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:23:59.956897   393 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.975765 32050 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:23:59.957194   743 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:23:59.955487   540 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:59.979948 32050 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:23:59.956579   734 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:23:59.917948   301 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.928175   751 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.287s
I20260709 12:23:59.977146 32080 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.991752 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:23:59.996524 31464 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:23:59.962399   775 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.999171 32081 raft_consensus.cc:2410] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:23:59.954891   717 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.982545   653 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:59.971908   780 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:00.006148 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 139783us
I20260709 12:23:59.978302   689 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:00.011024   750 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:00.019374 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.002259 31461 raft_consensus.cc:2393] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:00.021929 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:23:59.999752   765 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.992652   693 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.034503 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:00.032213 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.032331 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:23:59.977016   677 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.005860   653 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.008085   689 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.986552   676 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.973896   773 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.045862   791 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.046898   791 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.048478   794 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.992379   743 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:23:59.997923   540 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.032914   765 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.000134   734 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.052531 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.063623 31464 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:00.011708   750 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.054538   791 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.056632 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 139) took 1019 ms. Trace:
I20260709 12:24:00.070015 31543 rpcz_store.cc:276] 0709 12:23:59.037351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.037462 (+   111us) service_pool.cc:224] Handling call
0709 12:24:00.056480 (+1019018us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b540021e154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:00.056577 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21255936}
I20260709 12:24:00.041676   653 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.055186   767 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:00.060137   681 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.051776   745 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.043299   689 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.071661   767 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.061904   752 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:23:59.992151   711 consensus_queue.cc:237] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.971376   777 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.078649   653 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.079432   689 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.081101   653 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:00.081377   689 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:23:59.967120   747 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:23:59.953684 31535 rpcz_store.cc:276] 0709 12:23:58.346010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.587587 (+241577us) service_pool.cc:224] Handling call
0709 12:23:58.643200 (+ 55613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.681481 (+ 38281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.684415 (+  2934us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:58.696344 (+ 11929us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.086520 (+390176us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:59.170138 (+ 83618us) log.cc:844] Serialized 14 byte log entry
0709 12:23:59.181247 (+ 11109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.191080 (+  9833us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.929986 (+738906us) raft_consensus.cc:1685] finished
0709 12:23:59.930013 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.930211 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85678,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":81,"raft.queue_time_us":13791,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":17566,"thread_start_us":398539,"threads_started":2,"wal-append.queue_time_us":478778}
I20260709 12:24:00.083776 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:00.092316 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:00.062736   765 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.094691 31464 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:00.087888   675 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.088192   540 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.062906   751 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:00.085743 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.098357 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:00.096047 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.088737   744 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.099103 31466 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:00.096177   717 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.099633 31392 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:00.068099   780 raft_consensus.cc:697] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:00.093400   784 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.115653 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:00.116681 31464 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.103381 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.067698   794 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.118822 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.120288 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:00.133982 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.097537 32710 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:00.102919   717 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.135187 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.136612 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:00.101966   540 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.139859 31466 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:00.114874 31461 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:24:00.115063   775 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.122053 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:00.134181   780 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.138818 32710 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:00.214304 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.158915 32710 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.333870 31464 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:00.142097   717 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.155929   747 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:00.357435 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:00.366591 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.366595 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1415) took 2030 ms. Trace:
I20260709 12:24:00.367221 31393 rpcz_store.cc:276] 0709 12:23:58.302937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.303135 (+   198us) service_pool.cc:224] Handling call
0709 12:23:58.303436 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.845431 (+541995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.333265 (+1487834us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b5400093dd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:00.333528 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245213056}
I20260709 12:24:00.200886   676 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:00.372887   734 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.281133   775 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:00.102237   751 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.332022   677 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:00.367337   739 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:00.374759   750 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:00.377180 31387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1413) took 2073 ms (client timeout 1802 ms). Trace:
I20260709 12:24:00.119158   784 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:00.395859   742 log.cc:927] Time spent T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:24:00.382225   743 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.385938   739 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.408016   659 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.410249   659 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:00.411795 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 176) took 1274 ms. Trace:
I20260709 12:24:00.412063   739 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:00.412328 31462 rpcz_store.cc:276] 0709 12:23:59.137515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.138605 (+  1090us) service_pool.cc:224] Handling call
0709 12:24:00.410863 (+1272258us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:00.411112 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.411363 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.411400 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:00.411467 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:00.411511 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.411586 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.411723 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13695232}
I20260709 12:24:00.417330 31359 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:00.378882   775 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:00.418015 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.428208   800 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:00.430505 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.432407   659 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:00.434729   659 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.435856   743 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.436427   743 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.438071   659 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.438575   743 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.441494   592 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.429728   706 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.442397   706 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.443729 31535 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:00.444621   706 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:00.426076   689 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:00.445385   689 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.446125 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.426213   587 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.429122   681 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:00.449288 31542 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:00.427281   739 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.451912 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:00.391587 31387 rpcz_store.cc:269] 0709 12:23:58.298528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.298926 (+   398us) service_pool.cc:224] Handling call
0709 12:24:00.337813 (+2038887us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540028d554. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:00.371447 (+ 33634us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189080960}
I20260709 12:24:00.455713   775 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:00.457911 31389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1414) took 2155 ms (client timeout 1882 ms). Trace:
W20260709 12:24:00.458415 31389 rpcz_store.cc:269] 0709 12:23:58.302149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.302274 (+   125us) service_pool.cc:224] Handling call
0709 12:24:00.457706 (+2155432us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b54001a22d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:00.457809 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120296704}
I20260709 12:24:00.459712   654 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.453356   681 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.459944 31395 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:00.460603 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:00.461771   681 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.463003   794 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.464985 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35368 (request call id 9) took 1433 ms. Trace:
I20260709 12:24:00.465464 31544 rpcz_store.cc:276] 0709 12:23:59.031517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.033835 (+  2318us) service_pool.cc:224] Handling call
0709 12:24:00.464724 (+1430889us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54001450d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912b6853 00007f6e9628460a 00007f6e8f80a7d4 00007f6e8f80a762 00007f6e8f80a691 00007f6e8f80a60c 00007f6e8f8098c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:00.464880 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153479552}
I20260709 12:24:00.466472   506 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.456557 31542 raft_consensus.cc:2368] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4.
W20260709 12:24:00.471233 31386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1417) took 2425 ms (client timeout 2044 ms). Trace:
I20260709 12:24:00.471524 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.472018 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:00.468523   381 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:00.471663 31386 rpcz_store.cc:269] 0709 12:23:58.045461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.050384 (+  4923us) service_pool.cc:224] Handling call
0709 12:24:00.471045 (+2420661us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54002d05d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:00.471160 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303634816}
I20260709 12:24:00.475296   786 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:00.484782 31542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74b96090004c463795628c0134d8ecac"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:00.485770 31542 raft_consensus.cc:606] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:00.486197 31542 raft_consensus.cc:614] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:00.491824   689 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.492427   786 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.454087   739 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:00.540508 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 59253.4us
I20260709 12:24:00.514410   681 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.557528 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.542184 32048 leader_election.cc:400] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4.
I20260709 12:24:00.559290 32048 leader_election.cc:403] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:00.558609 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.489113   573 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:00.560858 31544 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:24:00.542968   676 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.549872   706 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.526620   717 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.566394 31543 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:00.563560 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:00.579496 32048 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:00.578447 31507 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:00.591595 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.592510 31544 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:24:00.597450 31507 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:00.565613   785 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.562750   592 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:00.604734   784 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.560323   765 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.601580   552 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:00.598793 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.648001 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.543108   677 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.577872   773 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.560052 32710 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.600116   668 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:00.573985   573 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.784518 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:00.603402   689 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:00.602250   540 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:00.575023   676 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.607863   775 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:00.563632   681 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.577744   706 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:00.835216 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.613020   529 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:00.773172   736 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:00.723624   552 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.787607   689 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:00.789938 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:00.788002 31434 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.020s	sys 0.017s
I20260709 12:24:00.834841 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.600176   568 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.183s
I20260709 12:24:00.852007 31542 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:00.853041 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.854333 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:00.781240   668 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.608995 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1387) took 2031 ms. Trace:
I20260709 12:24:00.840692 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:00.841545 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:00.759960   592 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.849296 31540 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:00.827346 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:00.851389 31544 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:00.886914 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:00.887634 31544 raft_consensus.cc:606] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:00.773372 31536 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:24:00.897516 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:00.898083 31464 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.850217   552 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.866686 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:00.872469 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:00.876624   786 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:00.774741   677 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:00.906782 32048 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:00.856899   689 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.861250   668 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:00.931051   803 log.cc:927] Time spent T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:00.848019   736 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.932754 31542 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
W20260709 12:24:00.919590 31434 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.020s	sys 0.017s
I20260709 12:24:00.915663   463 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.856359   751 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.838622   775 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.931819   778 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:00.925143 31468 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:00.936618   506 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:00.973605   506 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:00.951491 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 814781us
I20260709 12:24:00.954452   542 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.933681   659 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.950342 31464 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:00.995290 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:00.964327   778 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:00.990502 31434 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:01.005445 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:00.977651   587 consensus_meta.cc:287] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 12:24:00.960009   463 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:01.006548 31359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.821s (SENT) [suppressed 18 similar messages]
I20260709 12:24:00.970290   706 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:00.972107 31468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1323) took 1743 ms (client timeout 1713 ms). Trace:
I20260709 12:24:00.991516   769 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.005677   778 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.007490   773 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:01.032196 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 177) took 1009 ms. Trace:
I20260709 12:24:01.049470 31462 rpcz_store.cc:276] 0709 12:24:00.022785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.424816 (+402031us) service_pool.cc:224] Handling call
0709 12:24:00.425238 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.425696 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.433358 (+  7662us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.439272 (+  5914us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.852270 (+412998us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:00.852322 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.852382 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.031944 (+179562us) raft_consensus.cc:1685] finished
0709 12:24:01.031971 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.032130 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":579,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5756,"thread_start_us":412378,"threads_started":1,"wal-append.queue_time_us":519171}
I20260709 12:24:01.051643 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.053423 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.007095   765 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.039492   681 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:01.040681   736 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.041622   676 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.043334   775 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.045590   463 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:00.996568   542 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.028052   784 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:01.025717   373 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.996563   659 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.057365 31462 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:01.036558   592 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.054126   506 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:01.061940 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 449395us
I20260709 12:24:01.062165 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:01.054486   751 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.067214 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.067472 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.065616 31464 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.073563 31434 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.055312   769 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.079775 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.080071 31510 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:01.027680 31468 rpcz_store.cc:269] 0709 12:23:59.226543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.234560 (+  8017us) service_pool.cc:224] Handling call
0709 12:24:00.460468 (+1225908us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197eee 000000000036eb39 00007f6e9620b1e0 00007f6e962d40c4 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:00.970228 (+509760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28351872}
W20260709 12:24:01.070608 31461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.013s	sys 0.062s
I20260709 12:24:01.056643   773 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.098624 31510 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:01.078917   798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.012s	sys 0.012s
I20260709 12:24:01.064626   373 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.071794   592 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:01.078359   676 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:01.077734 32079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 376) took 2107 ms. Trace:
I20260709 12:24:01.097886   681 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.098491   568 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:01.164393 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.164665   568 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:01.165041 32078 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:01.165175   568 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.166087 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.166715 32078 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
W20260709 12:24:01.100282 31461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.013s	sys 0.062s
I20260709 12:24:01.080148   506 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:01.070828   751 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.147074   529 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:01.147449   769 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:01.148245 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.190485 31510 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.148867   542 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.141103   706 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.143203   463 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.150839 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1336) took 1053 ms. Trace:
I20260709 12:24:01.151286   676 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.145905   403 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.153235   773 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:01.143889   798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.012s	sys 0.018s
I20260709 12:24:01.153870   552 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:00.862720 31537 rpcz_store.cc:276] 0709 12:23:58.573107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.578471 (+  5364us) service_pool.cc:224] Handling call
0709 12:24:00.368727 (+1790256us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197eee 000000000036eb39 00007f6e9620b1e0 00007f6e962d40c4 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:00.375115 (+  6388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.381442 (+  6327us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:00.386851 (+  5409us) log.cc:844] Serialized 14 byte log entry
0709 12:24:00.559483 (+172632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:00.566415 (+  6932us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:00.574134 (+  7719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.577797 (+  3663us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.604111 (+ 26314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1246,"prepare.queue_time_us":3608,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":18579,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9137,"spinlock_wait_cycles":12352768,"thread_start_us":156263,"threads_started":1,"wal-append.queue_time_us":442408}
I20260709 12:24:01.155037 31391 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:01.158476   689 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.202266 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.220000 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:01.227684 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.228909 31535 raft_consensus.cc:2410] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:01.229926 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.230834 31535 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:01.233631 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:01.238263   804 log.cc:927] Time spent T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.407s	user 0.000s	sys 0.005s
I20260709 12:24:01.196834   706 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.243419 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.297659 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.253988 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.299052 32082 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:01.260313 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1425) took 2209 ms. Trace:
I20260709 12:24:01.266863   777 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.268139 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1427) took 2193 ms. Trace:
I20260709 12:24:01.284132 31539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:01.302182 31539 raft_consensus.cc:606] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:01.188239   506 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:01.240737 32083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 381) took 1456 ms. Trace:
I20260709 12:24:01.235076 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.204897   403 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.197237 31465 rpcz_store.cc:276] 0709 12:24:00.097016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.581953 (+484937us) service_pool.cc:224] Handling call
0709 12:24:00.604885 (+ 22932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.605284 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.605337 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.605865 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.967712 (+361847us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:00.967770 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.967878 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.150618 (+182740us) raft_consensus.cc:1685] finished
0709 12:24:01.150643 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.150778 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1213,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":110,"thread_start_us":361008,"threads_started":1,"wal-append.queue_time_us":457107}
W20260709 12:24:01.305655 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 299128us
I20260709 12:24:01.289901 32048 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.301160 31388 rpcz_store.cc:276] 0709 12:23:59.076786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.077044 (+   258us) service_pool.cc:224] Handling call
0709 12:23:59.077350 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.691794 (+614444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.267855 (+1576061us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400231754. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:01.268065 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410995456}
I20260709 12:24:01.300061 31395 rpcz_store.cc:276] 0709 12:23:59.050887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.051016 (+   129us) service_pool.cc:224] Handling call
0709 12:24:00.459625 (+1408609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.460431 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.260034 (+799603us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001a22d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:01.260211 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3238759680}
I20260709 12:24:01.303273 32083 rpcz_store.cc:276] 0709 12:23:59.784162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.784326 (+   164us) service_pool.cc:224] Handling call
0709 12:24:01.239885 (+1455559us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:01.240117 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.240350 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.240387 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:01.240440 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:01.240482 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.240551 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.240671 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6511488}
I20260709 12:24:01.307477 31433 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:01.184098   681 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.319677 32084 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:01.325318 31433 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:01.334290 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.200598   529 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.308481   706 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.210057   463 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.312709   403 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.306794   506 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.296350 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.332988   589 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:01.350630 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 277082us
I20260709 12:24:01.344749   786 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.328155   796 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:01.332363   645 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:01.355842 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.336109   568 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:01.353451 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:01.371043 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 98406.3us
W20260709 12:24:01.380976 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 55741.6us
I20260709 12:24:01.374260 31434 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:01.345698 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.382019 31433 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:01.347666   817 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:01.350049 31464 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
W20260709 12:24:01.385372 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 194913us
I20260709 12:24:01.392959 31510 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.355610   769 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:01.352771   540 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:01.397266 31510 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.400331 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.401116 31464 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:01.403648 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.371130   589 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.378773   592 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.410221 31464 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:01.161990 32079 rpcz_store.cc:276] 0709 12:23:58.964525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.966091 (+  1566us) service_pool.cc:224] Handling call
0709 12:24:01.046756 (+2080665us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:01.047029 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.055819 (+  8790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.057065 (+  1246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:01.058261 (+  1196us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:01.060143 (+  1882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.063012 (+  2869us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.069846 (+  6834us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30225664}
I20260709 12:24:01.376339   796 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:01.420713   796 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.424319   689 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.424921   774 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:01.384101   645 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.428272   463 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:01.428972   681 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.429473   645 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:01.429911   681 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.430394   681 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.430840   681 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.438093 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.438936 31395 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:24:01.415175 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.415373 31464 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:01.374963 32764 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:24:01.444919 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.446022 31395 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:01.399786   784 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.389166   819 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:01.448738 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.398598 32078 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:24:01.398450   769 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.453114 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.462774 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:01.463699 31390 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.462906 31393 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:01.453874 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.465086 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.465617 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.456666 31465 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:01.456802 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:01.458020 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 61167.7us
I20260709 12:24:01.458526 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.467635 31395 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:01.451592 31389 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:01.468869 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.408453   589 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.379029   786 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.459455 31388 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:01.431696 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.461097 31394 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:01.412293   592 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:01.454703 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:01.455843   668 consensus_meta.cc:287] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.005s
I20260709 12:24:01.398778   817 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.430402   529 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.395895   568 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:24:01.409149   813 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:01.414319   822 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:01.457207   689 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:01.431048   676 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.414172   540 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.483528 32082 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:01.471011   769 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.571218 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1445) took 1634 ms. Trace:
I20260709 12:24:01.582824 31390 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:01.471745   664 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:01.579007 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 182143us
I20260709 12:24:01.580163 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:01.569229 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 166566us
I20260709 12:24:01.587854 31394 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:01.484014   592 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.590595 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.591162 31395 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:01.592065 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.567816 31386 raft_consensus.cc:1275] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:01.595588 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.471170   829 consensus_queue.cc:1059] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 12:24:01.570335   689 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:01.576123   813 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.596472 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:01.596794 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:01.597172   809 log.cc:927] Time spent T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 12:24:01.569612   552 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.600274 31393 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:01.510655   767 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.463828   819 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.510426 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:01.605926   816 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:24:01.605957 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.659838 31389 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:01.558617   751 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.661898   706 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.664024 32710 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.664858   659 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.666419 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:01.667030 31468 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.667284 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1418) took 3361 ms. Trace:
I20260709 12:24:01.667618 31391 rpcz_store.cc:276] 0709 12:23:58.305531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.305667 (+   136us) service_pool.cc:224] Handling call
0709 12:23:58.305920 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.215562 (+2909642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.667057 (+451495us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b540037c154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:01.667210 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6551566208}
I20260709 12:24:01.668694   540 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:01.668859 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.671814   706 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.593150   568 consensus_queue.cc:1243] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer 503bef451a2b424fa35e8e46b8c06f29 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:24:01.677212   820 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 12:24:01.677349   817 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.483660 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.460956   784 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.647547 31392 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:01.569939   636 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.807607   636 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.510416   542 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.649837 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.810474   739 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.810798 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.650243 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.582398   668 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:01.655786 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 59373us
I20260709 12:24:01.656016 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1372) took 1222 ms. Trace:
I20260709 12:24:01.655931 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:01.657629 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.680339   813 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:01.713454 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:01.716357   785 consensus_meta.cc:287] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.000s
I20260709 12:24:01.756201   796 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.840065   785 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4.
I20260709 12:24:01.840865 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.841401   796 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.743148 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.842097 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.842636 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.716318 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.732615 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.844511 31535 raft_consensus.cc:2410] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:01.845141 32084 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:01.845592 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:01.845898 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.846174 31535 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.732882 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.704810 32080 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.847572 31465 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:01.731560 31510 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.715605 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:01.703455 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 55615.9us
W20260709 12:24:01.812657 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 50031.5us
I20260709 12:24:01.686398 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.851143 31393 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:24:01.831629 31394 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.832155 31434 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:01.831419 31541 rpcz_store.cc:276] 0709 12:24:00.433180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.433347 (+   167us) service_pool.cc:224] Handling call
0709 12:24:00.433665 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.434034 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.434063 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.281568 (+847505us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b2c0001f138. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc5372 00007f6e912f7a01 00007f6e912bc43a 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2
0709 12:24:01.282104 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.396486 (+114382us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:01.396525 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.396590 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.655727 (+259137us) raft_consensus.cc:1685] finished
0709 12:24:01.655745 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.655960 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":601,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":12057984,"thread_start_us":113977,"threads_started":1,"wal-append.queue_time_us":285928}
I20260709 12:24:01.856761 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.712212   787 ts_tablet_manager.cc:933] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.713855 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.843075 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.835058 31464 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:01.858331 31544 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:01.858706 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.859383 31541 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:01.859787 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:01.860149 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.838775   784 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:01.743135   677 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:01.862773 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 131280us
I20260709 12:24:01.862890 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.863649 31465 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:01.749897   819 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.707657 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1403) took 1145 ms. Trace:
I20260709 12:24:01.733654 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.844635   668 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:01.847021 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.857924 31507 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:01.860657 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.655382 31469 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:01.860949 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:01.716037   301 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.738852 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.711836 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.864252 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.684096   587 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:01.711018   573 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:01.872136 31394 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:01.872586 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.607942   689 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:01.934835 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.935277 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.944818 31395 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
W20260709 12:24:01.935531 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 74656.5us
I20260709 12:24:01.833130   542 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.936157 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.920111 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:01.936947 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.864337   440 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:01.937856 31537 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:01.950001 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.938167 32710 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:01.938640 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 80794.7us
I20260709 12:24:01.952620 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.862605   570 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:01.939426 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 75277.8us
I20260709 12:24:01.747463   592 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.739737   506 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:01.753780   778 consensus_meta.cc:287] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.003s
I20260709 12:24:01.847781 31386 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:01.882514 31436 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:01.951098 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:01.953867 31395 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:01.972038 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 89644.4us
I20260709 12:24:01.859018   813 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:24:01.973037 31436 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:01.974663 31436 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:01.920382   659 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 12:24:01.876135 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:01.979092 31541 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:01.958112 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.858129   739 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 12:24:01.706979 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1334) took 1696 ms. Trace:
I20260709 12:24:01.965595 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:01.934178   681 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.967360 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.967837 31462 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:01.876255   817 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:01.968364 31507 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.941321   668 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:01.876133   568 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:24:01.943594   676 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:01.992636   676 raft_consensus.cc:697] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:01.984371 31461 rpcz_store.cc:276] 0709 12:24:00.010668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.161955 (+151287us) service_pool.cc:224] Handling call
0709 12:24:00.380415 (+218460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.393736 (+ 13321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.406698 (+ 12962us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.448629 (+ 41931us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.205950 (+757321us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:01.208838 (+  2888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.216795 (+  7957us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.656438 (+439643us) raft_consensus.cc:1685] finished
0709 12:24:01.681138 (+ 24700us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.706893 (+ 25755us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3256,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7777,"thread_start_us":643885,"threads_started":1,"wal-append.queue_time_us":858584}
I20260709 12:24:01.993566   676 consensus_queue.cc:237] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:01.993834 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:01.995380   825 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:01.995642 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.995908   825 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:01.996667 31386 raft_consensus.cc:2410] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:01.996608   825 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.997606 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.947664 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:01.963346   301 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.973022 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.975607   664 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:01.982390 31541 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:01.949182   774 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:01.985446 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:01.983511   829 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:01.988021 31543 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.974016 32076 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:01.989439   668 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:02.013433 31510 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:01.991357   440 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:02.000012 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 52407.2us
I20260709 12:24:02.014410 31510 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:01.945930   587 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:01.974216 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:02.003273 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:01.982426 31394 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:02.020255 31395 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:01.987211   706 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:01.976349   778 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.013669   668 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:01.988440   403 consensus_meta.cc:287] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 12:24:01.964210 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:01.988744 31507 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:01.976846 32077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 380) took 2271 ms (client timeout 1984 ms). Trace:
I20260709 12:24:01.989464   817 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.984745 31387 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:02.011950 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:02.015807 31361 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:02.021240 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:02.035653 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 46987.8us
I20260709 12:24:02.036120 31395 raft_consensus.cc:2376] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4. Re-sending same reply.
I20260709 12:24:02.036345 31507 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:02.036574 31361 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:02.036933 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.037524 31395 raft_consensus.cc:2376] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5. Re-sending same reply.
I20260709 12:24:02.038287 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.017081   739 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:01.969066   834 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:01.982090   833 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:24:02.025254 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.004909   570 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:02.012279 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.022233   659 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.040876 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.009745   301 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.072762 32047 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.014403   774 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.081257 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.041074   782 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:02.091423 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.067691   706 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.095980 32047 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.113370   706 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.113790   706 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.040982   540 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.114223   796 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:02.114351   540 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.114893   540 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.116672   681 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:02.078060   570 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.118269   570 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.079221   664 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:02.119532   664 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.121726   664 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:02.045104   744 raft_consensus.cc:3055] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:02.122263   744 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:02.123123   744 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.123755   592 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:02.124166   744 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.100021 31386 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:02.127074 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.128219 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.128769 31386 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:02.129869   841 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:24:02.076865   739 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:24:02.106869   506 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:02.093261   659 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.131973   659 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.071938   836 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:02.132822   836 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.134842   836 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:02.042888   813 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.135417   813 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:02.135812   813 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.102236   301 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.102715   774 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.094897   785 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:02.140198   589 consensus_meta.cc:287] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.000s
I20260709 12:24:02.140594   589 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:02.103420   840 log.cc:927] Time spent T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:24:02.104722 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:02.104990   778 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:01.875767 31536 rpcz_store.cc:276] 0709 12:24:00.562020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.893679 (+331659us) service_pool.cc:224] Handling call
0709 12:24:00.893962 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.894266 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.894300 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.894817 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.067941 (+173124us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:01.381252 (+313311us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.399624 (+ 18372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.406749 (+  7125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.707327 (+300578us) raft_consensus.cc:1685] finished
0709 12:24:01.707366 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.707574 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126,"prepare.queue_time_us":327409,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":1730,"raft.queue_time_us":71551,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":5776,"thread_start_us":396382,"threads_started":2,"wal-append.queue_time_us":400996}
I20260709 12:24:02.142767   589 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.107753   833 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:02.108094 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.143849 31465 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:02.144215 31394 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:02.098134   782 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.145130   782 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.582280 31466 rpcz_store.cc:276] 0709 12:23:59.936554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.145106 (+208552us) service_pool.cc:224] Handling call
0709 12:24:00.145485 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.145724 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:00.155502 (+  9778us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.432043 (+1276541us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b18001ebd40. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e149c0a 00007f6e97889219 00007f6e8e1d1a40 00007f6e8e1cc4e4 00007f6e8e1cc455 00007f6e94cb43c7 00007f6e912c69a7 00007f6e912d60bf 00007f6e912d6038
0709 12:24:01.432248 (+   205us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.570766 (+138518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:01.570840 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:01.570901 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.570999 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.571148 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1277011,"prepare.queue_time_us":2479193,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":41679,"raft.queue_time_us":63268,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":26453,"spinlock_wait_cycles":22388992,"thread_start_us":127646,"threads_started":1}
I20260709 12:24:02.146744 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:02.149441 32081 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 387) took 2297 ms (client timeout 1855 ms). Trace:
W20260709 12:24:02.149892 32081 rpcz_store.cc:269] 0709 12:23:59.851828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.854568 (+  2740us) service_pool.cc:224] Handling call
0709 12:24:02.149237 (+2294669us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b54000dbbd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:02.149373 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149006080}
I20260709 12:24:02.153285   540 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.153658 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.154544   771 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:02.155694   771 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.159265   813 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.160383   542 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.161310 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.161772 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 390) took 2309 ms. Trace:
I20260709 12:24:02.164647 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.165010 31386 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:02.165483 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1405) took 1603 ms. Trace:
I20260709 12:24:02.165555 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.165973 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.166342 31539 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:02.167279 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.098496 31395 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:02.167532 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.167670 32075 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:02.169775   668 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.170179 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.170867 31395 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:02.171644 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.112229 31468 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:02.172186   587 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.172186 31395 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:02.154608 31462 raft_consensus.cc:2393] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:02.165759 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.174494 31466 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:02.173260 31386 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:02.165874 31542 rpcz_store.cc:276] 0709 12:24:00.562422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.854066 (+291644us) service_pool.cc:224] Handling call
0709 12:24:02.165302 (+1311236us) spinlock_profiling.cc:243] Waited 77.7 ms on lock 0x7b5400241654. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:02.165408 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178728704}
W20260709 12:24:02.032274 32077 rpcz_store.cc:269] 0709 12:23:59.699384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.783588 (+ 84204us) service_pool.cc:224] Handling call
0709 12:24:01.711721 (+1928133us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197eee 000000000036eb39 00007f6e9620b1e0 00007f6e962d40c4 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:01.969197 (+257476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4195072}
I20260709 12:24:02.176863 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.177160 32047 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:02.177484 31542 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:02.178220 31393 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:02.178982 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.180089 31393 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:24:02.180332 31433 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:02.180622 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.181465 31395 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.168218   813 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:02.162107 32080 rpcz_store.cc:276] 0709 12:23:59.852770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.901653 (+ 48883us) service_pool.cc:224] Handling call
0709 12:23:59.917660 (+ 16007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.680590 (+1762930us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b580006d4d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912180aa 00007f6e9129a447 00007f6e912b2fe7 00007f6e912b47de 00007f6e912beb49 00007f6e912bf416 00007f6e912bbd8f 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4
0709 12:24:02.154326 (+473736us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:02.154355 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.154393 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:02.154423 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.161617 (+  7194us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.161721 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7949,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":2962231680}
I20260709 12:24:02.034686   817 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.179462   762 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.191071   762 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:02.191514   762 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.173108 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.191655 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.192468 31538 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:02.188771   625 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.188603 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.033540   769 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.198858 31462 raft_consensus.cc:2410] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:02.189684   782 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.194722 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.199023 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:02.200114 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:02.203949 31393 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:02.200745 31543 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:02.208029 31468 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:02.208191   800 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:02.209041 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:02.208880   800 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.209690 31468 raft_consensus.cc:2376] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3. Re-sending same reply.
I20260709 12:24:02.210553 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.202366 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.211967 31462 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:02.212090 31535 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:02.212865 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.214184   836 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:02.214830   393 consensus_queue.cc:1059] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:24:02.216472 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.217846 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.218469 31464 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:02.198196   625 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:02.220515   625 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.225970   540 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.223078   762 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.227641 31433 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:02.228488 31433 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:02.229001 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:02.229255 31433 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:02.211059 31468 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:02.229790 31542 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:02.230435 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.231370 31468 raft_consensus.cc:2410] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:02.214186 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.232275 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.233335 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.234884 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:02.236060 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 221718us
I20260709 12:24:02.236771 31510 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:02.237437 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.240773 31464 raft_consensus.cc:2410] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:02.244558 31395 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:02.276310 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.277669 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.032994   403 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.191336   373 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.265726 31468 raft_consensus.cc:1275] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:02.379331 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1460) took 1382 ms. Trace:
I20260709 12:24:02.267424 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1320) took 3017 ms. Trace:
I20260709 12:24:02.266728 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:02.381565 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 114902us
I20260709 12:24:02.382488 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:02.267863 31538 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:02.384528 31542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:02.385306 31542 raft_consensus.cc:606] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:02.270991 31463 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:02.279050 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.379784 31468 rpcz_store.cc:276] 0709 12:24:00.997253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.242350 (+1245097us) service_pool.cc:224] Handling call
0709 12:24:02.242674 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.379018 (+136344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.379267 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.386893 31395 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:02.280206 32047 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:02.387643 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 107530us
W20260709 12:24:02.370698 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 141488us
I20260709 12:24:02.372818 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.389943 31388 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:02.391044 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:02.376000 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1341) took 1023 ms. Trace:
I20260709 12:24:02.378429 31464 raft_consensus.cc:1275] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:02.268931 31539 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:02.392189 31466 rpcz_store.cc:276] 0709 12:24:01.352188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.374909 (+1022721us) service_pool.cc:224] Handling call
0709 12:24:02.375338 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.375547 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.375585 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.375644 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:02.375689 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.375776 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.375930 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.391746 31388 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:02.234532   744 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.414702 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:02.379981 31470 rpcz_store.cc:276] 0709 12:23:59.225572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.227912 (+  2340us) service_pool.cc:224] Handling call
0709 12:23:59.228276 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.671716 (+2443440us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b18003db8e0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e90e644bc 00007f6e8e1b248b 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cc455 00007f6e912b4060 00007f6e912b4bfb 00007f6e912bf64b
0709 12:24:01.671845 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.671871 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.672321 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.926898 (+254577us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:01.951161 (+ 24263us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.967075 (+ 15914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.967158 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.199610 (+232452us) raft_consensus.cc:1685] finished
0709 12:24:02.243060 (+ 43450us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.243269 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22775,"prepare.queue_time_us":25251,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":43,"raft.queue_time_us":25197,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":41510,"spinlock_wait_cycles":6849920,"thread_start_us":303699,"threads_started":2,"wal-append.queue_time_us":308483}
I20260709 12:24:02.265239   813 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:02.242054 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:02.438648   664 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.445057   664 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.379616   836 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:02.376973   301 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.424638   832 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:02.381784   800 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.420151 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:02.459683 31361 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.461061 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:02.377032   589 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.382272   822 raft_consensus.cc:3055] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:02.380911 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:02.471297   668 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:02.466329   800 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:02.472030 31537 raft_consensus.cc:2368] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5.
I20260709 12:24:02.471659   659 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.472291   800 raft_consensus.cc:697] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:02.426244   785 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:02.473156   785 raft_consensus.cc:697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:02.473248   800 consensus_queue.cc:237] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.474138   785 consensus_queue.cc:237] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.447237   664 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.418267   744 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:02.453236   832 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:02.475725   744 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.475854   529 raft_consensus.cc:3055] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:02.476325   529 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:02.440485   587 consensus_queue.cc:1059] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:24:02.477106   529 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.448959   301 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.478153   301 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.417667   373 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:02.467384 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:02.374071   506 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.193s
I20260709 12:24:02.272404   739 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.190s
I20260709 12:24:02.448725   542 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:02.411873   787 tablet_copy_client.cc:323] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:24:02.468538   822 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:02.463271   836 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:02.370719   592 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.197s
I20260709 12:24:02.481038 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:02.454696 31461 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:02.469836 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:02.475873   832 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.452651   769 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.448540   403 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.448414   762 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:02.447557   636 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:02.479676   689 consensus_meta.cc:287] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.000s
I20260709 12:24:02.466382   748 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:02.522761 31464 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:02.492237 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1442) took 2646 ms. Trace:
W20260709 12:24:02.523481 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 486003us
I20260709 12:24:02.473966   659 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:02.547245 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.498215   822 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.513262 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.510926 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:02.555646 31466 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:02.517932 32050 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:02.493083   819 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:02.497084 31361 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:02.502103   540 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.555763 31465 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.493557   373 raft_consensus.cc:3055] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:02.557801 32050 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:02.521380   814 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.131s	user 0.007s	sys 0.025s
I20260709 12:24:02.561609 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:02.563722 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.523586 31467 rpcz_store.cc:276] 0709 12:23:59.846328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.138202 (+291874us) service_pool.cc:224] Handling call
0709 12:24:00.149165 (+ 10963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.149401 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:01.212942 (+1063541us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b18003cc340. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e149c0a 00007f6e97889219 00007f6e8e1d1a40 00007f6e8e1cc4e4 00007f6e8e1cc455 00007f6e94cb43c7 00007f6e912c69a7 00007f6e912d60bf 00007f6e912d6038
0709 12:24:01.406683 (+193741us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.947620 (+540937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.948093 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.948229 (+   136us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:02.491500 (+543271us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18003cc340. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e149c0a 00007f6e97889219 00007f6e8e1d1a40 00007f6e8e1cc4e4 00007f6e8e1cc455 00007f6e94cb43c7 00007f6e912c69a7 00007f6e912d60bf 00007f6e912d6038
0709 12:24:02.491698 (+   198us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.491939 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.492019 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.492058 (+    39us) raft_consensus.cc:1685] finished
0709 12:24:02.492071 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.492182 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104452,"prepare.queue_time_us":1868408,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":56297,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":9055,"spinlock_wait_cycles":104498944,"thread_start_us":584372,"threads_started":2,"wal-append.queue_time_us":605992}
W20260709 12:24:02.562549 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 65560.4us
I20260709 12:24:02.564340 31542 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:02.565761 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:02.563509   814 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.007s	sys 0.025s
I20260709 12:24:02.567997 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:02.568835 31542 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.566937 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.570219 31539 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:02.572197 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.572834 31388 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.555033   777 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:02.560909   540 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:02.553771   748 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:02.560201   373 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:02.568325   636 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.568063   796 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:02.566872 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet ab7bbda785db43a8a40b2bbd07b0c97a from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:24:02.632027 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.532491   689 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.606070   836 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.606705   822 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.606123   769 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:02.628916 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:02.635531   706 consensus_meta.cc:287] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 12:24:02.615131 31542 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:02.672013 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:02.672699 31542 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:02.636307 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 193986us
I20260709 12:24:02.632892 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.677273 31392 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.619978 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:02.648165 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.684700 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.685330 31539 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:02.685425 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:02.648332 31543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 150) took 1636 ms (client timeout 1987 ms). Trace:
W20260709 12:24:02.686178 31543 rpcz_store.cc:269] 0709 12:24:01.011603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.219704 (+208101us) service_pool.cc:224] Handling call
0709 12:24:02.648136 (+1428432us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540021e154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:02.648261 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764798720}
I20260709 12:24:02.630348 31507 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:02.687829 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 57560.9us
I20260709 12:24:02.636565   636 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.620267 31389 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:24:02.661383 31469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1329) took 3419 ms (client timeout 1821 ms). Trace:
I20260709 12:24:02.651592 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:02.617651 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.568061   819 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:02.625519   847 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:02.701287 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.645687 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:02.703274 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.704099 31463 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:02.661227   796 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:02.689064 31507 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:02.720762 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.721309 31507 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:02.691452 31469 rpcz_store.cc:269] 0709 12:23:59.233293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.290481 (+ 57188us) service_pool.cc:224] Handling call
0709 12:24:00.471878 (+1181397us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:02.652480 (+2180602us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400415854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:02.652600 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724233856}
I20260709 12:24:02.722785 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:02.724066 31469 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.724759 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:02.687148 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:02.725431 31539 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:02.725394 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.621326   782 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:02.626953 32076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 393) took 1859 ms (client timeout 1801 ms). Trace:
I20260709 12:24:02.625800   771 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.634420   777 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.760337 31542 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:02.632844   744 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:02.678638   570 consensus_meta.cc:287] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.560s	user 0.004s	sys 0.004s
I20260709 12:24:02.696492 31388 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
W20260709 12:24:02.571980   393 consensus_queue.cc:1175] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b63f042a541248b88888cbd3049b38ca" responder_term: 4 status { last_received { term: 4 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 4 index: 7 } }
W20260709 12:24:02.697889 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 46410.9us
I20260709 12:24:02.698534   587 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:02.698480 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 139370us
I20260709 12:24:02.660662   786 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.667127   778 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.709290 31467 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:02.689543   644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.009s
I20260709 12:24:02.621127   540 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:02.715123 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.721540 31389 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.629310 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1435) took 1178 ms. Trace:
I20260709 12:24:02.727468 31507 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:02.788200 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 60816.4us
I20260709 12:24:02.732067   834 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:02.731904 31359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.033s	sys 0.036s
I20260709 12:24:02.742441 31544 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:02.694763   636 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:02.668851 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 401152us
W20260709 12:24:02.798977 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.800019 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:02.802030 31510 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:02.805507   856 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:02.805810   825 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:02.806272   825 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:02.808209 32050 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:02.782928   644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.005s	sys 0.009s
I20260709 12:24:02.667999 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet ab7bbda785db43a8a40b2bbd07b0c97a from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-ab7bbda785db43a8a40b2bbd07b0c97a
I20260709 12:24:02.693675   849 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:02.766376 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.815718 31388 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.815778 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:02.816591 31467 raft_consensus.cc:2410] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:02.817472 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 113669us
I20260709 12:24:02.818173 32048 leader_election.cc:400] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5.
I20260709 12:24:02.818436 32048 leader_election.cc:403] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:02.775084   855 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.762027 31392 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:02.695767 32077 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:02.733239 31536 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:02.742265   681 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.690351   706 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.821380 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.690474   769 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.788928 31507 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:02.728382 31543 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:24:02.787811   440 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.828243 31507 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:02.792436 31390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.029s
W20260709 12:24:02.792641 31359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.033s	sys 0.036s
I20260709 12:24:02.789669   830 raft_consensus.cc:993] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: : Instructing follower 503bef451a2b424fa35e8e46b8c06f29 to start an election
W20260709 12:24:02.829274 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 649284us
W20260709 12:24:02.744024 32076 rpcz_store.cc:269] 0709 12:24:00.767315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.770170 (+  2855us) service_pool.cc:224] Handling call
0709 12:24:02.626781 (+1856611us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54001333d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:02.626890 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118849408}
I20260709 12:24:02.790205 31469 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:02.764143   592 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:02.806663   825 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.831614   664 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:02.832258   664 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.834692   767 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:02.835377   767 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.830222 31359 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.839278 31359 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.840093   542 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:02.840509 31359 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.840811   542 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.841353   835 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:02.829202 31390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.014s	sys 0.029s
I20260709 12:24:02.825661 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:02.843061 31359 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.831719   829 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.845086   829 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.845157 31389 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
W20260709 12:24:02.843956 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.849351 31388 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:02.853454 31359 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:02.778239   570 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.849380 32084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 350) took 1105 ms. Trace:
I20260709 12:24:02.809576   659 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:02.759948   748 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.863956 31361 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:02.810321   856 raft_consensus.cc:697] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:02.863925 31359 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.809190   395 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:24:02.856124   681 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:02.878110 31394 raft_consensus.cc:1240] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:02.857992 32084 rpcz_store.cc:276] 0709 12:24:01.743840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.992008 (+248168us) service_pool.cc:224] Handling call
0709 12:24:01.992289 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.992485 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:02.268472 (+275987us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.849071 (+580599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.849120 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:02.849157 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.849217 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.849314 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":456163,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":40,"raft.queue_time_us":74020,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":27407,"thread_start_us":853236,"threads_started":3}
I20260709 12:24:02.856281   855 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.812098   786 consensus_queue.cc:1059] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:24:02.862462   542 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.630030   668 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:24:02.855180   440 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.787853 31387 rpcz_store.cc:276] 0709 12:24:01.450441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.460981 (+ 10540us) service_pool.cc:224] Handling call
0709 12:24:02.629124 (+1168143us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540027ef54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:02.629239 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397499264}
I20260709 12:24:02.856377   769 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.809434   857 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:24:02.869352   677 raft_consensus.cc:1081] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Signalling peer 503bef451a2b424fa35e8e46b8c06f29 to start an election
W20260709 12:24:02.920729   852 log.cc:927] Time spent T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:24:02.921041 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 220) took 1111 ms. Trace:
I20260709 12:24:02.921970   777 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.868907   652 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:02.807672   834 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.936244 31359 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.859510   848 raft_consensus.cc:2764] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:02.874117   829 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:02.937841   689 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:02.944826   771 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.944515   825 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.872495   676 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:24:02.950455   706 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:02.983793 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 106547us
I20260709 12:24:02.984695 31359 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:02.985646 31539 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:02.985911 31359 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:02.847843   796 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:02.915900   778 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.937793   542 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.951901 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 216) took 1143 ms. Trace:
I20260709 12:24:02.952564 31395 rpcz_store.cc:276] 0709 12:24:01.809705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.428300 (+618595us) service_pool.cc:224] Handling call
0709 12:24:02.428741 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.429125 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.429167 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.429756 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:24:02.697597 (+267841us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:02.697636 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.699271 (+  1635us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.920840 (+221569us) raft_consensus.cc:1685] finished
0709 12:24:02.920859 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.920983 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21353,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":229262,"threads_started":1,"wal-append.queue_time_us":341629}
W20260709 12:24:02.954278 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 136223us
I20260709 12:24:02.998569 32048 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:02.957103 31465 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:02.911010   851 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:02.946714   301 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:02.964882   652 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:02.952777 32764 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:02.988796 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 175511us
I20260709 12:24:02.997123 31390 rpcz_store.cc:276] 0709 12:24:01.808561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.228464 (+419903us) service_pool.cc:224] Handling call
0709 12:24:02.228711 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.228881 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:02.842252 (+613371us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.951525 (+109273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.951580 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:02.951624 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.951709 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.951844 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11606,"prepare.queue_time_us":461883,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":6605,"raft.queue_time_us":11893,"spinlock_wait_cycles":14802304,"thread_start_us":702669,"threads_started":2}
I20260709 12:24:03.002103 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:03.005093 31465 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
W20260709 12:24:03.005429 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 177278us
I20260709 12:24:03.006253 31507 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:03.003069 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 168410us
I20260709 12:24:03.011118 31507 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.012346 31465 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:03.012742 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.014219 31510 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:03.002498   625 consensus_meta.cc:287] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.782s	user 0.005s	sys 0.005s
I20260709 12:24:03.015024 32047 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.015106 31507 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.001665   542 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.996850   644 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.997591   778 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:03.004573   871 raft_consensus.cc:3055] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:03.005467   817 consensus_meta.cc:287] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.001s
I20260709 12:24:03.001490   751 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:03.018599 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.011330   706 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.032867 31466 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:03.031584   570 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.019162   689 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:03.019003   857 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:03.016242   874 raft_consensus.cc:3055] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:03.026510   778 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.013518   849 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:03.024289   659 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.063762 31507 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:03.067329 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.024008   681 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.094237   739 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:02.967324   856 consensus_queue.cc:237] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.123265   301 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.124928   739 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:03.094722   883 log.cc:927] Time spent T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:24:03.095856   869 log.cc:927] Time spent T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:24:03.098585   832 consensus_meta.cc:287] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 12:24:03.025776   625 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:03.061705   592 raft_consensus.cc:697] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.099217 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.045054   817 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.064479   874 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:03.084066 31510 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:03.138949 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 55027.2us
I20260709 12:24:03.139842 31510 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:03.026801   871 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:03.105556 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:03.106000   877 log.cc:927] Time spent T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:24:03.106730   881 log.cc:927] Time spent T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:24:03.107522   865 log.cc:927] Time spent T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:24:03.109193 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.109937   830 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:24:03.114758   880 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.115907   440 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.132115   832 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.116174   659 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:03.147897 32079 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.148917   832 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:03.143724   887 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:03.117259 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.061326   689 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:03.059197   506 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.098762 32050 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:03.025564   782 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 12:24:03.117010 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1451) took 1405 ms. Trace:
I20260709 12:24:03.132042 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.120316   857 raft_consensus.cc:697] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:03.135329   825 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:03.149391 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:03.159543 32080 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:03.130999 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 145154us
W20260709 12:24:03.156589 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 57902.2us
I20260709 12:24:03.153908   830 raft_consensus.cc:3055] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:03.065419   652 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.142822   849 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:03.158255 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 55707.5us
I20260709 12:24:03.163897 31507 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.153120   689 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.151997   506 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:03.168708 31359 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:03.167459   832 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:24:03.171144   871 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.172549   871 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.155558   659 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.157454   880 raft_consensus.cc:697] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:03.181214 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.159818   777 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:03.196972 31389 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:03.162344   830 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.199873 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.165813   887 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:03.201351 31359 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.198060 31388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:56518
I20260709 12:24:03.217633 31388 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.217792 31359 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.221563 31388 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.213660 31390 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:03.213506   857 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.173061   625 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.175884   506 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.243649 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.275821 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 217) took 1467 ms. Trace:
I20260709 12:24:03.281888 31393 rpcz_store.cc:276] 0709 12:24:01.808843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.235528 (+426685us) service_pool.cc:224] Handling call
0709 12:24:02.236557 (+  1029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.236784 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:02.695696 (+458912us) log.cc:844] Serialized 14 byte log entry
0709 12:24:03.125620 (+429924us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b18003eeea0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c23a 00007f6e912c6a2a
0709 12:24:03.275344 (+149724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:03.275419 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:03.275478 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.275574 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.275743 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":458842,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":9702,"raft.queue_time_us":126,"spinlock_wait_cycles":19873536,"thread_start_us":473616,"threads_started":2}
I20260709 12:24:03.286240 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.312556 32080 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:03.316659 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.322397 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.323148 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.186908   834 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:03.202219   825 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.327188 31389 raft_consensus.cc:1240] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:03.205266   832 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:03.198971   777 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:03.339048 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.312031   644 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.343216 31392 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:03.281183 32710 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:03.213490 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.361776 32084 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:03.322059   625 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.322770   771 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5.
I20260709 12:24:03.313053   858 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.321950   829 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:03.376559   886 log.cc:927] Time spent T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:24:03.359346 32710 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:03.377583 32079 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
W20260709 12:24:03.386423   876 log.cc:927] Time spent T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 12:24:03.353914   867 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.175s	user 0.001s	sys 0.002s
W20260709 12:24:03.373564   540 consensus_meta.cc:287] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.002s
I20260709 12:24:03.404289 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.403569 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.350378   777 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:03.405962 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 202073us
I20260709 12:24:03.426874 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.438163 31389 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:03.409183 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 90468.9us
I20260709 12:24:03.351168   825 raft_consensus.cc:697] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.354291   644 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.403082 31388 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.425868 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.366091   739 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:03.374629   636 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.003s
W20260709 12:24:03.435976 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.437247 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.165469   874 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.322136   592 consensus_queue.cc:237] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.418534 32710 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.455125 31393 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 3: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:03.468889 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.470325 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.464325 31388 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:03.473394 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.435295   817 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:03.405601   625 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.477898 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.471055 31393 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.480165 31389 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:03.455224   644 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.418959   829 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.366477   830 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.484397 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.371883   659 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.487782 31462 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.486546 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.446125   540 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.479485   874 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.494163 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.155755 31386 rpcz_store.cc:276] 0709 12:24:01.711446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.190681 (+479235us) service_pool.cc:224] Handling call
0709 12:24:02.191338 (+   657us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:02.623190 (+431852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.623248 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:02.624569 (+  1321us) log.cc:844] Serialized 539 byte log entry
0709 12:24:02.788889 (+164320us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:02.793345 (+  4456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.806872 (+ 13527us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.116755 (+309883us) raft_consensus.cc:1685] finished
0709 12:24:03.116773 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.116930 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25581,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"thread_start_us":555144,"threads_started":2,"wal-append.queue_time_us":476580}
I20260709 12:24:03.472942   636 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.489696   887 raft_consensus.cc:697] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.500583 31462 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:03.429497   880 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.505034 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.505740 31462 raft_consensus.cc:2368] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:03.506527 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:03.507432 31393 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:03.507653 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.508222 31462 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.508539 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.512929   706 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:03.517045 32710 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.518067 31388 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:03.520344   625 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:03.522943   836 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.523447   836 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.525403 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.526536   506 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.519047 32078 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:03.528332   529 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.528169   542 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.528818 32710 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.529302   506 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:03.529641 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.530197   542 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.532070   540 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:03.532487 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.501881   830 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.535936 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.537909 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.538352 31433 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:03.540962 31391 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:24:03.543524 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.526469   778 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:03.547155 31359 connection.cc:256] RPC call timeout handler was delayed by -1.1918568490000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:24:03.548893 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.555254 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.560783 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.508709   668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34616 (request call id 10) took 16250 ms. Trace:
I20260709 12:24:03.560783 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.541962   834 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:03.564828 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.493805   825 consensus_queue.cc:237] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.561786 31387 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:03.567705 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.559382 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.538599   777 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.563522 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.567162 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1395) took 1403 ms. Trace:
I20260709 12:24:03.580410 31462 raft_consensus.cc:2410] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:03.574972   887 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.583611   777 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.585110 31386 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:03.586020   902 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:03.586537   902 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:03.580323   895 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:24:03.588646   902 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:03.590760   778 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.592665 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:03.593883 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.594851 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:03.598913 31470 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:03.601460 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.604631 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:03.605469 32078 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:03.606315 31540 raft_consensus.cc:2410] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:03.606897 31537 raft_consensus.cc:1275] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:03.581089 31536 rpcz_store.cc:276] 0709 12:24:02.164192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.171970 (+  7778us) service_pool.cc:224] Handling call
0709 12:24:02.172282 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.820992 (+648710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.565166 (+744174us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54003ffa54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:03.565433 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198694144}
I20260709 12:24:03.591087   819 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:03.609115 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.610190 32079 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:03.571049 32077 raft_consensus.cc:2376] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4. Re-sending same reply.
I20260709 12:24:03.613096 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:03.614310 31470 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:03.614603 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.581802 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.615895 31462 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.617273 31510 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.618299   540 raft_consensus.cc:2764] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:03.619477   829 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.619992   542 consensus_queue.cc:1059] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:03.620687   542 consensus_queue.cc:1243] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:03.633353 32076 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:03.631616   506 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:24:03.635001 31462 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:03.636567 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.629237   540 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.632733   902 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.604130   689 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.635128   644 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.644769   902 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:03.654451   902 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.654765 31390 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:03.656164   836 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.657116   644 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.658979 31544 raft_consensus.cc:2410] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:03.652621 31535 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:03.563150   668 rpcz_store.cc:276] 0709 12:23:47.244341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.257133 (+ 12792us) service_pool.cc:224] Handling call
0709 12:23:47.406373 (+149240us) log.cc:844] Serialized 513 byte log entry
0709 12:23:47.534300 (+127927us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b540011e520. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e9123cb26 00007f6e9123649a 00007f6e91235714 00007f6e91215eaa 00007f6e9121cd53 00007f6e9121ccd9 00007f6e9121cc69 00007f6e9121cc31 00007f6e9121bdfd 0000000000388634
0709 12:23:47.536911 (+  2611us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b2c0001f138. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc4a0a 00007f6e8fbc4693 00007f6e8fbc4631 00007f6e912f8b52 00007f6e912f8cf5 00007f6e91235691 00007f6e91215eaa 00007f6e9121cd53 00007f6e9121ccd9 00007f6e9121cc69
0709 12:23:47.545758 (+  8847us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b540011e520. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e91231dbe 00007f6e9123c930 00007f6e9123c8d8 00007f6e9123c858 00007f6e9123c813 00007f6e9123ba9c 00007f6e971272f6 00007f6e97121aa8 00007f6e912787cb 00007f6e9127b2c0
0709 12:23:47.584330 (+ 38572us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b4c001cc940. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8f588a20 00007f6e8f599a29 00007f6e8f59a13f 00007f6e8f55e2ab 00007f6e8f58bf3c 00007f6e8f58c3fe 00007f6e8f81950b 00007f6e91218381 00007f6e9121626b 00007f6e9121cd53 00007f6e9121ccd9
0709 12:24:03.491771 (+15907441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6732,"raft.queue_time_us":34552,"raft.run_cpu_time_us":8823,"raft.run_wall_time_us":268727,"spinlock_wait_cycles":125824256,"thread_start_us":21794,"threads_started":1,"wal-append.queue_time_us":82371,"wal-append.run_cpu_time_us":4075,"wal-append.run_wall_time_us":1064401}
I20260709 12:24:03.651896   636 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.652415 31386 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:03.664536 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:03.646432   540 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.670037 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1422) took 1091 ms. Trace:
I20260709 12:24:03.654841   587 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:03.670492 31540 rpcz_store.cc:276] 0709 12:24:02.578944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.685197 (+106253us) service_pool.cc:224] Handling call
0709 12:24:03.669846 (+984649us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b540017ff54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:03.669983 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116003712}
I20260709 12:24:03.678457   587 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.679499   689 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:03.678490 31470 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:03.678906 31543 raft_consensus.cc:1275] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:03.691824   540 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.692855 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:03.693725 31341 auto_rebalancer.cc:629] Failed to schedule move for tablet e9371bed6dc240b6969ed373c14c9a75: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:03.723026   373 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.725997   664 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.726140   373 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.733522 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.734138 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:03.734498 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.734603 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.735991 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.737501 31536 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:03.737686 31538 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:03.737727 31434 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:03.738534 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.738620 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.739077   836 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.739482   836 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:03.739739 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.739993   836 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.740140 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.740356 31538 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:03.740787 31537 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
I20260709 12:24:03.741161 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.741665 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.739518   767 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.735872 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.744205 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:03.743755 31434 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.744925   677 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:03.754227 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.754302   767 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:03.745558   902 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.742218 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.770136 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.771139 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:03.759131   908 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:24:03.746269 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.757128 31434 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.750339   587 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.752359 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:03.759856 31507 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.746614 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.748306 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.784219 31465 raft_consensus.cc:2393] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:03.771639 31469 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.747817   825 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:03.773403 31434 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:03.775943 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.765353   568 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.775658   403 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.790643   403 raft_consensus.cc:697] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:03.769907   767 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.791476   767 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.779727   830 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.778932 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1365) took 1064 ms. Trace:
I20260709 12:24:03.778901 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1472) took 1208 ms. Trace:
I20260709 12:24:03.786676 31434 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.786919 31470 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:03.787885 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.788005 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:03.784600   677 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.787526   829 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.795145 31465 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.796975 31469 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:03.793119 31394 rpcz_store.cc:276] 0709 12:24:02.570308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.570600 (+   292us) service_pool.cc:224] Handling call
0709 12:24:02.570896 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.911975 (+341079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.778605 (+866630us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400231754. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:03.778829 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705997184}
I20260709 12:24:03.752408   836 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.794276 31434 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.801414 31469 raft_consensus.cc:1240] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:03.800365 31434 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.802997   819 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.803368   819 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.798324   589 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.803723   819 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.803983   589 raft_consensus.cc:697] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:03.793081   395 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:03.804586   744 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:03.804919   589 consensus_queue.cc:237] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.804623   395 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.805847   664 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.806232   664 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.806558   664 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.807343   395 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.808463   830 consensus_queue.cc:1059] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:03.809147   830 consensus_queue.cc:1243] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:03.811604   830 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:03.801275   677 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.809217 31434 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.811987   830 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.793048 31461 rpcz_store.cc:276] 0709 12:24:02.714264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.752040 (+1037776us) service_pool.cc:224] Handling call
0709 12:24:03.778871 (+ 26831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:03.812760   677 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.813812 31461 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [2.2-5.4]
I20260709 12:24:03.814309   393 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:03.814694   393 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:03.815073   393 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.791620   403 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:03.816006 31433 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:03.816567 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.817919   744 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.818694   836 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:03.813372   830 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:03.802361 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:03.831579 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.832234 31469 raft_consensus.cc:2410] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:03.821509 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:03.822316 31510 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:03.822600 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:03.824160 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.834239 31465 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:24:03.834584 32081 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:03.834875 31510 leader_election.cc:400] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:03.835165 31510 leader_election.cc:403] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:03.835460 31469 raft_consensus.cc:1240] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:03.836027 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:03.836678 31539 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:03.836670 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.837507 31540 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:03.838361 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.824658 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:03.827765 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.827924 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:03.823570 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:03.828704   902 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:03.829983 31554 tablet_copy_source_session.cc:215] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:03.841817   463 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.842729 31554 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:34624 (request call id 158) took 1343 ms. Trace:
I20260709 12:24:03.842761 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.830384 32075 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:03.840965 31540 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:03.842108 31536 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:03.844596 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.845515 31543 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:03.857100 31538 raft_consensus.cc:3055] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.846634 31470 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:03.838069 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.857594 31538 raft_consensus.cc:740] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.858631 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.855338 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:03.855225 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 191) took 1314 ms. Trace:
I20260709 12:24:03.859690 31466 rpcz_store.cc:276] 0709 12:24:02.541030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.565448 (+ 24418us) service_pool.cc:224] Handling call
0709 12:24:03.855095 (+1289647us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54002c6354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:03.855184 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008501632}
I20260709 12:24:03.856180 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.849395 31436 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:03.846263 31467 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:03.830965 31461 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [3.2-4.3]
W20260709 12:24:03.881359 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 45391.1us
I20260709 12:24:03.882157 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.882536 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.883282 31510 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:03.883455 31540 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:03.884826 31510 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.870499 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:03.873068 31466 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:03.885914 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:03.869694 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1429) took 1240 ms. Trace:
I20260709 12:24:03.888228 31542 rpcz_store.cc:276] 0709 12:24:02.629408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.762103 (+132695us) service_pool.cc:224] Handling call
0709 12:24:02.762359 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.845445 (+ 83086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.845488 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.845541 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:02.845582 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.869466 (+1023884us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b54002094d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:03.869531 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.869645 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190622976}
I20260709 12:24:03.840483   786 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:03.904402 31543 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:03.905081 31543 pending_rounds.cc:85] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 2
I20260709 12:24:03.905407 31543 pending_rounds.cc:107] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:03.905746 31543 raft_consensus.cc:2889] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:03.894954   403 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.897101 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:03.897583 31389 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:03.898525 31466 raft_consensus.cc:1275] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:03.831012   836 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:03.965112 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 61476.4us
I20260709 12:24:03.840790   887 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:03.846875   813 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.906209 32710 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:03.988577 32710 consensus_queue.cc:1243] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:03.843124 31554 rpcz_store.cc:276] 0709 12:24:02.498982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.559433 (+ 60451us) service_pool.cc:224] Handling call
0709 12:24:03.829637 (+1270204us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003615d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c63f7 00007f6e9625c036 00007f6e96265a3e 00007f6e8db2927b 00007f6e962659ba 00007f6e96260acc 00007f6e9625bc7b 00007f6e962508d1 00007f6e953044b4 00007f6e95304442
0709 12:24:03.842648 (+ 13011us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384081152}
I20260709 12:24:03.965085 31389 pending_rounds.cc:85] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 5
W20260709 12:24:03.965160 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 80416.6us
I20260709 12:24:03.966369 32047 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:03.979377 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.992023 31389 pending_rounds.cc:107] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:03.896109   902 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.909077 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:03.991951 31542 pending_rounds.cc:85] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 1
I20260709 12:24:03.992997 31389 raft_consensus.cc:2889] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:04.002014 31542 pending_rounds.cc:107] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 12:24:03.908668   915 log.cc:927] Time spent T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:24:03.964610   568 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.996517 31510 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:03.848023   711 consensus_queue.cc:1059] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
W20260709 12:24:03.991436 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 91415.4us
I20260709 12:24:03.881845   751 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 12:24:03.855429   834 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:03.909075 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:04.016855 31463 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:04.017258 31463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1363) took 1324 ms (client timeout 1711 ms). Trace:
I20260709 12:24:04.004864 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1471) took 1434 ms. Trace:
I20260709 12:24:03.901005   830 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.869583   625 consensus_queue.cc:1059] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 12:24:03.980319   668 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:04.002534 31542 raft_consensus.cc:2889] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:04.018661 31391 rpcz_store.cc:276] 0709 12:24:02.570016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.570138 (+   122us) service_pool.cc:224] Handling call
0709 12:24:02.570436 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.541521 (+971085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.004638 (+463117us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54001a22d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:04.004812 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231132416}
I20260709 12:24:03.992046   589 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:04.017647 31463 rpcz_store.cc:269] 0709 12:24:02.692988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.869940 (+1176952us) service_pool.cc:224] Handling call
0709 12:24:04.017201 (+147261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:03.902504   592 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.991371   832 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:04.010000   777 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.984099   542 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:24:03.964869   782 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:04.023162   887 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.966741   819 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:04.070461 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:04.008109   568 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:04.114933 31388 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:24:04.008757   813 raft_consensus.cc:697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:03.980130   836 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.109481 31463 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:04.068722 31387 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:04.073742   914 log.cc:927] Time spent T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:24:04.126108 31510 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:04.121272 31538 consensus_queue.cc:260] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.129707 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:04.070638   677 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:24:04.131067 32080 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:04.125231   587 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:04.141968 31538 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.141422 32076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 363) took 1115 ms. Trace:
I20260709 12:24:04.067771   676 consensus_queue.cc:1059] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:24:04.037118   771 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:24:04.122854   568 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:04.137177   919 log.cc:927] Time spent T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.368s	user 0.002s	sys 0.000s
I20260709 12:24:04.127050   858 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:04.174075   858 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.174077 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1480) took 1097 ms. Trace:
I20260709 12:24:04.174768 31462 rpcz_store.cc:276] 0709 12:24:03.076207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.710304 (+634097us) service_pool.cc:224] Handling call
0709 12:24:03.721469 (+ 11165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.721705 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.721721 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:03.722306 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 12:24:03.768469 (+ 46163us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:03.768523 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.768588 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.173849 (+405261us) raft_consensus.cc:1685] finished
0709 12:24:04.173871 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.174017 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":725,"thread_start_us":32718,"threads_started":1,"wal-append.queue_time_us":37221}
I20260709 12:24:04.178320   659 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:04.073081   832 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:04.184176   890 raft_consensus.cc:3055] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:04.184666   890 raft_consensus.cc:740] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:04.184419   848 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:04.185454   890 consensus_queue.cc:260] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.186621   890 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:04.187489   506 consensus_queue.cc:1175] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "503bef451a2b424fa35e8e46b8c06f29" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:04.191526   659 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:04.192031   659 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:04.194841   856 consensus_queue.cc:1059] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:04.196049   856 raft_consensus.cc:3055] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:04.196463   856 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:04.199625   832 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:04.199450   856 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:04.208425 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:04.214900 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1361) took 1522 ms. Trace:
I20260709 12:24:04.215090 31543 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.215633 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1486) took 1135 ms. Trace:
I20260709 12:24:04.216157 31469 rpcz_store.cc:276] 0709 12:24:03.080407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.833551 (+753144us) service_pool.cc:224] Handling call
0709 12:24:03.835309 (+  1758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:03.835785 (+   476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.215453 (+379668us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b540004ced0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:04.215571 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3505536}
I20260709 12:24:04.215431 31468 rpcz_store.cc:276] 0709 12:24:02.692419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.811013 (+118594us) service_pool.cc:224] Handling call
0709 12:24:02.811377 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.827512 (+ 16135us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:02.862072 (+ 34560us) log.cc:844] Serialized 14 byte log entry
0709 12:24:03.019199 (+157127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:03.019267 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:03.019319 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.779493 (+760174us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b18003b08c0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e19d2a6 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419
0709 12:24:04.214644 (+435151us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5400271854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:04.214701 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.214830 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34423,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":87,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9232,"spinlock_wait_cycles":46573184,"thread_start_us":156706,"threads_started":1,"wal-append.queue_time_us":298138}
I20260709 12:24:04.225733 31538 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:24:04.226974 31359 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:04.272955 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.214476   902 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:04.201818   819 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:04.376833 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.174230   920 log.cc:927] Time spent T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 12:24:04.202952   921 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.207s	user 0.000s	sys 0.002s
I20260709 12:24:04.214459   856 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.460064 32075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 411) took 1385 ms. Trace:
I20260709 12:24:04.157344 32076 rpcz_store.cc:276] 0709 12:24:03.025955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.048500 (+ 22545us) service_pool.cc:224] Handling call
0709 12:24:03.159657 (+111157us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:03.175494 (+ 15837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:03.633904 (+458410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.137741 (+503837us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540064c154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:04.141344 (+  3603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058619520}
I20260709 12:24:04.380278   373 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.228094   689 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:04.473611   664 consensus_meta.cc:287] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.002s
I20260709 12:24:04.374662   848 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:04.481336 31543 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
W20260709 12:24:04.485013 32082 consensus_meta.cc:287] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.589s	user 0.004s	sys 0.009s
I20260709 12:24:04.552031 32082 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:04.552593 32082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 410) took 1479 ms. Trace:
I20260709 12:24:04.204623   393 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.202796   787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7bbda785db43a8a40b2bbd07b0c97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.549922 32710 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.191110   767 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.552891 32082 rpcz_store.cc:276] 0709 12:24:03.073614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.073761 (+   147us) service_pool.cc:224] Handling call
0709 12:24:03.870367 (+796606us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:04.552533 (+682166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51163520}
I20260709 12:24:04.561856 32710 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.200482   858 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:04.568095 31467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.019s	sys 0.006s
W20260709 12:24:04.568521 31467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.019s	sys 0.006s
I20260709 12:24:04.372459   813 consensus_queue.cc:237] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.608959 32710 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:04.202389   659 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.553256   373 raft_consensus.cc:697] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:04.613798 31466 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:04.591323   463 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.554101   689 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.506950 32075 rpcz_store.cc:276] 0709 12:24:03.074793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.131763 (+ 56970us) service_pool.cc:224] Handling call
0709 12:24:04.384802 (+1253039us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400690354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:04.392564 (+  7762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298995584}
I20260709 12:24:04.550062   664 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:04.632495 31436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.000s	sys 0.008s
W20260709 12:24:04.635176 31436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.000s	sys 0.009s
W20260709 12:24:04.636070 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 786696us
W20260709 12:24:04.639593 31470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.004s	sys 0.004s
W20260709 12:24:04.639967 31470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.004s	sys 0.004s
W20260709 12:24:04.641122 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.645388 31434 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:04.632633 31540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.020s	sys 0.068s
I20260709 12:24:04.618458   677 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:04.647957 31540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.020s	sys 0.068s
I20260709 12:24:04.557579   848 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.635203   836 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:04.675426 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 198476us
I20260709 12:24:04.628979   463 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:04.682407 31436 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:04.683720 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:04.686298 31538 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:04.688094 31543 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:04.652840   819 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:04.697449 31462 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:04.701174 31468 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:04.692137   763 consensus_queue.cc:1059] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 12:24:04.712810 31389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.019s	sys 0.030s
W20260709 12:24:04.713515 31389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.019s	sys 0.030s
I20260709 12:24:04.703774   393 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:04.704610   927 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:24:04.660943   677 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.678617   373 consensus_queue.cc:237] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.725121   393 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.715574   589 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.727653   542 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:04.746975   542 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:04.749805   542 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:04.751580   463 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:04.753129   677 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:04.754446   830 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.000s
I20260709 12:24:04.755116   677 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:04.755622 31537 raft_consensus.cc:2410] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:04.755807   664 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:04.755666   677 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:04.757159 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.758455   677 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:04.729091   935 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:04.760090   928 log.cc:927] Time spent T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:24:04.762240 31542 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:04.728001   767 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:04.763566   689 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:04.763756   857 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:04.726583   858 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:04.744623   890 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.767864   890 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.742632   872 raft_consensus.cc:3055] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:04.806291   568 consensus_meta.cc:287] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.000s
W20260709 12:24:04.825846 31361 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.029s	sys 0.077s
W20260709 12:24:04.836879 31361 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.030s	sys 0.077s
W20260709 12:24:04.854028 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 726968us
I20260709 12:24:04.864321 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:04.875810 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 183600us
W20260709 12:24:04.825706   777 consensus_meta.cc:287] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.000s
I20260709 12:24:04.904394 31361 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:04.905383 32710 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:04.905563 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:04.906312 32710 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.906755 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:04.907575 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 214668us
I20260709 12:24:04.744551   589 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:04.812134   872 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:04.828866   857 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:04.826469   568 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:04.908926   751 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:04.910261   777 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.914675   848 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:04.911026   767 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 12:24:04.929915 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 247579us
W20260709 12:24:04.944545 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.084739 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.949106 31391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.007s	sys 0.003s
W20260709 12:24:05.085556 31391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.007s	sys 0.004s
W20260709 12:24:04.960144 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.964884 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 58202.1us
I20260709 12:24:05.086970 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 199) took 1565 ms. Trace:
I20260709 12:24:05.087682 31361 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:04.931187   763 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:05.087695 31470 rpcz_store.cc:276] 0709 12:24:03.521368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.866838 (+345470us) service_pool.cc:224] Handling call
0709 12:24:03.879001 (+ 12163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:03.879218 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:04.640427 (+761209us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.086040 (+445613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:05.086108 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:05.086165 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.086245 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.086900 (+   655us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3005,"prepare.queue_time_us":130901,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":1189674,"threads_started":2}
I20260709 12:24:04.950721   819 raft_consensus.cc:697] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:05.092224 31361 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:05.079772   858 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.091602   751 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:05.083962   857 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:05.201294 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 373348us
I20260709 12:24:05.223614   819 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.186420   890 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:05.132421   848 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:05.096045   763 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:05.198374   936 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.297s	user 0.001s	sys 0.001s
I20260709 12:24:05.193781   782 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:05.199561   954 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.199790   858 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.240667   848 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:05.202991   751 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:05.256675 31420 heartbeater.cc:646] Failed to heartbeat to 127.29.131.254:36201 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.29.131.254:36201 timed out after 15.000s (SENT)
I20260709 12:24:05.243762   951 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:24:05.258594 31539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1415) took 1413 ms (client timeout 1762 ms). Trace:
I20260709 12:24:05.190032   956 consensus_queue.cc:1059] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:24:05.261220 31542 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:05.233093 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 152280us
I20260709 12:24:05.267292 31393 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:05.276137 31539 rpcz_store.cc:269] 0709 12:24:03.845666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.858338 (+ 12672us) service_pool.cc:224] Handling call
0709 12:24:05.252298 (+1393960us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003cffd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:05.258537 (+  6239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3072212736}
I20260709 12:24:05.280591 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:05.281390 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:05.278438   956 consensus_queue.cc:1243] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:05.286090 31542 raft_consensus.cc:2393] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:05.284399 31539 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:05.287580   948 log.cc:927] Time spent T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:24:05.289525 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1423) took 1143 ms. Trace:
W20260709 12:24:05.289942 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.289783 31359 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:05.290004 31544 rpcz_store.cc:276] 0709 12:24:04.145748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.145898 (+   150us) service_pool.cc:224] Handling call
0709 12:24:04.146209 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.180222 (+ 34013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.180274 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.180892 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.633458 (+452566us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:04.633498 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.633567 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.289261 (+655694us) raft_consensus.cc:1685] finished
0709 12:24:05.289288 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.289441 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33498,"raft.queue_time_us":34865,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":452227,"threads_started":1,"wal-append.queue_time_us":597248}
I20260709 12:24:05.292898   589 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.293913   751 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:05.294651   959 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:24:05.294616   848 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:05.295101   568 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:05.274175   782 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:05.296610   782 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:05.297219   829 raft_consensus.cc:3055] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.297722   829 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:05.298100   644 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:05.299218   644 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:05.271154 32084 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:05.294703   542 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:24:05.319381 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:05.318545 32764 raft_consensus.cc:3055] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:05.320917 32764 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:05.324221   373 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:05.324899   373 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:05.341614 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 249483us
I20260709 12:24:05.342721 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:05.351847 31361 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:05.258808   954 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.298830   829 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.340996   589 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:05.339560 32764 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.356726   589 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.357261 32764 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.358549   542 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:05.360072   832 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:05.360857   922 log.cc:927] Time spent T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 1.466s	user 0.006s	sys 0.011s
W20260709 12:24:05.362250   961 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:24:05.362015 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:05.362754 31395 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:05.360730   751 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.363763 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:05.365149 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:05.365224   767 raft_consensus.cc:3055] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:05.365664   858 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.365911 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:05.366501   858 raft_consensus.cc:3055] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:05.366884   858 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:05.367481   589 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.367682   763 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:05.340935   568 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:05.371140   568 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.371402 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:05.372066 31470 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:05.373023 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:05.373693 31464 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:05.365695 31540 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 1.
I20260709 12:24:05.375685 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:05.376998 31540 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:05.374982 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:05.378544 31462 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:05.379729 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:05.379835 31359 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:05.380482 31540 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:05.279168   951 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.382081 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:05.383773 31389 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:05.384181 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:05.381045   835 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.387837 31464 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:05.387925 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:05.389303 31393 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:05.432848 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1492) took 1927 ms. Trace:
I20260709 12:24:05.413429 31468 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:05.412245 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:05.434787 31462 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:05.426296 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:05.388952 31359 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:05.410827 31395 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:05.436656 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:05.423509 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 141595us
I20260709 12:24:05.409973 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:05.433506 31467 rpcz_store.cc:276] 0709 12:24:03.505083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.865073 (+359990us) service_pool.cc:224] Handling call
0709 12:24:03.865470 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.965457 (+ 99987us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:04.568915 (+603458us) log.cc:844] Serialized 14 byte log entry
0709 12:24:04.825214 (+256299us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.825794 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.825955 (+   161us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:04.826005 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.826098 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.432573 (+606475us) raft_consensus.cc:1685] finished
0709 12:24:05.432597 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.432766 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1618,"prepare.queue_time_us":103301,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":136064,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":56878,"thread_start_us":860041,"threads_started":3,"wal-append.queue_time_us":471637}
I20260709 12:24:05.440495 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:05.440974 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53139.2us
I20260709 12:24:05.441807 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:05.441856 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:05.442309 31390 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
W20260709 12:24:05.444756 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 55880us
I20260709 12:24:05.380582   373 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:05.445140 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:05.381453   751 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:05.444242 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:05.446167   968 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:05.458998 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:05.441149 31389 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
W20260709 12:24:05.460891 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 93403.3us
I20260709 12:24:05.385725   967 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:05.465147 31393 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:05.365680   767 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:05.411657   542 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:05.474395 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:05.477233 31393 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:05.446647   652 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:05.481492   568 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.447633   835 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:05.480162   787 consensus_meta.cc:287] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.003s
I20260709 12:24:05.474632   373 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:05.496371 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:05.367714   858 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:05.470422   968 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:05.504704   949 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 12:24:05.506299   918 log.cc:927] Time spent T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 1.596s	user 0.002s	sys 0.000s
W20260709 12:24:05.507449   965 log.cc:927] Time spent T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:24:05.507535 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:05.508376   958 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 12:24:05.509594   963 log.cc:927] Time spent T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:24:05.512071 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.474629   542 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:05.481505   652 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.531635   652 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.534178 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1394) took 3678 ms. Trace:
I20260709 12:24:05.524650 31543 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:05.534561 31541 rpcz_store.cc:276] 0709 12:24:01.855322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.006793 (+151471us) service_pool.cc:224] Handling call
0709 12:24:02.007220 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.012482 (+  5262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.012526 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.702616 (+690090us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b1800259b40. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e19d2a6 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc5372 00007f6e912f7a01 00007f6e912bc43a
0709 12:24:03.727758 (+1025142us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b2c0001f138. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc5372 00007f6e912f7a01 00007f6e912bc43a 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2
0709 12:24:03.728225 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:24:03.765091 (+ 36866us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:03.765125 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.765235 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.505728 (+1740493us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:05.533960 (+ 28232us) raft_consensus.cc:1685] finished
0709 12:24:05.533981 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.534103 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":222,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5394,"spinlock_wait_cycles":153774208,"thread_start_us":36536,"threads_started":1,"wal-append.queue_time_us":103434}
I20260709 12:24:05.490631   970 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:24:05.516530   856 consensus_meta.cc:287] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.004s	user 0.009s	sys 0.006s
I20260709 12:24:05.528834   542 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.469678   751 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.516389   968 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.474366   967 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:05.543834 31433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.684s	user 0.014s	sys 0.012s
W20260709 12:24:05.580607 31433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.721s	user 0.014s	sys 0.012s
I20260709 12:24:05.524480 31387 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:05.547873   652 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:05.578843   971 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:05.548475 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.581425 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 1.72602e+06us
I20260709 12:24:05.622390 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1376) took 1877 ms. Trace:
I20260709 12:24:05.623013 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:05.622821 31461 rpcz_store.cc:276] 0709 12:24:03.744884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.012259 (+267375us) service_pool.cc:224] Handling call
0709 12:24:04.071092 (+ 58833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.157958 (+ 86866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.157987 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.158025 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:04.158056 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.622146 (+1464090us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b5400415d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:05.622193 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.622335 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199279360}
I20260709 12:24:05.585892   835 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.586947   787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49878 (request call id 389) took 5734 ms. Trace:
I20260709 12:24:05.588481   951 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.591784   954 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.541563   767 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.539558   975 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:24:05.575122   832 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:05.607597   967 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:05.530997   858 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.530438   972 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.639060   403 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.651011   972 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:05.659386   652 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:05.626706   971 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.652354   832 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.660851   972 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.685755   971 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:05.717808   832 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.624893   787 rpcz_store.cc:276] 0709 12:23:59.852447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.853925 (+  1478us) service_pool.cc:224] Handling call
0709 12:24:01.862278 (+2008353us) ts_tablet_manager.cc:934] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
0709 12:24:04.067487 (+2205209us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:04.767655 (+700168us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:04.768077 (+   422us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:05.520142 (+752065us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:05.579750 (+ 59608us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:05.586772 (+  7022us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:05.586853 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":310248,"tablet-copy.queue_time_us":191043,"thread_start_us":236320,"threads_started":2}
I20260709 12:24:05.718947   787 tablet_copy_client.cc:806] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:05.719688   787 tablet_copy_client.cc:670] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:05.606205 31394 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
W20260709 12:24:05.769737 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 319496us
I20260709 12:24:05.613860 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1495) took 1500 ms. Trace:
W20260709 12:24:05.773655 31491 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 12:24:05.772321 31395 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:05.793675   751 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.798254 31390 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
W20260709 12:24:05.812143 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.817485 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 268816us
I20260709 12:24:05.819826   975 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:05.820705   951 consensus_queue.cc:1059] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:05.820900   975 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:05.833652 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.840149 31387 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:05.829874 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 192613us
I20260709 12:24:05.850498   951 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:05.851553   951 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.855638   987 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.856745   987 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.722834   968 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.861299 31544 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:05.862097   968 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.863102 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:05.865600 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 232) took 1980 ms. Trace:
W20260709 12:24:05.867411 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.868937   568 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.869606   568 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:05.846302 31391 rpcz_store.cc:276] 0709 12:24:04.113590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.114231 (+   641us) service_pool.cc:224] Handling call
0709 12:24:04.114531 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:04.126225 (+ 11694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.126256 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:04.136904 (+ 10648us) log.cc:844] Serialized 52 byte log entry
0709 12:24:05.085950 (+949046us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:05.088162 (+  2212us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.241633 (+153471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.241739 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.390560 (+148821us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b18003e2180. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf522 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:05.613464 (+222904us) raft_consensus.cc:1685] finished
0709 12:24:05.613595 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.613785 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11322,"prepare.queue_time_us":4522,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":115106,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":10555,"spinlock_wait_cycles":5961600,"thread_start_us":1031875,"threads_started":2,"wal-append.queue_time_us":1033668}
I20260709 12:24:05.892086 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:05.893146 31543 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:05.895185 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:05.895722 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1374) took 2151 ms. Trace:
I20260709 12:24:05.896148 31394 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:05.866221 31386 rpcz_store.cc:276] 0709 12:24:03.884920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.900322 (+ 15402us) service_pool.cc:224] Handling call
0709 12:24:04.002261 (+101939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.197656 (+195395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.197695 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.197734 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:04.197771 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.865033 (+1667262us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002e13d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:05.865128 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.865379 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448886144}
I20260709 12:24:05.901700   975 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:05.903538   987 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.904247 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:05.900908   848 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:05.905278 31537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 165) took 2067 ms (client timeout 1630 ms). Trace:
I20260709 12:24:05.896173 31466 rpcz_store.cc:276] 0709 12:24:03.744419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.005022 (+260603us) service_pool.cc:224] Handling call
0709 12:24:04.005699 (+   677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.619972 (+614273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.895067 (+1275095us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b540029aed4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:05.895482 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397926144}
I20260709 12:24:05.905812   848 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:05.908281 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:05.909327 32076 raft_consensus.cc:2393] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:05.909221   848 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.905747 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:05.905299 31538 raft_consensus.cc:2393] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:05.914044 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:05.915844 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 62807.2us
W20260709 12:24:05.916220 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 45566.2us
I20260709 12:24:05.918121 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:05.918167 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:05.905824 31537 rpcz_store.cc:269] 0709 12:24:03.837386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.840238 (+  2852us) service_pool.cc:224] Handling call
0709 12:24:05.904733 (+2064495us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54003ff054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:05.905097 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086537472}
I20260709 12:24:05.909245   568 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:05.939767 32082 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.947019   711 raft_consensus.cc:3055] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:05.931670   974 consensus_queue.cc:1059] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:05.935325   951 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:05.933458 31433 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:05.958269 32084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 419) took 1862 ms (client timeout 1921 ms). Trace:
I20260709 12:24:05.950615   711 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:05.964046 32084 rpcz_store.cc:269] 0709 12:24:04.070082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.070209 (+   127us) service_pool.cc:224] Handling call
0709 12:24:05.931996 (+1861787us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54000e06d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:05.932213 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260673408}
I20260709 12:24:05.980711   711 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:05.981706 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 505106us
W20260709 12:24:05.986246 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.995182   951 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:05.988090   711 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:05.997403 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.997684 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 79927.6us
I20260709 12:24:05.987915   592 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.012674 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1410) took 2174 ms. Trace:
I20260709 12:24:06.014483   998 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.012516   887 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:06.027015 32082 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
W20260709 12:24:06.030282 32082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 371) took 1376 ms (client timeout 1753 ms). Trace:
W20260709 12:24:06.037186 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 118655us
W20260709 12:24:06.037950 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.038336   568 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.045264   568 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.045943 31433 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.047212   951 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.014842 31535 rpcz_store.cc:276] 0709 12:24:03.838285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.840308 (+  2023us) service_pool.cc:224] Handling call
0709 12:24:03.896087 (+ 55779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:03.985159 (+ 89072us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:04.037965 (+ 52806us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.620376 (+1582411us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b18002df5e0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c23a 00007f6e912c6a2a
0709 12:24:06.008787 (+388411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:06.008899 (+   112us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:06.008999 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.009128 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.012312 (+  3184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18454,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":30218,"raft.queue_time_us":118,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":137,"spinlock_wait_cycles":88820608,"thread_start_us":387977,"threads_started":1}
I20260709 12:24:06.049250 31433 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.049531   887 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.050547   951 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:06.053830   993 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:24:06.054527   592 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:06.039492 32082 rpcz_store.cc:269] 0709 12:24:04.653655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.653783 (+   128us) service_pool.cc:224] Handling call
0709 12:24:05.917602 (+1263819us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:06.030224 (+112622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18424576}
I20260709 12:24:06.047823   568 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.060334   968 consensus_queue.cc:1059] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:06.065357 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.029001   998 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:06.072944 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 57043.7us
I20260709 12:24:06.051148 31433 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.019658 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:06.018424   972 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.087221   872 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.060251 31359 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.064392   887 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.095824  1005 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.096354  1005 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.096748  1005 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.096805   968 raft_consensus.cc:3055] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:06.098021 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 94395.8us
I20260709 12:24:06.097488   968 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:06.094509 31469 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.033s	sys 0.017s
W20260709 12:24:06.105011 31469 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.033s	sys 0.017s
W20260709 12:24:06.107880 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 47830.6us
I20260709 12:24:06.103734   771 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.092386   542 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.116792   659 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.117247 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1497) took 2000 ms. Trace:
I20260709 12:24:06.117817 31388 rpcz_store.cc:276] 0709 12:24:04.114232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.114418 (+   186us) service_pool.cc:224] Handling call
0709 12:24:04.114650 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.114809 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:04.384839 (+270030us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.511052 (+1126213us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b180012b1a0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cc455 00007f6e94cb43c7 00007f6e912c69a7 00007f6e912d60bf 00007f6e912d6038
0709 12:24:05.969481 (+458429us) log.cc:844] Serialized 14 byte log entry
0709 12:24:06.098799 (+129318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:06.100709 (+  1910us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:06.106709 (+  6000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.111061 (+  4352us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.114208 (+  3147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23714,"prepare.queue_time_us":31267,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":29822,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":6528,"spinlock_wait_cycles":10365824,"thread_start_us":806720,"threads_started":3,"wal-append.queue_time_us":540361,"wal-append.run_cpu_time_us":1419,"wal-append.run_wall_time_us":1003166}
W20260709 12:24:06.118255 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.124998   872 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.118288   771 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.108351   592 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.109864   393 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.127857   636 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:06.127663   644 consensus_queue.cc:1059] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:24:06.128883 31394 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.131397 31361 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.132916 31391 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.118183   998 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.116827   950 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:06.139858 31392 raft_consensus.cc:2393] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:06.151213 31540 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:06.153245 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 102235us
I20260709 12:24:06.155414 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.156199 31536 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.157557 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:06.151542   644 raft_consensus.cc:3055] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.167405   771 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.168180 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.168493 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.171267   969 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:06.171726   969 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:06.171664 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.172396   969 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.171128 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.175149   950 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:06.177886   962 log.cc:927] Time spent T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.889s	user 0.000s	sys 0.003s
I20260709 12:24:06.179193   998 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.180624   857 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.182736   954 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.183307   954 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.187665   393 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:06.187433   968 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.188866   968 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.188548   393 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.191206 31536 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:06.191774 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.192293   659 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.192946   659 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.193218 31361 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.194233   972 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.163115   990 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.197389   393 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.197548 31538 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:06.194952   998 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.169526   644 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:06.198688 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.201785 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.202893   950 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.204083 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.204959 31390 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:06.145728   636 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:06.209146   857 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:06.209432 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.209898   857 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.210244   771 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:06.210960   771 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.212206   857 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.213147   771 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.214073   990 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:06.214778   990 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.210033   950 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:06.215816 31541 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:06.217101   990 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.217010   644 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.211378 32047 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.210979 32082 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:06.218624   644 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.216958   767 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.225222 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.226049 31544 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:06.227324 31541 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:06.227707 31541 pending_rounds.cc:85] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 3
I20260709 12:24:06.231873   966 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:06.228717 31541 pending_rounds.cc:107] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:06.233909 31541 raft_consensus.cc:2889] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:06.209259  1005 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.236886 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.237332 31543 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:06.232996 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:06.240979   836 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.241796   373 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:06.241750   836 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.242442   373 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.243692 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.244964 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.245622 31540 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:06.246136 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.249420   970 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:06.250211   970 consensus_queue.cc:1059] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:06.251387 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.251507   763 raft_consensus.cc:3055] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:06.251556 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.252067   763 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:06.252403 32082 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:06.252977 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.253226   763 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.253816 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.254412 31541 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:06.255400   998 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.255515 32047 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.256040   998 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.256858   463 consensus_queue.cc:1059] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:06.258242   463 raft_consensus.cc:3055] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.258479   998 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.258607   463 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:06.259451 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.256636   373 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.261458 31359 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:06.253332 31510 connection.cc:256] RPC call timeout handler was delayed by -1.1978590399999121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 12:24:06.256716   997 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.267293 32082 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.267457   997 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:06.267622 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 74614.3us
I20260709 12:24:06.267939   997 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.268700 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:06.267474   659 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.270612   636 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:06.264138 31510 connection.cc:256] RPC call timeout handler was delayed by -1.1294590399998015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 12:24:06.272521 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.274493 31292 catalog_manager.cc:5697] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 3, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 3 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.276320 31535 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:05.411612 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.273687 32047 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:06.275189   836 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.275353   871 raft_consensus.cc:3055] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:06.272716   990 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.281718   880 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:06.282064   787 tablet_copy_client.cc:538] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:06.282648   373 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.282575   990 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.284960   871 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:06.285066   990 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.286159   871 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.289489 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.282648   880 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.291751   880 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.293143   990 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:06.291657 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 43656.1us
I20260709 12:24:06.261184   463 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:06.297551 31291 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38044 (request call id 248) took 17467 ms (client timeout 15000 ms). Trace:
I20260709 12:24:06.281730   393 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.280618   636 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.301044 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.300549   463 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.305217 31434 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.304342 31292 catalog_manager.cc:5697] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 3 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.309566 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.309430 31292 catalog_manager.cc:5697] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.302055   871 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:06.313572 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 143077us
I20260709 12:24:06.312805 31292 catalog_manager.cc:5697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.314428   925 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:06.318233 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.327296 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.318933   954 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.328161 31538 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.328547 31465 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:06.328713   925 raft_consensus.cc:697] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:06.330006 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.329967   925 consensus_queue.cc:237] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:06.317611   960 log.cc:927] Time spent T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 1.031s	user 0.003s	sys 0.000s
I20260709 12:24:06.332049 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.314571   951 consensus_queue.cc:1059] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:24:06.333323   813 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.333482   951 raft_consensus.cc:3055] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:06.333982   951 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:06.334024   813 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.334749 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.302384   836 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:06.281334   998 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:24:06.314913 31434 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:06.338465 31465 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:06.359558 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.358356 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:06.337626 31510 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:06.361129 31389 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.344578 31544 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:06.364801 31538 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:06.352484 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.306155 31537 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:06.348186 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:06.352366 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.373522 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.354920   787 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:24:06.377278   836 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.377898 31510 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:06.378921 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.379139 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.335165   951 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.353019   763 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.326424   542 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.382664 31395 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:06.336566   813 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.340103  1005 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.366933   990 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.341178   829 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.319919   711 consensus_queue.cc:1059] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:24:06.340595 31292 catalog_manager.cc:5697] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 4, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 4 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.389377   393 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:06.389289   941 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:06.390360   834 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.391592 31387 raft_consensus.cc:2393] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 2: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:06.382587   659 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:06.392419   836 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.390695 32047 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:06.393985 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:06.299746 31291 rpcz_store.cc:269] 0709 12:23:48.828988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.829114 (+   126us) service_pool.cc:224] Handling call
0709 12:24:06.296204 (+17467090us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:59.286675 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:59.791568 (+504893us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:59.819376 (+ 27808us) write_op.cc:435] Acquired schema lock
0709 12:23:59.831246 (+ 11870us) tablet.cc:662] Decoding operations
0709 12:23:59.930822 (+ 99576us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:59.930923 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:59.930965 (+    42us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:23:59.931637 (+   672us) tablet.cc:701] Row locks acquired
0709 12:23:59.931662 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:23:59.931843 (+   181us) write_op.cc:270] Start()
0709 12:23:59.931963 (+   120us) write_op.cc:276] Timestamp: P: 1783599839931788 usec, L: 0
0709 12:23:59.931992 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:23:59.979372 (+ 47380us) log.cc:844] Serialized 2089 byte log entry
0709 12:24:01.345651 (+1366279us) op_driver.cc:464] REPLICATION: finished
0709 12:24:02.177200 (+831549us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e8e1b20ac 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e94cf2ef0
0709 12:24:02.632228 (+455028us) write_op.cc:301] APPLY: starting
0709 12:24:02.632333 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:02.632531 (+   198us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:02.632561 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:02.805708 (+173147us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:02.805906 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:24:02.805954 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:02.806209 (+   255us) log.cc:844] Serialized 47 byte log entry
0709 12:24:02.828495 (+ 22286us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:02.861608 (+ 33113us) write_op.cc:454] Released schema lock
0709 12:24:02.865371 (+  3763us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:02.909654 (+ 44283us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:02.912103 (+  2449us) write_op.cc:454] Released schema lock
0709 12:24:03.171900 (+259797us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b18000db460. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
Metrics: {"mutex_wait_us":251734,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":1278421,"apply.run_cpu_time_us":4435,"apply.run_wall_time_us":240164,"num_ops":5,"prepare.queue_time_us":203491,"prepare.run_cpu_time_us":30534,"prepare.run_wall_time_us":841820,"raft.queue_time_us":734312,"raft.run_cpu_time_us":33791,"raft.run_wall_time_us":1280154,"replication_time_us":1388096,"spinlock_wait_cycles":103339008,"thread_start_us":2063388,"threads_started":5,"wal-append.queue_time_us":446345,"wal-append.run_cpu_time_us":36553,"wal-append.run_wall_time_us":3001473}]]}
W20260709 12:24:06.395326 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 80495.7us
I20260709 12:24:06.385735 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.408185 31469 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:06.355206   969 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.413206   902 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:06.413482 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.413938   902 raft_consensus.cc:697] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:06.414575 31461 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:06.405514   393 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:06.413292   659 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.404341   872 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.415788 31507 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.365597   997 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.388659   880 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.425563 31434 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.416258   941 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:06.423739   990 raft_consensus.cc:3055] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:06.416079   830 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:24:06.424410 31292 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:06.439616 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.440622 31292 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 4, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 4 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.441673   941 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.415616   393 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.415482   848 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:06.431218 32082 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:06.431849 31510 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:06.425535   813 consensus_queue.cc:1059] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:24:06.423622   950 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:06.432806   987 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:06.433429 31507 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.432727 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.434173 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:06.436841 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.437358 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.438158 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.438310 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.430137   990 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:06.501040 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:06.486035 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 167960us
W20260709 12:24:06.497001 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.448091 31466 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:06.503854 31392 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.502019 31468 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
W20260709 12:24:06.505754 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 73109us
I20260709 12:24:06.449416 31359 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.454936 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:06.507768 32084 raft_consensus.cc:2393] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:06.519179 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.520045 32077 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:06.521595 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.443178 31292 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:06.446183   951 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.530409 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.531754 31462 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
W20260709 12:24:06.539722 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.532949 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 83610.5us
W20260709 12:24:06.534466 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.437376   925 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:06.443346   880 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.450313 31387 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:06.502110   950 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:06.502018   987 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:06.547756 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.548022 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:06.445755   659 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.549837 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:06.551155 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:06.551324 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.552196   668 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:06.415182   902 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:06.552862 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.554309   998 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:06.520114   969 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.572494 31292 catalog_manager.cc:5697] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.584585   998 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.556730 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.586364 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.586990 31395 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:06.587540 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.588025 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.558385 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.588819 31390 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:06.589804   942 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.585361 31292 catalog_manager.cc:5697] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.590418   942 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.558099 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.590969   393 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.591506 31386 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:06.592046 31461 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:06.591609 31292 catalog_manager.cc:5697] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 3 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.592846   942 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.559854 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.561265 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.561179   990 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.593722 31394 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:06.594108 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.594410   990 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.594782 31540 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.561700 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.523460   834 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.530856   836 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.596585   836 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:06.595248 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 163556us
I20260709 12:24:06.598771   836 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.563197 31389 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:06.568820 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:06.572845 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 139500us
I20260709 12:24:06.601045 31395 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.572429 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.565635 31433 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.578706 31464 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.545578   542 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:06.580140   676 raft_consensus.cc:2764] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:06.581420 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.615000   668 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:06.617877 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.618063   969 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.618597   969 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:06.581699 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.575176   950 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.575937   987 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.588155 31542 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.589736 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:06.624985   971 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:06.516278   872 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:06.560560  1014 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:24:06.593568 31391 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:06.565824   644 consensus_queue.cc:1059] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:24:06.603087 31540 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:06.567842   830 raft_consensus.cc:3055] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.632547 31359 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.586912   998 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.581796 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.619215   542 raft_consensus.cc:697] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:06.619086   969 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.595829 31292 catalog_manager.cc:5697] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:24:06.605369 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.546945   925 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:06.629880 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.565923   463 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 12:24:06.634236 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 65494.4us
I20260709 12:24:06.636525 31538 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.621443 31466 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.636443 31507 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.619019   668 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.641466   925 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.646087 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.646819 31387 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:06.647389   652 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:06.648767   676 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.649169   676 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.649556   676 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.641474 32078 raft_consensus.cc:2393] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:06.633140   836 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:06.652621 32047 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:06.651088 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 85548.9us
W20260709 12:24:06.653618 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.632095   971 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:06.632328   830 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:06.652513 31292 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 1 to 3, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 3 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:06.652438   997 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:06.663911 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 43935.8us
W20260709 12:24:06.660189 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.639045 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.639339   393 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.667963   689 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:06.665210   568 consensus_queue.cc:1059] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:06.668514   689 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:06.668959   689 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.669065   568 raft_consensus.cc:3055] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:06.669530   568 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:06.671422   944 consensus_queue.cc:1059] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.670516   568 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.654950   652 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:06.656383   880 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:06.640524   970 consensus_queue.cc:1059] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:24:06.679840 31542 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:24:06.678342   880 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.684520   880 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.692919 31433 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.695117 31469 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:06.696830 31359 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.699966 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:06.712286 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.672304   944 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:24:06.730419 31507 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.689565   954 raft_consensus.cc:3055] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.697064   568 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.680727   942 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:24:06.739508 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:06.738799 31538 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
W20260709 12:24:06.740499 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.750257 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:06.752737 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 50483.8us
I20260709 12:24:06.754674 32082 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:06.758430 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:06.759274 31542 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:06.759295  1017 log.cc:927] Time spent T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:24:06.760926 31463 raft_consensus.cc:1275] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.762337   506 raft_consensus.cc:2764] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:06.733083   968 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:06.701690   813 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:24:06.733088 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.771677 32076 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:06.771730 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:06.769456   998 raft_consensus.cc:3055] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:06.772627   998 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:06.773815 31461 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.773675   998 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.776539   998 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.777906   830 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.783867 31359 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.787081   636 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:06.738759   393 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.787573   636 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:06.788528   636 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.789094   972 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.789824   972 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.793541   972 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:06.691686   902 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 12:24:06.798146 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.800225 31466 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:06.733798   954 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:06.804963   871 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.806348   871 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.808219   652 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.808709 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:06.810770   871 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:06.811756 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:06.700774   941 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:24:06.813325   830 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.815750 31390 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:06.817305 32047 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.818048 31392 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
W20260709 12:24:06.818895 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 153522us
I20260709 12:24:06.682273   971 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:06.817022 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 61066us
I20260709 12:24:06.824373 32047 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.826314   813 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.826607 31464 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:06.830083 31461 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:06.831640 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.832520   872 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:06.833528  1018 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:24:06.833673 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:06.836109 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:06.832365 31466 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:06.830036 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.837532 31392 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:06.703377   542 consensus_queue.cc:237] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.841025 31395 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:06.827555   970 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:06.827762   968 raft_consensus.cc:697] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:06.852933 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.837524   871 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:06.854970 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:06.847987   925 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.857486 31461 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:06.859496 31466 raft_consensus.cc:2410] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:06.859886 31507 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:06.851071   998 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.855619   975 consensus_queue.cc:1059] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:24:06.813726   954 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:06.840790   880 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.846792   506 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:24:06.871883  1020 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:24:06.872984   950 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.874562   942 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:06.879562 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:06.860706   970 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:06.861871   871 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:24:06.885284 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.888810 31507 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:06.890407   968 consensus_queue.cc:237] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.890465   393 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:06.892671 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.892765   393 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.893556 31392 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:06.894627 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:06.898252 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:06.900786 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.901952 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:06.909396 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:06.883958   942 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:06.920673 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:06.922405 31466 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:06.924485 31387 raft_consensus.cc:1240] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:06.926307 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.932011 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:06.926594 31510 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:06.899646   393 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:06.941622 31390 raft_consensus.cc:2410] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:06.914506   676 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.897354   689 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.917814   902 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:06.948771 31507 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:06.949856   997 raft_consensus.cc:3055] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.932860   942 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.952176 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:06.924221   970 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:06.930401   767 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:06.957906 31393 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:06.933959   506 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.947444 32077 raft_consensus.cc:2393] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:06.958756 32047 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:06.913281   987 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:06.918301   941 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:24:06.964752 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:06.966794  1019 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:24:06.974252 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:06.978519 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.997807 31390 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:06.999066 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:06.999889 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 57093.1us
I20260709 12:24:06.999979 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.002276 31391 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:07.003741 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.005136   975 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:07.005342 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:07.005576   975 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.005977   975 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.006033 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:07.007025 32082 raft_consensus.cc:2410] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:07.009658 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:06.956947   997 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:07.003602 31392 raft_consensus.cc:2410] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:07.015192 31395 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.972751 31387 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:07.017768 31507 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.019559   676 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:07.020618   950 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.021528   925 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:07.005995 32081 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:07.023782 31386 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:07.024248   954 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.992513   506 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:07.027918  1021 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:24:07.028143 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:06.967168   849 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.991515   813 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:07.011442   711 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:07.040274 31507 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:07.028847   902 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.058442 31393 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.031564 32075 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:07.063905 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.068590 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:07.066428 31388 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:07.057089   506 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.060909   568 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.057390   659 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:07.032075   767 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.104838 31392 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:07.067133   644 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:07.105721 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.092036   848 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:07.067171   972 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:07.012264   871 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.078915   676 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.087291 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.115126 31461 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:07.115965 31507 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:07.093137   830 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.106737   659 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.126368 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:07.123522 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.111651   848 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.116868   925 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.127101 31538 raft_consensus.cc:2368] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6.
I20260709 12:24:07.087963   711 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.127329 31466 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:24:07.120568   393 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:24:07.128412 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:07.114705   880 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:07.118923   941 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:07.136914 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:07.133198 32050 leader_election.cc:336] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.544s (SENT)
I20260709 12:24:07.118613   830 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.139477 32050 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:07.145399 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:07.111064   568 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.128012 32078 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:07.129741   848 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.129076   659 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.138525 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:07.161406 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:07.118781   972 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.161556 31544 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:07.161432  1005 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.142206   941 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.169795 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:07.146696   830 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.128484   644 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.174013 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:07.179646 32080 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.138048   925 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.162071   689 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.125351   997 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.173383   941 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.174486   676 raft_consensus.cc:2764] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:24:07.207863 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 80959us
W20260709 12:24:07.212126 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 49204.5us
I20260709 12:24:07.199749 31537 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:07.248700 32050 leader_election.cc:336] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.612s (SENT)
I20260709 12:24:07.249426 32050 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:07.272369 31542 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
W20260709 12:24:07.278726 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 65802.2us
I20260709 12:24:07.280618 31436 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:07.294260 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 79169.8us
I20260709 12:24:07.294994 32084 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:07.299436 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 167792us
I20260709 12:24:07.302755 31434 leader_election.cc:400] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6.
I20260709 12:24:07.303267 31434 leader_election.cc:403] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:07.282122  1005 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:07.306334 32050 leader_election.cc:336] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.630s (SENT)
W20260709 12:24:07.306728 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.311739 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:07.306200 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:07.295668   997 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.293980   975 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.317286 32050 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:07.319854  1032 log.cc:927] Time spent T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:24:07.320595  1042 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.304535   767 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:07.323800 32080 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:07.325125   902 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:07.329399   373 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:07.309860  1025 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:24:07.267776  1037 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:24:07.344743   848 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:07.365190 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 58909.6us
W20260709 12:24:07.372959 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:07.358703  1028 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:24:07.346634  1042 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.346978   711 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:07.358132   767 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.355024   902 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.316959   942 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.360189   880 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.362723   836 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:07.357960   506 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.362818   373 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.392629   972 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:07.382673  1042 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.405998   373 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:07.394150   987 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.407455   848 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:07.409605   925 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:07.412583   942 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.421072 31393 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:07.422454 31391 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:07.424118 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 112464us
I20260709 12:24:07.425236 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:07.426054 31434 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:07.420112   951 consensus_meta.cc:287] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.003s
I20260709 12:24:07.433585 32047 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:07.424507   373 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.437089 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:07.437158   659 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.437842 31394 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.443539 31434 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.444810   373 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.447220   373 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:07.444801   659 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.447214   830 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.448849 31540 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:07.449465   373 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.449568 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:07.450642   373 raft_consensus.cc:697] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:07.451440   540 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:07.453399   373 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.429306  1040 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.464284 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:07.464915 31389 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.469900   951 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:07.433563   969 consensus_meta.cc:287] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.790s	user 0.004s	sys 0.008s
I20260709 12:24:07.477172 31389 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:07.481928 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:07.482892 31389 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:07.486654 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:07.487114 31507 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.488032 32077 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:07.481678  1040 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:07.488879   944 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:07.489456   944 raft_consensus.cc:697] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:07.489650 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:07.490808 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.492070 31464 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:07.492551 31469 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:07.488899  1040 raft_consensus.cc:697] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:07.476718  1033 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:07.493288 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:07.493815  1033 raft_consensus.cc:697] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:07.494429 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:07.494863  1033 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.496215 31468 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:07.493963  1040 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.497550   836 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.497665 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:07.490507   944 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.498152   836 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.501344 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:07.498919 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:07.501820   998 consensus_meta.cc:287] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.001s
I20260709 12:24:07.502135 31393 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.502230   998 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:07.502633 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.482957   969 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.504305 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:07.509155 31389 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:07.505259 31467 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:07.503939 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:07.511780 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:07.503799   506 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.513244 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.513855 31462 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:07.511971 31544 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:07.508749 31394 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:07.516696 31393 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
W20260709 12:24:07.516899 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.519822 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:07.520540 31394 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:07.525523 31361 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:07.515027 31387 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.526713 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:07.526849 31538 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:07.507126   767 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6.
I20260709 12:24:07.531797 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:07.532097 31539 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:07.532711 31389 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.537672 31463 raft_consensus.cc:2368] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6.
I20260709 12:24:07.539343 31393 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:24:07.503199   941 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.542680 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:07.543280 31390 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.544814 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.546170 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.536195   998 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:07.545500 31462 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:07.548951 31507 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.546265 31389 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:07.549877 31507 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.568439 31543 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:07.549926   942 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:07.572945 31390 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:07.568935 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.576555 31467 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:24:07.572139 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.580516 31507 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.586457 31389 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:07.586998  1037 consensus_queue.cc:1059] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:07.587316  1038 consensus_queue.cc:1059] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:24:07.588251  1037 raft_consensus.cc:3055] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:07.588626  1037 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:07.590044 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:07.591439 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.550658   849 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.549043   998 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.598832 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.582875   659 consensus_queue.cc:1059] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:24:07.598537  1030 consensus_queue.cc:1059] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:07.582271   848 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:07.589406   813 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.589412   987 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:07.596143   942 raft_consensus.cc:697] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:07.578821   767 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:24:07.579059   951 consensus_queue.cc:1059] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:07.598749   849 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.601812   998 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.614987 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.605528   848 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:07.617720 31467 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:07.620327 32083 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:07.620365   987 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:07.546912 31535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:07.621726   987 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.623167   568 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.597133  1040 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:24:07.618980 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:07.619000   813 raft_consensus.cc:697] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:07.613003   849 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.628778 31544 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:07.628927   659 raft_consensus.cc:3055] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:07.629436   969 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:07.631394 31387 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:07.633705 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:07.624788   848 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.673043 32084 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:07.619200   954 raft_consensus.cc:3055] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:07.653618   941 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.657073  1049 raft_consensus.cc:3055] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:07.659452 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 359098us
I20260709 12:24:07.661325 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:07.663563   836 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:07.621737 31535 raft_consensus.cc:606] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:07.600495  1037 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.670639   830 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:07.706086 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.707585 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:07.635852   659 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:07.754179 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:07.726799 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:07.637161 31466 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:07.756404  1041 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.462s	user 0.003s	sys 0.001s
I20260709 12:24:07.757676 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:07.724921 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 73968.6us
I20260709 12:24:07.746023 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:07.693960 32077 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.631415   902 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.741380   568 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:24:07.751613   813 consensus_queue.cc:237] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.751899   969 consensus_queue.cc:1048] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:07.752810   941 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.719820  1049 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:07.695560   767 raft_consensus.cc:3055] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:07.694618   954 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:07.764482  1035 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:07.667455   849 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.765381 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:07.743507   942 consensus_queue.cc:237] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.767342 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:07.773631 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:07.759002 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:07.772756   830 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:07.793125 32081 raft_consensus.cc:2393] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:07.793884 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:07.794485 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:07.795579  1034 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:07.785166 32078 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:07.792448   941 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:07.798609 32079 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.798619 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:07.802232   944 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:07.787988   767 raft_consensus.cc:740] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:07.808900 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:07.794957  1037 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.816720 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.816999   954 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.817687   902 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:07.823666 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:07.799721  1033 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.827939 31361 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:07.799782  1040 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.796891  1035 raft_consensus.cc:697] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:07.803439   652 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:07.805271 31386 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.833771 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:07.832720   373 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.825685 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.818802   540 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:07.828948  1048 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.854050 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.859875 31462 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:07.806404   830 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.828997 31536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:07.854846 31390 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:07.865105 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.864951   767 consensus_queue.cc:260] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.865896 31470 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
W20260709 12:24:07.866547 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:07.869609  1056 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:24:07.871342  1035 consensus_queue.cc:237] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.855296   969 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.869537 31536 raft_consensus.cc:606] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:07.832260   990 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:24:07.866852 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.851501   944 consensus_queue.cc:1243] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:07.880008 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:07.885485 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:07.866480   767 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.856774   540 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:07.818364  1049 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:07.889722   941 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.890858 32077 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:07.891754   849 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:07.844161  1040 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.893870  1040 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:07.895203 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:07.875759  1038 raft_consensus.cc:3055] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:07.895900  1038 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:07.914938 32083 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:07.920471 31539 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 7. Ops: []
I20260709 12:24:07.889688  1049 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.835820  1033 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:07.927285 31536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:07.927961 31536 raft_consensus.cc:606] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:07.936039  1065 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:24:07.886329   954 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.948171 31394 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:07.897784   540 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:07.952658 31394 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:07.959720 31470 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:24:07.960075 31436 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:07.965518 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 137732us
I20260709 12:24:07.956246   975 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:08.015020 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:08.015286 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:08.015985 31470 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:08.020486  1061 raft_consensus.cc:3055] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:08.021049  1061 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:08.022121  1061 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.024659  1061 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.044741 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:08.046582 31541 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:08.049342 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:08.051357 32050 leader_election.cc:336] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 2.170s (SENT)
I20260709 12:24:08.051931 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:08.052126 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:08.053856 31540 raft_consensus.cc:2393] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:08.028357 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:08.033655   813 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.035620 31393 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.036962 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:08.098178 31467 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.038157 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:08.040359   689 raft_consensus.cc:3055] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.090161 31394 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.088792 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:07.896867  1038 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:08.100909 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 140916us
W20260709 12:24:08.100041 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 149005us
I20260709 12:24:08.012909   652 raft_consensus.cc:697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:08.107859 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:08.108441 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:08.114814 31470 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.100766   689 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:08.095798   990 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:08.110467 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:08.113405 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.120360 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.120585 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.121004 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.122807 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.125901 31510 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:08.127024 31542 raft_consensus.cc:1275] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.127451 31388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:24:08.128201 31388 raft_consensus.cc:606] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:08.128600 31388 raft_consensus.cc:614] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:08.129518 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:08.130223 31392 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.150437 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:08.155890 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:08.179275 31510 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:08.105695   373 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.106014   711 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.107266   463 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:08.105851  1034 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:08.120072   990 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:08.155675   787 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:08.150959   942 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:08.180541  1055 log.cc:927] Time spent T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:08.155480   568 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:08.108444  1069 consensus_queue.cc:1059] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.216s
I20260709 12:24:08.113266   813 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:08.333709 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.189719   902 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:08.339087 31542 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:08.190976  1038 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.339144 31392 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:08.172761  1037 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.270486   990 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:08.363109 31542 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:08.363524 31542 pending_rounds.cc:85] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 6
I20260709 12:24:08.363739 31542 pending_rounds.cc:107] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:08.363987 31542 raft_consensus.cc:2889] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.370229 31541 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:08.336874   568 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:08.195748   373 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.198436   711 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.375092 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:08.378532 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 327203us
I20260709 12:24:08.378892 31461 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.271387  1034 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.261199   463 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:08.376066   568 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.381135 32083 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:08.306106   689 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:08.383958 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:08.385954 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:08.439669 31464 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:08.397298   659 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:08.405057 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:08.405268 31542 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:08.407610 31540 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:08.372668   969 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.409595 32077 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:24:08.413025   644 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:08.413338  1073 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
W20260709 12:24:08.414621  1076 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:24:08.420729   925 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.424160 31433 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:08.425983  1047 consensus_queue.cc:1059] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:08.435842 31470 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:08.438084  1040 consensus_queue.cc:1059] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:08.438321   463 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:08.495532 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.408149  1039 raft_consensus.cc:3055] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.421577  1071 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:08.447607 32079 consensus_meta.cc:287] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.612s	user 0.001s	sys 0.009s
I20260709 12:24:08.535784 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:08.448362  1075 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 12:24:08.368669  1037 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:08.449820  1042 consensus_meta.cc:287] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.021s	user 0.006s	sys 0.006s
I20260709 12:24:08.532785 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:08.565055 31461 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:08.439723   950 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:24:08.519007   941 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:08.585916 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.612597 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:08.516942   969 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.369230   652 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:08.560344 31386 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.698s	user 0.005s	sys 0.005s
I20260709 12:24:08.528508  1039 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:08.610234 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1499) took 1579 ms. Trace:
I20260709 12:24:08.673539 31391 rpcz_store.cc:276] 0709 12:24:07.030461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.104177 (+ 73716us) service_pool.cc:224] Handling call
0709 12:24:07.422220 (+318043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.423122 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.610057 (+1186935us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b540028c150. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:08.610176 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730579712}
I20260709 12:24:08.610563 31466 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:24:08.610965 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 169090us
I20260709 12:24:08.527787   942 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.612948 31393 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:08.613274 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.530505   925 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:08.621033 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 196969us
I20260709 12:24:08.680259 31433 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:08.620781 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:08.615518 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 169240us
I20260709 12:24:08.614540 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:08.535429 32079 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:08.566712  1033 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:08.675992 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.613298 31461 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:08.686866 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:08.613440  1085 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:08.540609  1035 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
I20260709 12:24:08.614256  1040 consensus_queue.cc:1243] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:08.673619   787 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:08.598613   975 consensus_queue.cc:1059] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:24:08.669688   902 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.699642 31464 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:08.702338 31461 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:24:08.698132 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:08.597734  1042 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:08.704138 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 206544us
I20260709 12:24:08.598203   971 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 12:24:08.722828 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 108425us
W20260709 12:24:08.724916 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 216442us
I20260709 12:24:08.725291 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:08.726233 31391 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:08.726513 31392 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:08.674219 31386 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:08.685132   872 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.698065  1063 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.698171  1074 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.725222 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:08.734103 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:08.731650 31395 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 7. Ops: []
I20260709 12:24:08.740900 31388 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:08.689540  1085 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:08.736279 31433 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:08.744799 31464 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:08.620409   941 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:08.747869 31468 raft_consensus.cc:2368] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6.
W20260709 12:24:08.733508  1082 log.cc:927] Time spent T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 12:24:08.752331 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.753472  1097 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:08.779640 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 54492.7us
W20260709 12:24:08.781390 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 55584.6us
W20260709 12:24:08.757908   998 consensus_meta.cc:287] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.138s	user 0.002s	sys 0.006s
W20260709 12:24:08.745163  1078 log.cc:927] Time spent T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.383s	user 0.001s	sys 0.001s
I20260709 12:24:08.743417   636 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:08.761482  1091 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:08.762427   711 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:08.697800  1033 consensus_queue.cc:1059] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:24:08.747287  1030 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.763780 32077 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:08.765174   990 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:08.767146  1042 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:08.684819   942 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.768018  1035 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.737884  1039 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:08.771989  1095 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.773470   925 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:08.757581   568 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:08.784615 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 48439.8us
I20260709 12:24:08.844638 31433 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:08.741317   975 consensus_queue.cc:1243] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:08.739451 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1540) took 1085 ms. Trace:
I20260709 12:24:08.791453   849 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.748839  1085 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.777527   813 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:08.791724 31540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:08.830308 32050 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:08.867103 31540 raft_consensus.cc:606] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:08.867771 31540 raft_consensus.cc:614] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:08.867892 32050 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:08.727869   902 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:08.852789   990 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:08.858229   787 tablet_bootstrap.cc:492] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:24:08.786859   373 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:08.787756  1091 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:08.836571  1040 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:08.858144 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 72339.8us
I20260709 12:24:08.849725   971 raft_consensus.cc:3055] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:08.909641 31542 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:08.921897   971 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:08.785386   998 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:08.856770 31467 consensus_meta.cc:287] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.001s
I20260709 12:24:08.927876 31467 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:08.928483 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1534) took 1002 ms. Trace:
W20260709 12:24:08.860569   767 consensus_meta.cc:287] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.971s	user 0.012s	sys 0.000s
I20260709 12:24:08.848522  1034 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:08.912506 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 44713.2us
I20260709 12:24:08.745714  1063 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.918557 31433 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:08.930274 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:08.855707  1099 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:08.928839 31467 rpcz_store.cc:276] 0709 12:24:07.926128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.036612 (+110484us) service_pool.cc:224] Handling call
0709 12:24:08.928415 (+891803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:08.937531 32050 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:08.847864   950 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:24:08.912190   975 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:08.914624   711 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:08.921592  1091 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.974692 31389 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.856937  1030 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.920135   968 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:08.879369   849 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.921461  1033 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:08.923913   925 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.914439   813 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:24:08.962184  1097 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.017575 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:08.935021  1037 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:08.994463 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:09.013891 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 103018us
I20260709 12:24:08.858820 31386 rpcz_store.cc:276] 0709 12:24:07.653792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.758732 (+104940us) service_pool.cc:224] Handling call
0709 12:24:08.733858 (+975126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:08.982995   787 ts_tablet_manager.cc:1403] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 2.629s	user 0.043s	sys 0.012s
W20260709 12:24:09.002677   954 consensus_meta.cc:287] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.047s	user 0.012s	sys 0.000s
I20260709 12:24:09.033679 31467 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:09.064419 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:08.972857   373 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:09.034574 31433 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:09.065284 31541 raft_consensus.cc:2410] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:24:09.013309   540 consensus_meta.cc:287] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.049s	user 0.011s	sys 0.000s
I20260709 12:24:08.969871 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:09.018436 31543 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:08.908507  1095 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:08.933475  1040 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:08.975821   990 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:09.002270  1099 raft_consensus.cc:697] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:08.971688   975 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:08.978693   767 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.005275   969 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.005622  1033 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:24:09.081265 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 111792us
I20260709 12:24:09.034430  1034 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:09.079777 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 45319us
I20260709 12:24:09.153649 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:09.091900 31467 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:09.002070   711 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:08.963359  1106 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 12:24:09.012686   968 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.178411   968 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.151654 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:09.095532   975 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:09.071710   373 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.156848 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1505) took 1508 ms. Trace:
I20260709 12:24:09.097040   925 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.169020 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.184341 31467 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:09.154692 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:09.171875 31537 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:24:09.183319 31395 rpcz_store.cc:276] 0709 12:24:07.648622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.032543 (+383921us) service_pool.cc:224] Handling call
0709 12:24:08.731479 (+698936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.740246 (+  8767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.156586 (+416340us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54000942d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:09.156769 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606559104}
I20260709 12:24:09.037176  1097 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.143088  1033 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:09.172793  1103 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:09.173370   711 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.174415 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1530) took 1311 ms. Trace:
I20260709 12:24:09.195487 31537 pending_rounds.cc:85] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 1
I20260709 12:24:09.174917  1104 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:09.175367  1096 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:09.176213  1037 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.174342  1113 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.168676  1094 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.187220 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:09.059926  1098 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.368s
I20260709 12:24:09.170096  1079 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.285s
I20260709 12:24:09.074817   540 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.202992 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.218087 31467 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:09.204170 31433 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:09.084985   990 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.184832   941 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.189884   950 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.181972  1034 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:09.205799   568 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:09.211467  1047 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:09.208210 32050 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.811s (SENT) [suppressed 24 similar messages]
I20260709 12:24:09.094842  1100 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.342s
I20260709 12:24:09.244388  1095 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.246196   659 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.217772   813 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:09.249514  1063 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.249912   813 raft_consensus.cc:697] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:09.250375  1089 log.cc:927] Time spent T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.571s	user 0.000s	sys 0.003s
I20260709 12:24:09.250988   813 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.206938 31537 pending_rounds.cc:107] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 12:24:09.222186 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 440088us
I20260709 12:24:09.204977 31466 rpcz_store.cc:276] 0709 12:24:07.863395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.774238 (+910843us) service_pool.cc:224] Handling call
0709 12:24:08.774609 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.783882 (+  9273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.783915 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.788225 (+  4310us) log.cc:844] Serialized 26 byte log entry
0709 12:24:09.075431 (+287206us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:09.075484 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.075585 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.174166 (+ 98581us) raft_consensus.cc:1685] finished
0709 12:24:09.174193 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.174350 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8806,"raft.queue_time_us":9445,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5933,"thread_start_us":212941,"threads_started":1,"wal-append.queue_time_us":337013}
W20260709 12:24:09.213475 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 61926.3us
I20260709 12:24:09.259083 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:09.230062  1048 consensus_meta.cc:287] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.368s	user 0.003s	sys 0.010s
I20260709 12:24:09.230372 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:09.227269  1097 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.233361   990 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.203637   767 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:24:09.215668 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:09.234275  1091 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.238876   849 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:09.281128 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 77028.8us
I20260709 12:24:09.211185  1096 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:09.255892 31390 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:09.276913  1061 consensus_meta.cc:287] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.226s	user 0.008s	sys 0.005s
I20260709 12:24:09.214222   902 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:09.265964 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:09.268023 32083 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.231600  1034 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.258504 31537 raft_consensus.cc:2889] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:09.269253  1108 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:09.270290  1084 raft_consensus.cc:3055] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:09.270457 31507 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:09.291183 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:09.218381  1113 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.271241   941 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:09.272396   540 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.273590   373 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.222900   998 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.280113 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.290081  1084 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:09.295760  1110 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:09.296213 31466 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:09.280301 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.260191 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:09.297003 31467 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:09.214756  1104 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:09.287986  1038 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.928s	user 0.013s	sys 0.000s
W20260709 12:24:09.284718 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 76541.5us
I20260709 12:24:09.267779  1063 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.299649  1110 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:09.299911  1063 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.300750  1110 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.255061  1030 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:09.277694  1048 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.306161  1063 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.305924   787 raft_consensus.cc:359] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:09.294378 31433 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:09.307644 31433 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:09.290553   902 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:09.293874 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:09.286456  1096 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.289152 31537 pending_rounds.cc:107] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:09.301257  1113 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.286036 32082 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:09.302631 31540 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:09.319033 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.319727  1091 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.298338   568 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:09.325071  1119 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.321859 31537 raft_consensus.cc:2889] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:09.325730  1119 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.326185  1112 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.304656  1069 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:09.306244   951 raft_consensus.cc:3055] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:09.229305   950 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.220933  1094 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.339126 31388 raft_consensus.cc:1275] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:09.339442 32083 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:09.339744 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:09.293530   848 consensus_meta.cc:287] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.582s	user 0.009s	sys 0.004s
I20260709 12:24:09.306845   787 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:24:09.311475 31393 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:09.327045   568 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:09.322834 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.356243 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.328245 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.357906 31466 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:09.358021 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.315076  1079 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.326720  1112 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.329771 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.330562  1119 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.336182  1069 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:09.220028  1099 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.298791  1108 raft_consensus.cc:697] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:09.332360 31359 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:09.296536   849 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:09.304661  1084 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.308738 31433 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:09.309049 31465 raft_consensus.cc:2410] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:09.295348   813 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:24:09.344585 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.384811 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:09.356060  1033 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.386070 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.386678 31387 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:09.389875  1063 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:09.345384 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.311522   902 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:09.315212  1061 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.397994 32075 raft_consensus.cc:3055] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:09.398411 32047 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:09.316259 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:09.321266 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.358639 31388 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:09.336035   951 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:09.335997  1048 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.361974 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.348150 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:09.331169  1120 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:24:09.364652 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.406571 31543 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 2.
W20260709 12:24:09.377700 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 45414.5us
I20260709 12:24:09.355715   393 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:09.381812 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 73140us
W20260709 12:24:09.395596 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.382923  1049 consensus_meta.cc:287] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.426s	user 0.012s	sys 0.000s
I20260709 12:24:09.396332 31507 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:09.397413   902 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:09.387091  1033 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.402041 32083 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:09.402698 31395 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:09.351020   848 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.404604 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:09.382112  1077 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:09.436249 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.436067 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.374958  1096 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.399044  1108 consensus_queue.cc:237] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.391654  1085 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.440065 31541 raft_consensus.cc:2410] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:24:09.414911 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.382146  1079 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.401067   997 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.398438 32075 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:09.448040 31361 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:09.413906  1100 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:09.403831  1119 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:09.440562 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44296.9us
I20260709 12:24:09.492980 31434 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:09.446800  1069 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.495137  1069 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:09.497965 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:09.448307  1049 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.470919 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.499408 31467 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:09.499621 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.491804 31507 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:09.500775 31388 raft_consensus.cc:2410] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:09.476507 31395 raft_consensus.cc:1240] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:09.501467 31507 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:09.414397  1084 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:09.438839  1037 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.436035  1061 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.447345  1077 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:09.517514 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 117018us
I20260709 12:24:09.488499 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.460949  1091 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:09.436450 31386 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:09.401268  1035 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:24:09.463253   925 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:09.514223 31466 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:09.382277   787 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:09.518700 32047 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:09.438431   393 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.447135  1042 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:24:09.497754   373 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:09.547468 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.533134 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.516422 31535 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:09.535760 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.555791 31395 raft_consensus.cc:2393] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:09.404250  1034 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:24:09.538760 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:09.539602 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.560170 31541 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:09.483529  1071 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:09.540968  1115 log.cc:927] Time spent T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.250s	user 0.001s	sys 0.001s
I20260709 12:24:09.557132 32075 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:09.543609 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 280509us
I20260709 12:24:09.465339  1063 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:24:09.498893 32077 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:09.400993  1093 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 12:24:09.413854  1048 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:09.535249 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 80560.2us
I20260709 12:24:09.519279  1061 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.508260  1100 raft_consensus.cc:697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:09.517136   941 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:09.614387   941 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.532397   540 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.554548   796 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:09.516037  1037 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.519480  1077 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.534722  1110 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:09.485129   997 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:09.557191  1088 log.cc:927] Time spent T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.940s	user 0.003s	sys 0.000s
I20260709 12:24:09.518113  1079 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:09.545074  1091 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.516120  1049 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:09.546628 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.435792  1117 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:24:09.566316 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.564155  1071 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:09.595559 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:09.659986  1085 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.546263   925 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.564729 32075 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:09.497613   836 consensus_queue.cc:1175] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "503bef451a2b424fa35e8e46b8c06f29" responder_term: 7 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:09.665601 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.650803   813 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:09.566426 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 73543.1us
I20260709 12:24:09.507959  1119 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.628491 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.629279 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1526) took 1807 ms. Trace:
W20260709 12:24:09.629761 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 140027us
I20260709 12:24:09.520030   951 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.633172   787 ts_tablet_manager.cc:1434] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.561s	user 0.008s	sys 0.029s
I20260709 12:24:09.559816   373 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:09.633291  1096 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:09.614926   941 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.595559 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.639730   796 raft_consensus.cc:697] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:09.651983  1092 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:09.629843  1104 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.656075   393 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.634617  1098 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:09.652110  1127 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:24:09.633998   540 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:09.659121  1107 log.cc:927] Time spent T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.460s	user 0.002s	sys 0.002s
I20260709 12:24:09.638772  1110 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.660706 31467 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:09.640523   849 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:09.661155 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:09.639195  1069 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.642980   668 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:09.713387 31468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 206) took 2214 ms (client timeout 2170 ms). Trace:
W20260709 12:24:09.713816 31468 rpcz_store.cc:269] 0709 12:24:07.499285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.503652 (+  4367us) service_pool.cc:224] Handling call
0709 12:24:09.713154 (+2209502us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002c6354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:09.713283 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2832390528}
I20260709 12:24:09.666338 31541 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:09.497844   568 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.650295  1030 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.654855  1091 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:09.652231  1129 consensus_queue.cc:1175] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "503bef451a2b424fa35e8e46b8c06f29" responder_term: 7 status { last_received { term: 5 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:09.727677   796 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.731114  1030 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.735746 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1524) took 1914 ms. Trace:
I20260709 12:24:09.736126 31462 rpcz_store.cc:276] 0709 12:24:07.821048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.896090 (+ 75042us) service_pool.cc:224] Handling call
0709 12:24:07.896386 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:07.896692 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.896719 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:07.897154 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.306781 (+409627us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:08.354944 (+ 48163us) log.cc:844] Serialized 14 byte log entry
0709 12:24:08.419882 (+ 64938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.420004 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.732117 (+1312113us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b1800410d40. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:09.735443 (+  3326us) raft_consensus.cc:1685] finished
0709 12:24:09.735550 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.735683 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196498,"prepare.queue_time_us":52281,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2950,"raft.queue_time_us":82521,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":7321,"spinlock_wait_cycles":12330752,"thread_start_us":409200,"threads_started":1,"wal-append.queue_time_us":540713}
I20260709 12:24:09.739249   971 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.740294   971 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.724579   668 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.669387   848 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:09.682363   813 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:09.683410  1123 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:24:09.683594   997 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:09.753464 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1481) took 1830 ms. Trace:
I20260709 12:24:09.754037 31535 rpcz_store.cc:276] 0709 12:24:07.923187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.925281 (+  2094us) service_pool.cc:224] Handling call
0709 12:24:07.925631 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.555175 (+1629544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.753125 (+197950us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400033c54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:09.753352 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3583521024}
I20260709 12:24:09.660920   950 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:09.756263 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.711290  1110 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:09.757763 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:09.656848   954 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:09.759537   954 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.668664 31464 rpcz_store.cc:276] 0709 12:24:07.821768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.768822 (+947054us) service_pool.cc:224] Handling call
0709 12:24:08.769179 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.934469 (+165290us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:09.031831 (+ 97362us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.196825 (+164994us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:09.206725 (+  9900us) log.cc:844] Serialized 26 byte log entry
0709 12:24:09.206891 (+   166us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:09.206924 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.206992 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.583456 (+376464us) raft_consensus.cc:1685] finished
0709 12:24:09.583483 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.629216 (+ 45733us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21515,"prepare.queue_time_us":40768,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":30924,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":32521,"thread_start_us":309807,"threads_started":3,"wal-append.queue_time_us":145248}
I20260709 12:24:09.688293  1101 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.763660  1101 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.764027 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:09.764580 31465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1532) took 1847 ms (client timeout 1712 ms). Trace:
I20260709 12:24:09.764879 31464 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:09.765697  1101 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.669762  1035 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.669993  1071 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.766225 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.766812  1071 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:09.680979   787 ts_tablet_manager.cc:1467] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Tablet startup took 617ms
I20260709 12:24:09.705693 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.690914   951 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.711181 31388 raft_consensus.cc:2368] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3.
I20260709 12:24:09.692852  1092 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.672303   975 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.706512  1049 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.725021 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.725546 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:09.655414  1079 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.767026 31464 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:09.781925 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.788646 31507 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:09.764997 31465 rpcz_store.cc:269] 0709 12:24:07.916841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.028025 (+111184us) service_pool.cc:224] Handling call
0709 12:24:09.764349 (+1736324us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001c98d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:09.764490 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2807282048}
I20260709 12:24:09.792366 31541 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:09.795403 31468 raft_consensus.cc:2410] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:09.813640 31433 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:09.689134  1100 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.764048  1039 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.818643 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.821018 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:09.824335 31464 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:09.791503  1092 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.827487 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.828405 31468 raft_consensus.cc:2410] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:09.726233  1069 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.767799   373 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.707621  1098 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.767467  1071 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.832948  1038 consensus_queue.cc:1059] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:24:09.836908   925 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.837893 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:09.815588  1061 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:09.839692  1135 log.cc:927] Time spent T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:24:09.844944 31464 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:09.856001 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:09.823969 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.839941  1079 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.795580  1114 consensus_queue.cc:1059] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:24:09.899698 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1525) took 2078 ms. Trace:
I20260709 12:24:09.900465 31465 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:09.840159 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.906684 31468 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:09.907712 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.908485 31468 raft_consensus.cc:2368] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3.
I20260709 12:24:09.904387 31461 rpcz_store.cc:276] 0709 12:24:07.821394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.728155 (+906761us) service_pool.cc:224] Handling call
0709 12:24:08.728503 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.728882 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.728916 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.740863 (+ 11947us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.999032 (+258169us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:09.007224 (+  8192us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.007473 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.007547 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.447061 (+439514us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:09.868584 (+421523us) raft_consensus.cc:1685] finished
0709 12:24:09.899491 (+ 30907us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.899637 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31481,"prepare.queue_time_us":68470,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":1828,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":32347,"spinlock_wait_cycles":23387904,"thread_start_us":208077,"threads_started":1,"wal-append.queue_time_us":285128}
W20260709 12:24:09.865096 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.913764 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.914580 31461 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:09.805487  1035 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.828855   540 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.922966 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.927685 31464 raft_consensus.cc:2376] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7. Re-sending same reply.
I20260709 12:24:09.847484   848 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:09.827483  1049 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.900381  1048 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.934682 32050 leader_election.cc:400] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3.
I20260709 12:24:09.935127 32050 leader_election.cc:403] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:09.937701 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.938061 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:09.916594   925 raft_consensus.cc:3055] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:09.941238 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:09.942201 31469 raft_consensus.cc:2376] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4. Re-sending same reply.
I20260709 12:24:09.927934  1114 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:09.932314  1034 raft_consensus.cc:3055] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:09.948410 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.950568 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.931866   848 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:09.949319 31469 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
W20260709 12:24:09.962263   902 consensus_meta.cc:287] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.002s
I20260709 12:24:09.965881   848 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.932722 32077 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:09.944442  1129 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:09.942047   925 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:09.945976  1146 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:09.948961  1034 raft_consensus.cc:740] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:09.981755 31394 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:09.975030   997 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3.
I20260709 12:24:09.951459  1119 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:09.985302 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:09.986032  1098 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:09.987793   925 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:09.952456  1114 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.990361 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.034024 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:10.216619 31394 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:10.216225 31462 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:10.220183 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1437) took 1431 ms. Trace:
I20260709 12:24:10.220670 31462 rpcz_store.cc:276] 0709 12:24:08.788493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.985017 (+1196524us) service_pool.cc:224] Handling call
0709 12:24:10.220097 (+235080us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:10.186513 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.165169  1091 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:10.231980 31393 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:10.233193  1091 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:09.787964   787 ts_tablet_manager.cc:1469] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Trace:
0709 12:23:59.852447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.853925 (+  1478us) service_pool.cc:224] Handling call
0709 12:24:01.862278 (+2008353us) ts_tablet_manager.cc:934] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
0709 12:24:04.067487 (+2205209us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:04.767655 (+700168us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:04.768077 (+   422us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:05.520142 (+752065us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:05.579750 (+ 59608us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:05.586772 (+  7022us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:05.586853 (+    81us) inbound_call.cc:177] Queueing success response
0709 12:24:06.354225 (+767372us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:24:09.085194 (+2730969us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:24:09.274234 (+189040us) tablet_replica.cc:261] Starting instrumentation
0709 12:24:09.274823 (+   589us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":310248,"raft.queue_time_us":3600,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3457,"tablet-copy.queue_time_us":191043,"tablet-download-pool.queue_time_us":94265,"tablet-download-pool.run_cpu_time_us":2498,"tablet-download-pool.run_wall_time_us":465955,"thread_start_us":236320,"threads_started":2}
I20260709 12:24:10.173828   542 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.247205   644 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:10.264699   542 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.264837   644 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.268040 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.268859 31394 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:10.206461 32075 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:10.274792 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:10.282052 31462 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:10.222025  1035 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:10.276882   542 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.263092  1069 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:10.281677 32075 pending_rounds.cc:85] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Aborting all ops after (but not including) 6
W20260709 12:24:10.312723 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:10.313349 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.314147 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:09.975895   659 consensus_meta.cc:287] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.729s	user 0.006s	sys 0.006s
I20260709 12:24:10.272845 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:10.287040  1098 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:10.318750 31468 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:10.023797  1110 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.040477  1034 consensus_queue.cc:260] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.314944 31462 raft_consensus.cc:2376] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6. Re-sending same reply.
I20260709 12:24:10.324002 31538 raft_consensus.cc:2410] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:09.975687  1129 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.328006 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:10.304548   644 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.310009 32075 pending_rounds.cc:107] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:10.327958   944 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.330464   944 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:09.973132   902 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.331687 31470 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:10.333669 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:10.335693 31466 raft_consensus.cc:2393] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:10.316783  1040 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.331485 32075 raft_consensus.cc:2889] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:10.331722  1129 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.339927 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:10.334573 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:10.338325 31510 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:09.992259  1146 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:10.343041 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:10.344643   951 consensus_meta.cc:287] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.004s
I20260709 12:24:10.341651 32076 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:10.326372  1098 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:10.347342 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:10.345063  1077 consensus_meta.cc:287] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.002s
I20260709 12:24:10.347191 31462 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.337716  1034 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.353300 32084 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:10.355255 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.356202 31436 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:10.358193 31510 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:10.359824 31510 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:10.354384 32078 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:10.361838 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.354205 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:10.354530  1086 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:24:10.362670 31392 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:10.357040  1039 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:10.379385 31510 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:10.382947 31392 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:10.384692 31392 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:10.386493 31392 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:10.365777   951 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.389739 31392 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:24:10.393253  1084 consensus_meta.cc:287] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.876s	user 0.012s	sys 0.000s
I20260709 12:24:10.395802  1094 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.377424 32079 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:10.372038 32075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 446) took 1663 ms. Trace:
I20260709 12:24:10.357021  1077 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.471586   813 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:10.491752 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.391309   951 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.391952  1150 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:10.515924  1152 log.cc:927] Time spent T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:24:10.516657  1100 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.517215  1100 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:10.519526  1100 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.528420  1098 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:10.529426 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.406410 32075 rpcz_store.cc:276] 0709 12:24:08.701739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.723983 (+ 22244us) service_pool.cc:224] Handling call
0709 12:24:08.752785 (+ 28802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.397887 (+645102us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400153720. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e91233dc0 00007f6e912be1c0 00007f6e912bf231 00007f6e912bbd8f 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c
0709 12:24:10.347271 (+949384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.364774 (+ 17503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247017216}
W20260709 12:24:10.545115   941 consensus_meta.cc:287] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.000s
I20260709 12:24:10.499069   951 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.545595   941 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.546223  1040 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:10.546746  1040 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.547879   902 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.405915  1114 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:10.548791  1040 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.556099  1146 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:10.557243  1110 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.560737 31465 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:10.564224 31462 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:10.569008  1144 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:10.569525 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1488) took 2461 ms (client timeout 1879 ms). Trace:
I20260709 12:24:10.575039  1129 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:10.630059 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.667685   506 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:10.587498  1093 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.568516  1098 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.668208   506 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.669200   987 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.669740   987 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:10.670199  1129 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.670401   506 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.579026   941 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.595108 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1486) took 1291 ms. Trace:
I20260709 12:24:10.671670 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:10.633776 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:10.637010 32077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 424) took 1721 ms (client timeout 1682 ms). Trace:
I20260709 12:24:10.666883  1144 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.672688 31464 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
W20260709 12:24:10.666878 31538 rpcz_store.cc:269] 0709 12:24:08.113680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.127188 (+ 13508us) service_pool.cc:224] Handling call
0709 12:24:10.569204 (+2442016us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540021f054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:10.569382 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4996163840}
I20260709 12:24:10.622205  1071 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:10.668128 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:10.650031 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 270771us
I20260709 12:24:10.638818 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1493) took 1858 ms. Trace:
I20260709 12:24:10.589375 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:10.626469   668 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.620831  1112 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.674803 31542 rpcz_store.cc:276] 0709 12:24:08.780102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.781334 (+  1232us) service_pool.cc:224] Handling call
0709 12:24:08.781594 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.922081 (+140487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.638523 (+1716442us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540021e654. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:10.638743 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293832064}
I20260709 12:24:10.637252 31359 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:10.625419   849 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:10.701952 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 64772.9us
W20260709 12:24:10.587330  1153 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 12:24:10.713856 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.648368 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1498) took 1631 ms. Trace:
I20260709 12:24:10.590719  1077 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.637081 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1500) took 1220 ms. Trace:
W20260709 12:24:10.627187   848 consensus_meta.cc:287] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.001s
I20260709 12:24:10.605623 32050 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:10.659669  1092 consensus_meta.cc:287] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.819s	user 0.008s	sys 0.004s
I20260709 12:24:10.673002 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:10.618456 31436 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:10.676776 31510 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:10.633630  1030 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.685644  1144 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.584123   954 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.685851   987 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:10.615973  1047 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:10.671734 31540 rpcz_store.cc:276] 0709 12:24:09.303900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.318785 (+ 14885us) service_pool.cc:224] Handling call
0709 12:24:10.594871 (+1276086us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003fe654. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:10.595031 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2930383616}
I20260709 12:24:10.622515   830 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:10.672600 32077 rpcz_store.cc:269] 0709 12:24:08.916032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.920300 (+  4268us) service_pool.cc:224] Handling call
0709 12:24:10.636831 (+1716531us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54000dc854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:10.636936 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963403648}
I20260709 12:24:10.688349 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.689991 31544 raft_consensus.cc:1217] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 12:24:10.675053 31469 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:10.761580 31544 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:10.691413  1160 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:10.692379 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1539) took 2764 ms. Trace:
I20260709 12:24:10.692745 31541 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:10.693830  1037 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.693986 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.695523 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:10.768918 31543 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:10.699801   925 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.703315   951 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:10.771440   951 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:10.704979  1129 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:10.705288 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 290) took 1251 ms. Trace:
I20260709 12:24:10.772205  1129 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:10.772317 31393 rpcz_store.cc:276] 0709 12:24:09.460027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.553858 (+ 93831us) service_pool.cc:224] Handling call
0709 12:24:10.705083 (+1151225us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b540027f454. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:10.705208 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295114112}
I20260709 12:24:10.773406 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:10.774401  1129 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.715853 31359 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:10.775484 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 59748.9us
I20260709 12:24:10.775360  1077 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:10.776226 31359 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:10.776993  1077 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.777647  1077 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.778049  1077 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.784293 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.702670 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.719456 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1530) took 3250 ms. Trace:
W20260709 12:24:10.752791 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 76099.2us
I20260709 12:24:10.722963 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.789924 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:10.721040 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 115515us
I20260709 12:24:10.757272  1086 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.762647 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1423) took 2833 ms. Trace:
I20260709 12:24:10.717914  1095 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.720559  1094 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:24:10.764135 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1422) took 2835 ms. Trace:
I20260709 12:24:10.764776 31464 rpcz_store.cc:276] 0709 12:24:07.927673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.691536 (+2763863us) service_pool.cc:224] Handling call
0709 12:24:10.691869 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.692038 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.692064 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.692107 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:10.692141 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.692192 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.692300 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.802516 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.716929  1039 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:10.786767 31389 rpcz_store.cc:276] 0709 12:24:07.462394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.595179 (+132785us) service_pool.cc:224] Handling call
0709 12:24:07.599917 (+  4738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.975212 (+1375295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.711495 (+1736283us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540028da54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:10.711701 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3161094400}
W20260709 12:24:10.756235 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 137881us
I20260709 12:24:10.757030   668 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:10.805167   668 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:10.805609   668 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.720225 31537 rpcz_store.cc:276] 0709 12:24:09.416315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.758953 (+342638us) service_pool.cc:224] Handling call
0709 12:24:09.793803 (+ 34850us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.942884 (+149081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:09.951066 (+  8182us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:10.160770 (+209704us) log.cc:844] Serialized 26 byte log entry
0709 12:24:10.496899 (+336129us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:10.507443 (+ 10544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.567676 (+ 60233us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.636759 (+ 69083us) raft_consensus.cc:1685] finished
0709 12:24:10.636795 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.636996 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54519,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":12159,"thread_start_us":394080,"threads_started":2,"wal-append.queue_time_us":386458}
I20260709 12:24:10.809523 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.810444  1098 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:10.810906  1098 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.757251  1092 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:10.812005  1093 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:10.812463  1093 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.813850  1092 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.792158  1044 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:24:10.758615  1110 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.815757  1035 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:10.757225   836 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.816107 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.816536   836 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.798473 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:10.797739 31469 rpcz_store.cc:276] 0709 12:24:07.928788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.761842 (+2833054us) service_pool.cc:224] Handling call
0709 12:24:10.762116 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.762277 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.762303 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.762347 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:10.762379 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.762446 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.762573 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.716640   849 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.802361 31462 rpcz_store.cc:276] 0709 12:24:07.928531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.754724 (+2826193us) service_pool.cc:224] Handling call
0709 12:24:10.763645 (+  8921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.763816 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.763850 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.763896 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:10.763941 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.763975 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.764082 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.755084   848 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.830706 31540 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:10.794705 31468 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:10.816179  1035 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:10.804350 31436 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:10.767364  1160 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.801913  1095 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.797411  1086 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.811084 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.828408 31469 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:10.854709 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1429) took 2924 ms. Trace:
I20260709 12:24:10.822547 32050 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:10.856403 32050 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:10.832595 31467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1550) took 1562 ms (client timeout 1942 ms). Trace:
I20260709 12:24:10.835043 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:10.857302 31467 rpcz_store.cc:269] 0709 12:24:09.270644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.500250 (+229606us) service_pool.cc:224] Handling call
0709 12:24:10.832435 (+1332185us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54002a62d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:10.832538 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257651584}
I20260709 12:24:10.836684 31510 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:10.826382 31461 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:10.859017 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1431) took 2737 ms. Trace:
I20260709 12:24:10.859413 31461 rpcz_store.cc:276] 0709 12:24:08.121566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.825760 (+2704194us) service_pool.cc:224] Handling call
0709 12:24:10.826076 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.858730 (+ 32654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.858959 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.855176 31469 rpcz_store.cc:276] 0709 12:24:07.930608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.827666 (+2897058us) service_pool.cc:224] Handling call
0709 12:24:10.828025 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.854363 (+ 26338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.854638 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.761992  1047 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.848026 31464 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:24:10.849463 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.801476   830 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:10.828189   942 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.857574 31544 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:10.814888  1077 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.853365 31538 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:10.803727   951 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:24:10.872787  1039 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.874032   975 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.830440  1110 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:24:10.841492 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.860764 31464 pending_rounds.cc:85] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 2
I20260709 12:24:10.876042 31462 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:10.875960 31466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1552) took 1604 ms (client timeout 1942 ms). Trace:
I20260709 12:24:10.832165  1119 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.900240 31464 pending_rounds.cc:107] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:24:10.902156 31464 raft_consensus.cc:2889] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:10.900182 31466 rpcz_store.cc:269] 0709 12:24:09.271211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.546374 (+275163us) service_pool.cc:224] Handling call
0709 12:24:10.875748 (+1329374us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540036b854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:10.875890 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566305024}
I20260709 12:24:10.839448   925 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.850733  1095 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.853543  1086 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.910676 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1425) took 2981 ms. Trace:
I20260709 12:24:10.911060 31464 rpcz_store.cc:276] 0709 12:24:07.929371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.802918 (+2873547us) service_pool.cc:224] Handling call
0709 12:24:10.847791 (+ 44873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.910414 (+ 62623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.910621 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:10.905575 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.861840   836 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:10.908017   997 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.968537 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:10.968402   997 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:10.922935 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:10.969700 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:10.970994 31543 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:24:10.924376 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.977285 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1558) took 1073 ms. Trace:
I20260709 12:24:10.924422  1035 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.977641 31468 rpcz_store.cc:276] 0709 12:24:09.903776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.321927 (+418151us) service_pool.cc:224] Handling call
0709 12:24:10.977127 (+655200us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54000faad4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:10.977231 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018376064}
I20260709 12:24:10.978310  1035 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.980406 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:10.981722 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:10.982790 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:10.876832  1145 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.900089 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.929010 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:10.934823   689 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:11.002940  1142 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 1.105s	user 0.012s	sys 0.005s
I20260709 12:24:11.003000 31386 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:10.935755 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.938628 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1430) took 3007 ms. Trace:
I20260709 12:24:10.909042 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:10.946265  1071 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:11.009346 31387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1557) took 1632 ms (client timeout 1942 ms). Trace:
I20260709 12:24:11.009196  1071 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:11.009824 31387 rpcz_store.cc:269] 0709 12:24:09.379644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.402326 (+ 22682us) service_pool.cc:224] Handling call
0709 12:24:10.935546 (+1533220us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:11.009281 (+ 73735us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24122624}
I20260709 12:24:11.010900 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.949602 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1514) took 1483 ms. Trace:
I20260709 12:24:10.405349 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.951004  1150 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:10.956580  1160 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:10.958266   944 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:10.955019  1115 log.cc:927] Time spent T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 1.391s	user 0.007s	sys 0.016s
I20260709 12:24:10.997843  1145 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.963627  1097 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:11.004172 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:10.966674  1040 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:10.966773 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:10.904300  1100 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.967470 32047 leader_election.cc:400] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3.
I20260709 12:24:10.904347  1110 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:10.905176   925 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.904486  1129 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.901914  1119 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.975338   463 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.976220 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1535) took 3495 ms. Trace:
I20260709 12:24:10.976543  1094 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.978974 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.077783 31468 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:10.988318 31470 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.928347 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1560) took 1246 ms. Trace:
I20260709 12:24:10.880684  1117 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:10.999464 31467 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.901503   975 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.004653 31464 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [2.2-6.4]
I20260709 12:24:10.945439 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.006279 31462 rpcz_store.cc:276] 0709 12:24:07.930900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.830984 (+2900084us) service_pool.cc:224] Handling call
0709 12:24:10.875876 (+ 44892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.900018 (+ 24142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.938425 (+ 38407us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b540036b850. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:10.938567 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57680256}
I20260709 12:24:10.946208  1084 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.014529 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:11.018116 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:11.083137 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 68708.5us
I20260709 12:24:11.011760 31392 rpcz_store.cc:276] 0709 12:24:09.465844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.390776 (+924932us) service_pool.cc:224] Handling call
0709 12:24:10.401135 (+ 10359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:10.485859 (+ 84724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.485915 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:10.566196 (+ 80281us) log.cc:844] Serialized 26 byte log entry
0709 12:24:10.688488 (+122292us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b48002e02d8. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:24:10.755665 (+ 67177us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:10.800078 (+ 44413us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.800283 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.800353 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.949265 (+148912us) raft_consensus.cc:1685] finished
0709 12:24:10.949377 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.949542 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14294,"prepare.queue_time_us":105204,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":28050,"raft.run_cpu_time_us":2068,"raft.run_wall_time_us":194345,"spinlock_wait_cycles":13150592,"thread_start_us":198875,"threads_started":2,"wal-append.queue_time_us":355899}
I20260709 12:24:10.876744   830 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.072395  1129 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.960685  1047 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.025724   997 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.025717 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:11.095706 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1527) took 3269 ms. Trace:
I20260709 12:24:11.095806 31394 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:11.025105 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 227) took 1333 ms. Trace:
I20260709 12:24:11.004743   542 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.965873  1098 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.033557 31389 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:11.068181 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 100855us
I20260709 12:24:11.100315 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.100914 31468 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:10.996615  1161 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:24:11.020064 32077 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.072206 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.107146 31461 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:11.030558  1145 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.032058   644 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.076671 31390 rpcz_store.cc:276] 0709 12:24:07.481317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.879955 (+398638us) service_pool.cc:224] Handling call
0709 12:24:07.922420 (+ 42465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.284288 (+1361868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.976018 (+1691730us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400406854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:10.976166 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3066086656}
I20260709 12:24:11.078544 31391 rpcz_store.cc:276] 0709 12:24:09.681724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.475021 (+793297us) service_pool.cc:224] Handling call
0709 12:24:10.475376 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:10.486063 (+ 10687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.486110 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:10.509474 (+ 23364us) log.cc:844] Serialized 26 byte log entry
0709 12:24:10.690937 (+181463us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b180044fb00. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:24:10.792164 (+101227us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:10.792209 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.792281 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.927996 (+135715us) raft_consensus.cc:1685] finished
0709 12:24:10.928026 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.928275 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10257,"raft.queue_time_us":10660,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10792,"spinlock_wait_cycles":89642752,"thread_start_us":101054,"threads_started":1,"wal-append.queue_time_us":416844}
I20260709 12:24:11.084028 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.084755 31434 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:11.072697   925 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.086714 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1433) took 2960 ms. Trace:
I20260709 12:24:11.017653 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.121939 31464 rpcz_store.cc:276] 0709 12:24:08.122069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.911806 (+2789737us) service_pool.cc:224] Handling call
0709 12:24:11.004390 (+ 92584us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:11.081896 (+ 77506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.082221 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.069839 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.075129  1119 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:11.145203  1167 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:11.150614 31537 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:11.119567 32082 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:11.021104  1150 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.093573 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:11.152417 31462 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.152359 31436 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:11.093909 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.154198 31361 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.096650 31465 rpcz_store.cc:276] 0709 12:24:09.691477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.917042 (+225565us) service_pool.cc:224] Handling call
0709 12:24:11.024948 (+1107906us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400414e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:11.025051 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048315136}
I20260709 12:24:11.155135 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.087116 31386 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:11.155915 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.069773  1097 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.082492  1071 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:11.084733   848 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:11.072953  1040 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.114037 31467 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:11.087189   836 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.073197  1100 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.092841  1117 raft_consensus.cc:697] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:11.094230  1129 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.106755   542 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.124135  1047 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.101320  1081 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.086552   975 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.132660   830 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:11.095348  1091 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.717793 31536 rpcz_store.cc:276] 0709 12:24:09.017420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.033011 (+ 15591us) service_pool.cc:224] Handling call
0709 12:24:09.155350 (+122339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.196121 (+ 40771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:09.202508 (+  6387us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:09.203099 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:24:10.334559 (+1131460us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b180012d960. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:24:10.500712 (+166153us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:10.507115 (+  6403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.567048 (+ 59933us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.646009 (+ 78961us) raft_consensus.cc:1685] finished
0709 12:24:10.646342 (+   333us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.648293 (+  1951us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19217,"raft.queue_time_us":29039,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3121,"spinlock_wait_cycles":2894080,"thread_start_us":138572,"threads_started":1,"wal-append.queue_time_us":1439240}
I20260709 12:24:11.136909  1122 raft_consensus.cc:3055] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:11.081808  1094 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.143187  1077 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.091002  1084 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.143558 31433 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:11.218883 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 75397.4us
I20260709 12:24:11.219704 31433 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.143940   668 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:11.159196 32050 leader_election.cc:336] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.811s (SENT)
W20260709 12:24:11.222983 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63827us
I20260709 12:24:11.160625 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:11.224239 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63693.2us
I20260709 12:24:11.225062 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:11.165382 31538 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.122309 31470 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:11.096107 31463 rpcz_store.cc:276] 0709 12:24:07.822080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.764962 (+942882us) service_pool.cc:224] Handling call
0709 12:24:08.765468 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.786100 (+ 20632us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:08.863674 (+ 77574us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.099567 (+235893us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:09.199239 (+ 99672us) log.cc:844] Serialized 26 byte log entry
0709 12:24:09.199440 (+   201us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:09.199501 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.199598 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.346731 (+147133us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b4800272358. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:24:10.954691 (+1607960us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b24002ae888. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0559c4 00007f6e8e053acb 00007f6e8e20edc9 00007f6e8e20ea55 00007f6e8e20e09d 00007f6e90e4010e 00007f6e90e5788c 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221
0709 12:24:11.090951 (+136260us) raft_consensus.cc:1685] finished
0709 12:24:11.090984 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.091120 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37237,"prepare.queue_time_us":88906,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":20718,"raft.run_cpu_time_us":2417,"raft.run_wall_time_us":611635,"spinlock_wait_cycles":48831488,"thread_start_us":136088,"threads_started":1,"wal-append.queue_time_us":352872}
I20260709 12:24:11.160058 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1516) took 1345 ms. Trace:
W20260709 12:24:11.176569 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 216480us
I20260709 12:24:11.080917   463 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.179185  1035 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.243532 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.244585 31510 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:11.237350 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.192692 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.188462 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-ab7bbda785db43a8a40b2bbd07b0c97a received from {username='slave'} at 127.0.0.1:34624
W20260709 12:24:11.197341 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 45097.9us
I20260709 12:24:11.203172 31462 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:11.211206 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:11.192243  1098 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:11.196426  1071 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.254768  1071 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.254096 31290 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 3 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.255144  1071 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.255282   463 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:11.252725 31510 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:11.255923 31290 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 4, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 4 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:11.257186   954 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.257477 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:11.255299   542 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.164461 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.260304 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:11.260552  1039 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:11.261183  1039 raft_consensus.cc:697] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:11.261327 31543 raft_consensus.cc:2410] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:11.262099  1039 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:11.242600 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:24:11.309254 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 66763.2us
I20260709 12:24:11.209810  1047 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.209122 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.176111   644 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.246282 31467 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:11.266299  1094 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.216094  1091 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.248294   836 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:24:11.257546   954 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:11.300946 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-ab7bbda785db43a8a40b2bbd07b0c97a on tablet ab7bbda785db43a8a40b2bbd07b0c97a with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:11.262377 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:11.263494 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:11.321985 31544 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.264006   830 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:11.264032 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.264731  1097 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.265151   848 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:11.268424  1084 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.268358  1071 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.269085 31469 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:11.214937  1122 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:11.271656   951 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.272157  1150 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:11.272850 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.314355  1047 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.274142   668 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:11.274396 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.276003  1110 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.215131  1081 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.279110 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.279568  1117 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.282424 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:11.348220 31464 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:11.243763  1035 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:24:11.284134 31292 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38054 (request call id 253) took 12988 ms (client timeout 15000 ms). Trace:
I20260709 12:24:11.284682 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:11.322017 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.352495 31463 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.284567  1093 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.286558  1095 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.245289  1044 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.228662 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.266281 31290 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 3 to 4, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 4 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.230201 31393 rpcz_store.cc:276] 0709 12:24:09.814846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.774116 (+959270us) service_pool.cc:224] Handling call
0709 12:24:10.774416 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:10.774719 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.774745 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:10.775126 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 12:24:10.995734 (+220608us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:11.012397 (+ 16663us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.053501 (+ 41104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.053601 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.159812 (+106211us) raft_consensus.cc:1685] finished
0709 12:24:11.159840 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.159988 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40799,"prepare.queue_time_us":12942,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":58202,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":3584,"thread_start_us":219573,"threads_started":1,"wal-append.queue_time_us":308615}
I20260709 12:24:11.294713 31542 raft_consensus.cc:2393] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:11.295080 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:11.307790 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 199049us
W20260709 12:24:11.307905 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.312270 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:11.259120   975 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.260628   849 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.250057 31468 raft_consensus.cc:2368] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:11.263085  1077 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.326020 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.332742   830 raft_consensus.cc:697] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:11.325503 31539 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:24:11.478407 31539 pending_rounds.cc:85] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 6
I20260709 12:24:11.478709 31539 pending_rounds.cc:107] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:24:11.479028 31539 raft_consensus.cc:2889] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:11.328780 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:11.329386 32081 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:11.301971  1179 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.331375 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:11.335915  1084 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.336242 31461 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:11.490061 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1435) took 2804 ms. Trace:
W20260709 12:24:11.336309 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 116658us
I20260709 12:24:11.314177  1092 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:11.339808 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:11.315819  1174 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:11.323450   954 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.339453 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.490538 31461 rpcz_store.cc:276] 0709 12:24:08.685969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.489321 (+2803352us) service_pool.cc:224] Handling call
0709 12:24:11.489617 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.489768 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.489798 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:11.489838 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:11.489866 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.489918 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.490010 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.493106 31290 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 3 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:11.460116  1173 log.cc:927] Time spent T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:24:11.356508 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:11.350620 31292 rpcz_store.cc:269] 0709 12:23:58.252016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.252218 (+   202us) service_pool.cc:224] Handling call
0709 12:24:11.240295 (+12988077us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:07.195379 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:07.369176 (+173797us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:07.381474 (+ 12298us) write_op.cc:435] Acquired schema lock
0709 12:24:07.383419 (+  1945us) tablet.cc:662] Decoding operations
0709 12:24:07.542263 (+158844us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:07.544335 (+  2072us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:07.546766 (+  2431us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:24:07.552453 (+  5687us) tablet.cc:701] Row locks acquired
0709 12:24:07.552485 (+    32us) write_op.cc:260] PREPARE: finished
0709 12:24:07.552683 (+   198us) write_op.cc:270] Start()
0709 12:24:07.552857 (+   174us) write_op.cc:276] Timestamp: P: 1783599847552616 usec, L: 0
0709 12:24:07.552877 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:24:07.617451 (+ 64574us) log.cc:844] Serialized 5203 byte log entry
0709 12:24:09.062010 (+1444559us) op_driver.cc:464] REPLICATION: finished
0709 12:24:09.301732 (+239722us) write_op.cc:301] APPLY: starting
0709 12:24:09.301813 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:09.335674 (+ 33861us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:09.335804 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:09.397853 (+ 62049us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:09.398183 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:24:09.398228 (+    45us) write_op.cc:312] APPLY: finished
0709 12:24:09.398618 (+   390us) log.cc:844] Serialized 95 byte log entry
0709 12:24:09.398828 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.398977 (+   149us) write_op.cc:454] Released schema lock
0709 12:24:09.399052 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:09.465257 (+ 66205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.475750 (+ 10493us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71746,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":217173,"apply.run_cpu_time_us":5055,"apply.run_wall_time_us":99958,"num_ops":13,"prepare.queue_time_us":134912,"prepare.run_cpu_time_us":17089,"prepare.run_wall_time_us":652636,"raft.queue_time_us":260978,"raft.run_cpu_time_us":7252,"raft.run_wall_time_us":318027,"replication_time_us":1442756,"thread_start_us":328072,"threads_started":4,"wal-append.queue_time_us":265679,"wal-append.run_cpu_time_us":22785,"wal-append.run_wall_time_us":2550523}]]}
I20260709 12:24:11.464805  1095 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.465027 32077 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:11.467818   644 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:11.326550 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.556481 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:11.557072 31543 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.557477 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.558688 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.471647 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:11.490125   836 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.559566 31541 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.559839 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.560050 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.559942   836 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.560969 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.561378 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.561985 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.562565 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.359375 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.471307 31388 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:11.476472 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.476495 31470 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:11.479355 31463 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:11.480372 32084 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:11.475255 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 163055us
I20260709 12:24:11.481369   568 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.482219  1091 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:11.483645 31467 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:11.323216 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 155412us
I20260709 12:24:11.485291 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:11.492101 31433 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.492209 31462 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.495389 31461 raft_consensus.cc:1275] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:11.496965 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.499346 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:11.500074 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 200) took 3055 ms. Trace:
I20260709 12:24:11.510491 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.548892 32080 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:11.547410 31290 catalog_manager.cc:5697] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 3, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 3 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:11.353880  1035 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.562615 31544 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:24:11.567761 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.597584 31359 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:11.555023 32077 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:11.602159 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 110104us
I20260709 12:24:11.603310 31433 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.603909 32084 raft_consensus.cc:1240] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:11.349936  1086 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.607550 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:11.563028 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.564045 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:11.607651 31290 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 3 to 5, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.609192 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.609661 31290 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 3, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 3 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:11.601251   568 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.592726 31464 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:11.592834 31465 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.476585  1044 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:11.593755 31361 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.615751 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:11.594125 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 108951us
I20260709 12:24:11.477475  1077 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:11.594990 31434 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:11.596029 31468 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:11.482864  1097 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.591576 31539 rpcz_store.cc:276] 0709 12:24:08.444286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.444981 (+   695us) service_pool.cc:224] Handling call
0709 12:24:08.445328 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.479616 (+3034288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.488530 (+  8914us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b5400000d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:11.500018 (+ 11488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6622716288}
I20260709 12:24:11.600589 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1543) took 2899 ms. Trace:
I20260709 12:24:11.607928 31541 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:11.619443 31461 rpcz_store.cc:276] 0709 12:24:08.700933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.493963 (+2793030us) service_pool.cc:224] Handling call
0709 12:24:11.494416 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.600265 (+105849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.600514 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.621237 31510 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:11.622485 31510 leader_election.cc:400] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:11.622812 31510 leader_election.cc:403] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:24:11.563961  1176 log.cc:927] Time spent T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:24:11.625499 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:11.567013 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:11.626441 31290 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 3, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:11.568397  1181 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.630048 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.482623  1145 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.564379 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:11.652709 31290 catalog_manager.cc:5697] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.547616  1110 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:11.593241  1174 raft_consensus.cc:697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:11.641024 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:11.659785 31361 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.661090 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:11.644269 31462 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:11.562198   836 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.616762  1100 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.653908 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1432) took 3532 ms. Trace:
I20260709 12:24:11.627041  1097 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:11.512494   975 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:24:11.657938 31464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:24:11.681787 31464 raft_consensus.cc:606] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:11.682130 31464 raft_consensus.cc:614] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:11.510339  1092 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.516238  1119 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.606314 32079 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:11.546721  1084 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.664453 31462 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:24:11.694585 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1436) took 2907 ms. Trace:
I20260709 12:24:11.693791 31290 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.565080   830 consensus_queue.cc:237] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.628577   644 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.626740  1091 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:11.626839  1044 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.671357 31470 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:11.627352   925 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.571381  1178 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 12:24:11.632507  1095 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:11.632802  1147 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.633496   848 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:11.680555 31465 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:11.652607   689 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.723855   689 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:11.724328   689 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.724790   925 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:11.725419   925 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.725730   925 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:11.726063   925 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.684034 31538 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:11.654510  1183 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.727077  1183 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:11.727566  1183 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.729660  1183 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.729758  1119 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:11.731091  1092 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:11.732403   644 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:11.733778   689 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.642904 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.653843   463 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:11.695179 31462 rpcz_store.cc:276] 0709 12:24:08.787421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.662515 (+2875094us) service_pool.cc:224] Handling call
0709 12:24:11.662925 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.694245 (+ 31320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.694515 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.627187  1077 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.713106 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1544) took 3006 ms. Trace:
I20260709 12:24:11.601444  1098 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.635905   971 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:24:11.670230   542 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.653080 32076 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:11.668040  1094 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.670073 31466 rpcz_store.cc:276] 0709 12:24:08.121836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.903683 (+2781847us) service_pool.cc:224] Handling call
0709 12:24:10.923027 (+ 19344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:10.955547 (+ 32520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.955594 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:10.960904 (+  5310us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.075153 (+114249us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:11.301183 (+226030us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.301458 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.301527 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.653710 (+352183us) raft_consensus.cc:1685] finished
0709 12:24:11.653729 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.653854 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32003,"prepare.queue_time_us":407067,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":75856,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":6853,"thread_start_us":248867,"threads_started":2,"wal-append.queue_time_us":238045}
I20260709 12:24:11.598054  1122 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.737082 31464 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:11.761890 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1441) took 2841 ms. Trace:
I20260709 12:24:11.762358 31464 rpcz_store.cc:276] 0709 12:24:08.920047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.726724 (+2806677us) service_pool.cc:224] Handling call
0709 12:24:11.727027 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.761545 (+ 34518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.761814 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.684903 32075 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:11.771433 31543 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:11.755726  1098 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:11.773746  1098 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.774004  1084 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.775815  1122 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.775655  1174 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:11.758091   848 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.737510  1091 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:11.778901   848 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.779671  1086 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:11.735456  1147 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.780413  1147 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.779820  1091 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.781056   848 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:11.718832 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.784020 31536 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:11.785187 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.786708 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:11.787707 31466 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:11.788082 31462 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:11.788784 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1545) took 2519 ms. Trace:
I20260709 12:24:11.789206 31462 rpcz_store.cc:276] 0709 12:24:09.269209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.758639 (+2489430us) service_pool.cc:224] Handling call
0709 12:24:11.787703 (+ 29064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.788541 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.788722 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.763684  1094 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.791949  1094 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.792433   849 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:11.682323   652 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.736017 31470 rpcz_store.cc:276] 0709 12:24:08.706222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.641898 (+2935676us) service_pool.cc:224] Handling call
0709 12:24:11.665149 (+ 23251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.712770 (+ 47621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.713035 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.682919  1097 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.683063   836 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:11.654695  1181 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:11.669094  1110 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:11.797176 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 201511us
W20260709 12:24:11.771551 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 214641us
I20260709 12:24:11.788376 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1449) took 2399 ms. Trace:
I20260709 12:24:11.806388 31466 rpcz_store.cc:276] 0709 12:24:09.389315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.761203 (+2371888us) service_pool.cc:224] Handling call
0709 12:24:11.787542 (+ 26339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.788160 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.788325 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.806628 32048 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.763417   542 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:11.794018 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 190830us
I20260709 12:24:11.815385 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:11.790984 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 221) took 2154 ms. Trace:
I20260709 12:24:11.816071 31462 rpcz_store.cc:276] 0709 12:24:09.637035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.790142 (+2153107us) service_pool.cc:224] Handling call
0709 12:24:11.790500 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.790668 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.790705 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:11.790745 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:11.790776 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.790822 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.790923 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.816885 31464 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:11.736882  1071 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:11.796533 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:11.797777 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 202883us
I20260709 12:24:11.743993 31290 catalog_manager.cc:5697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 2, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 2 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.808971 32048 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.841915 31469 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.141561 31461 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:11.850374 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:12.227491 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1553) took 2559 ms. Trace:
I20260709 12:24:12.148983  1184 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.819639 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:12.228173 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 408618us
I20260709 12:24:12.228268  1184 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.229151 31433 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.229499  1190 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:12.229928  1037 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:12.230305  1037 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:24:12.230538 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 421627us
I20260709 12:24:12.230693  1037 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.231793 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:12.233187  1195 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.797740  1093 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:12.233635  1195 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:11.865043 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.234071  1195 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.798583 31536 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:12.235451  1190 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.236202 31536 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.237020 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1525) took 1017 ms. Trace:
I20260709 12:24:12.237439 31536 rpcz_store.cc:276] 0709 12:24:11.219462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.235692 (+1016230us) service_pool.cc:224] Handling call
0709 12:24:12.236015 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.236769 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.236962 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.818490 31359 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:12.236120  1190 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:11.922930 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 261919us
I20260709 12:24:12.240764 31361 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.985599  1181 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.241453  1195 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.227931 31461 rpcz_store.cc:276] 0709 12:24:09.667872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.140711 (+2472839us) service_pool.cc:224] Handling call
0709 12:24:12.141300 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.227209 (+ 85909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.227440 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.233072 31543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:12.243522 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1554) took 2549 ms. Trace:
I20260709 12:24:11.816896 31541 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:12.243887 31461 rpcz_store.cc:276] 0709 12:24:09.694600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.242640 (+2548040us) service_pool.cc:224] Handling call
0709 12:24:12.242932 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.243116 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.243151 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.243205 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:12.243267 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.243335 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.243467 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.244757 31541 pending_rounds.cc:85] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 6
I20260709 12:24:12.245222 31541 pending_rounds.cc:107] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:12.245556 31541 raft_consensus.cc:2889] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:12.246090 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 235) took 2275 ms. Trace:
I20260709 12:24:12.246513 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1521) took 1060 ms. Trace:
I20260709 12:24:12.250102  1192 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:12.250715  1192 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.253328  1192 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:12.231010 31433 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:12.226998 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.257006 31433 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.258172  1181 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:12.259418  1192 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.246543 31461 rpcz_store.cc:276] 0709 12:24:09.970240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.245214 (+2274974us) service_pool.cc:224] Handling call
0709 12:24:12.245516 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.245703 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.245739 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.245793 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:12.245834 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.245905 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.246029 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.260985 31433 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:11.880465 31462 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:24:12.261451 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 237) took 2181 ms. Trace:
W20260709 12:24:12.265015  1077 consensus_meta.cc:287] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 12:24:12.262681  1192 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:11.795797   652 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:12.265529 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 225) took 2601 ms. Trace:
I20260709 12:24:12.299896 31462 rpcz_store.cc:276] 0709 12:24:09.664394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.817010 (+2152616us) service_pool.cc:224] Handling call
0709 12:24:11.880114 (+ 63104us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:12.265270 (+385156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.265480 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.247043 31541 rpcz_store.cc:276] 0709 12:24:11.185623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.816060 (+630437us) service_pool.cc:224] Handling call
0709 12:24:11.816423 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.246199 (+429776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.246441 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.266180  1181 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.265327 31461 rpcz_store.cc:276] 0709 12:24:10.079978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.260705 (+2180727us) service_pool.cc:224] Handling call
0709 12:24:12.260991 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.261150 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.261173 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.261210 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:12.261237 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.261285 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.261387 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.267068 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.271138  1071 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.271157 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 452742us
I20260709 12:24:12.305361 31359 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:12.272686   644 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:12.273648 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.227958 31290 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:12.253275 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.226087 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 220) took 2589 ms. Trace:
I20260709 12:24:12.230850  1184 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:11.897655  1129 consensus_meta.cc:287] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.000s
I20260709 12:24:12.242123  1190 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.307585 31464 rpcz_store.cc:276] 0709 12:24:09.636742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.793627 (+2156885us) service_pool.cc:224] Handling call
0709 12:24:11.816592 (+ 22965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.817233 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.226024 (+408791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:11.811440   836 raft_consensus.cc:697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:11.814776  1100 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:11.820873   542 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.848199  1183 raft_consensus.cc:2764] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:24:12.342674 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 89453.6us
I20260709 12:24:11.892740  1110 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:11.848402   849 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:12.304224  1091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.014s	sys 0.027s
I20260709 12:24:12.362787 32048 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.359751   689 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:12.364950 31461 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:12.370533 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1564) took 1441 ms. Trace:
I20260709 12:24:12.303642   652 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.366950 31462 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:12.371663 32048 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.370935 31461 rpcz_store.cc:276] 0709 12:24:10.928603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.308798 (+1380195us) service_pool.cc:224] Handling call
0709 12:24:12.364626 (+ 55828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.370236 (+  5610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.370468 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.379719 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1562) took 1451 ms. Trace:
I20260709 12:24:12.381547 31462 rpcz_store.cc:276] 0709 12:24:10.928102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.308422 (+1380320us) service_pool.cc:224] Handling call
0709 12:24:12.360461 (+ 52039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.375071 (+ 14610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.379664 (+  4593us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:12.381018 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 109181us
I20260709 12:24:12.318163  1184 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:12.379700   849 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.307874  1129 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.360585   975 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.302520  1077 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.304607  1192 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.404289 31462 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:24:12.371573   830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.019s	sys 0.039s
I20260709 12:24:12.405468 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:12.410912 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1570) took 1480 ms. Trace:
I20260709 12:24:12.411720 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:12.408785 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1571) took 1478 ms. Trace:
I20260709 12:24:12.374439  1181 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:12.412458 31462 rpcz_store.cc:276] 0709 12:24:10.930320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.390644 (+1460324us) service_pool.cc:224] Handling call
0709 12:24:12.403899 (+ 13255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.408471 (+  4572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.408719 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.380312  1100 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.415931 31543 raft_consensus.cc:606] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:12.411429 31461 rpcz_store.cc:276] 0709 12:24:10.930050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.390754 (+1460704us) service_pool.cc:224] Handling call
0709 12:24:12.410413 (+ 19659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.410582 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.410609 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.410650 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:12.410684 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.410735 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.410831 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.391113   971 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.374089  1196 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:12.423082 32075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 432) took 1096 ms. Trace:
I20260709 12:24:12.423512  1196 raft_consensus.cc:697] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:12.424458  1196 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.401495  1184 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.427801 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 449) took 1095 ms. Trace:
I20260709 12:24:12.428177 32080 rpcz_store.cc:276] 0709 12:24:11.332378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.332537 (+   159us) service_pool.cc:224] Handling call
0709 12:24:11.548629 (+216092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.592009 (+ 43380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.427594 (+835585us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54005fd050. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:12.427711 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454205312}
I20260709 12:24:12.428988  1184 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.430598  1192 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:12.430783  1035 consensus_meta.cc:287] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.824s	user 0.012s	sys 0.000s
I20260709 12:24:12.399823  1178 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:24:12.344535  1071 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.433034   849 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:12.416337 31543 raft_consensus.cc:614] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:12.435778 31461 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.436410 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1576) took 1504 ms. Trace:
I20260709 12:24:12.416754 32081 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:12.436721 31461 rpcz_store.cc:276] 0709 12:24:10.931654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.416829 (+1485175us) service_pool.cc:224] Handling call
0709 12:24:12.435598 (+ 18769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.436173 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.436348 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.436424  1077 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:12.438639  1094 consensus_meta.cc:287] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.003s
I20260709 12:24:12.439211  1077 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:24:12.423532 32075 rpcz_store.cc:276] 0709 12:24:11.326682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.329257 (+  2575us) service_pool.cc:224] Handling call
0709 12:24:11.489190 (+159933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.764637 (+275447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.422711 (+658074us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54005febd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:12.423016 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343417728}
I20260709 12:24:12.444485 31462 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.442003 31436 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.445189 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1453) took 1495 ms. Trace:
I20260709 12:24:12.445626 31462 rpcz_store.cc:276] 0709 12:24:10.949716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.417072 (+1467356us) service_pool.cc:224] Handling call
0709 12:24:12.444312 (+ 27240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.444980 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.445141 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.446521 31462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "8d38acb9ce494ceb917c8441666104c4"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:24:12.421509 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:12.449026 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:12.449193 31537 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:12.449676 32079 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:12.450438  1044 consensus_meta.cc:287] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.730s	user 0.004s	sys 0.004s
I20260709 12:24:12.448307 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:12.414579   830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.021s	sys 0.039s
I20260709 12:24:12.451730  1040 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:12.440814 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:12.453091 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 299) took 1486 ms. Trace:
I20260709 12:24:12.450846  1044 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:12.449368   951 consensus_meta.cc:287] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.112s	user 0.007s	sys 0.002s
W20260709 12:24:12.420966   954 consensus_meta.cc:287] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.000s
I20260709 12:24:12.458370 31469 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:12.448580  1071 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:12.431303  1095 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:12.401592   644 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.450803 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1529) took 1172 ms. Trace:
I20260709 12:24:12.471423   644 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.472350 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:12.473150 32077 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:12.473521   644 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.473945 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:12.474596  1095 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:12.453460 31387 rpcz_store.cc:276] 0709 12:24:10.966244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.074864 (+108620us) service_pool.cc:224] Handling call
0709 12:24:11.086805 (+ 11941us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:11.340725 (+253920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.340760 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:11.341488 (+   728us) log.cc:844] Serialized 52 byte log entry
0709 12:24:11.702869 (+361381us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:11.731389 (+ 28520us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.732485 (+  1096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.452692 (+720207us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54002e22d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:12.452731 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.452774 (+    43us) raft_consensus.cc:1685] finished
0709 12:24:12.452881 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.453032 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23521,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":7316,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":6401,"spinlock_wait_cycles":568497024,"thread_start_us":219551,"threads_started":1,"wal-append.queue_time_us":463157}
I20260709 12:24:12.475608  1095 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.456182  1035 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.477939  1081 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:12.478062  1035 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:12.475659   925 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.000s
I20260709 12:24:12.479068 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:12.468876   954 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.480499 31510 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:12.481405   954 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:12.481662 31510 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:12.478792   925 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.475600 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:12.452296  1040 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:12.480561  1044 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.365787   836 consensus_queue.cc:237] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:12.443212  1047 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.093s	user 0.007s	sys 0.000s
W20260709 12:24:12.444816  1098 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.671s	user 0.002s	sys 0.006s
I20260709 12:24:12.481999   954 consensus_queue.cc:1059] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:12.470605  1097 consensus_meta.cc:287] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.001s
I20260709 12:24:12.475001 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:12.452339 31386 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:12.439033  1094 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.513370 31467 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:12.519876 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:12.534551 31389 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:12.484918 31535 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:12.469048   830 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.469949   951 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:12.487965   849 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:12.547721 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 280690us
I20260709 12:24:12.560367 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.540026  1047 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:12.553128 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1525) took 1946 ms. Trace:
I20260709 12:24:12.561450 31388 rpcz_store.cc:276] 0709 12:24:10.606921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.791258 (+184337us) service_pool.cc:224] Handling call
0709 12:24:10.791973 (+   715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.598919 (+806946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.552823 (+953904us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54002e18d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:12.553054 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556472192}
I20260709 12:24:12.554437 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:12.485960  1195 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:12.511610  1117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.017s	sys 0.034s
I20260709 12:24:12.511991   689 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:12.547006 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 241701us
I20260709 12:24:12.563000 31468 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:12.612481 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:12.613144 31468 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:12.614094 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:12.614737 31468 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:12.619212 31359 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:12.512133   668 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:12.511031  1040 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:12.621161  1040 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.576970 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1517) took 1392 ms. Trace:
I20260709 12:24:12.625119 31538 rpcz_store.cc:276] 0709 12:24:11.184745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.510206 (+325461us) service_pool.cc:224] Handling call
0709 12:24:12.576752 (+1066546us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b5400031bd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:12.576902 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209858304}
W20260709 12:24:12.563709 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 171857us
I20260709 12:24:12.627461  1044 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:12.632026 31361 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.633343 31361 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.630131  1091 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:24:12.637147   644 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:12.637967   644 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.638415   644 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.638820   644 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.643484  1044 consensus_queue.cc:1059] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:12.644744  1035 raft_consensus.cc:3055] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:12.645148  1035 raft_consensus.cc:740] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:12.646150  1035 consensus_queue.cc:260] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.679534 31361 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.510810  1093 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:24:12.485441   542 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.700798 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:12.570477  1117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.017s	sys 0.034s
I20260709 12:24:12.570031  1071 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.532696  1098 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:12.672273  1122 consensus_meta.cc:287] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.896s	user 0.006s	sys 0.003s
I20260709 12:24:12.545506  1097 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.737890 31539 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:24:12.716249 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 232232us
I20260709 12:24:12.707340 32077 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:12.724002 32082 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.482542 31537 rpcz_store.cc:276] 0709 12:24:11.278197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.450002 (+1171805us) service_pool.cc:224] Handling call
0709 12:24:12.450276 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.450471 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.450507 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.450550 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:12.450591 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.450647 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.450749 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.580207   689 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:12.729650 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 50407.4us
I20260709 12:24:12.708550  1184 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.737416 31394 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.708112  1183 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.707551  1192 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.741209 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.710294  1100 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:12.716966   849 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.768810 31391 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:12.754529  1037 consensus_meta.cc:287] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.006s
I20260709 12:24:12.753628 31543 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:12.757491 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 200107us
I20260709 12:24:12.757879 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1566) took 1828 ms. Trace:
I20260709 12:24:12.756142 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:12.793349 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1539) took 1128 ms. Trace:
I20260709 12:24:12.798087 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:12.799449  1196 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:12.799830  1196 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.800166  1196 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.800083  1206 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:12.806028 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1519) took 1594 ms. Trace:
I20260709 12:24:12.806558 31535 rpcz_store.cc:276] 0709 12:24:11.185188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.791610 (+606422us) service_pool.cc:224] Handling call
0709 12:24:11.791889 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.566447 (+774558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.778946 (+212499us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400033254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:12.779162 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588286848}
I20260709 12:24:12.809211 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1528) took 1531 ms. Trace:
I20260709 12:24:12.809577 31543 rpcz_store.cc:276] 0709 12:24:11.277965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.435814 (+1157849us) service_pool.cc:224] Handling call
0709 12:24:12.436080 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.776234 (+340154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.809009 (+ 32775us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54003c0354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:12.809158 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729684864}
I20260709 12:24:12.810025 31535 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:12.725713  1071 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.811847  1071 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.718128   951 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.815083 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 302) took 1271 ms. Trace:
I20260709 12:24:12.815503   951 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.815475 31391 rpcz_store.cc:276] 0709 12:24:11.544040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.544166 (+   126us) service_pool.cc:224] Handling call
0709 12:24:11.544514 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.771388 (+1226874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.814864 (+ 43476us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002e27d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:12.815020 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2806135680}
I20260709 12:24:12.817798   951 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:12.763455 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:12.741523 31390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.002s	sys 0.011s
W20260709 12:24:12.819070 31390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.002s	sys 0.011s
I20260709 12:24:12.819371 32082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 450) took 1486 ms. Trace:
W20260709 12:24:12.715346 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 96139.4us
I20260709 12:24:12.819746 32082 rpcz_store.cc:276] 0709 12:24:11.333099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.483607 (+150508us) service_pool.cc:224] Handling call
0709 12:24:11.483909 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.743423 (+1259514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.819137 (+ 75714us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54004a10d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:12.819311 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2851395968}
I20260709 12:24:12.742136   954 raft_consensus.cc:3055] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:12.754778  1202 log.cc:927] Time spent T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:24:12.823426   954 raft_consensus.cc:740] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:12.726913 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1530) took 1448 ms. Trace:
I20260709 12:24:12.738963  1174 raft_consensus.cc:2764] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:12.824522   954 consensus_queue.cc:260] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.825635   954 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.825513  1174 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:12.826041 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 224) took 3174 ms. Trace:
I20260709 12:24:12.764153 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:12.827566 31463 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.826524 31466 rpcz_store.cc:276] 0709 12:24:09.651798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.807769 (+2155971us) service_pool.cc:224] Handling call
0709 12:24:11.844182 (+ 36413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.844556 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.844596 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.845114 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:24:12.377304 (+532190us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:12.475690 (+ 98386us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4800272358. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:24:12.554104 (+ 78414us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.554339 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.554406 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.825707 (+271301us) raft_consensus.cc:1685] finished
0709 12:24:12.825823 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.825974 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29189,"prepare.queue_time_us":340290,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":398,"raft.run_cpu_time_us":7962,"raft.run_wall_time_us":627361,"spinlock_wait_cycles":51969280,"thread_start_us":467699,"threads_started":2,"wal-append.queue_time_us":623349}
I20260709 12:24:12.830705 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:12.831494  1204 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:12.831789 31466 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.832496  1204 raft_consensus.cc:3055] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:12.832924  1204 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:12.825078 31544 rpcz_store.cc:276] 0709 12:24:11.287334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.700392 (+1413058us) service_pool.cc:224] Handling call
0709 12:24:12.726327 (+ 25935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.726543 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.726566 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.726601 (+    35us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:12.726645 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.726713 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.726848 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.837544 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:12.838781 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:12.841192  1091 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:12.843480   463 consensus_queue.cc:1059] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:12.844696   463 consensus_queue.cc:1059] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:12.845690  1091 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:12.793864 31538 rpcz_store.cc:276] 0709 12:24:11.665316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.792368 (+1127052us) service_pool.cc:224] Handling call
0709 12:24:12.792736 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.792952 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.792989 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.793043 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:12.793085 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.793153 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.793280 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:12.848721 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.849402 31466 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:12.833817  1204 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.853611  1204 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.854043 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:12.857292 31466 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:12.861023 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:12.861375 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:12.861719 31391 raft_consensus.cc:2393] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:12.861879 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:12.862496 31386 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:12.863605 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:12.847324  1091 raft_consensus.cc:3055] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:12.869827  1091 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:12.887682 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:12.888957 31535 raft_consensus.cc:2410] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:12.890609 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:12.892587 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:12.894446 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:12.895437 31395 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:12.901763  1071 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.870853  1091 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.904407 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:12.905727 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:12.906008 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.047641 31394 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:12.907392 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.049160 31388 raft_consensus.cc:2393] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:12.907764 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.049793 31395 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:12.908596 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:12.759181   689 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:12.763393  1147 consensus_meta.cc:287] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.000s
I20260709 12:24:12.912463 31466 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:13.058019 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1584) took 1763 ms. Trace:
I20260709 12:24:13.058406 31466 rpcz_store.cc:276] 0709 12:24:11.294603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.862634 (+1568031us) service_pool.cc:224] Handling call
0709 12:24:12.863829 (+  1195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.057727 (+193898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.057967 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:12.914510 31463 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
W20260709 12:24:12.917874  1197 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 12:24:12.917577  1206 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:12.920610   568 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:12.922416  1098 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:12.922851 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:12.923370  1094 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.923532   925 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.766548  1183 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.924954   542 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:12.770948  1192 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:12.925498  1035 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:12.926788  1193 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 12:24:12.928057   652 consensus_meta.cc:287] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.000s
I20260709 12:24:12.758771  1122 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.928479 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.738590   830 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:24:12.938149 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 77576.3us
I20260709 12:24:12.912134  1037 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.939930  1211 raft_consensus.cc:3055] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:12.776983   849 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.942375 31537 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:12.942538 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 146431us
I20260709 12:24:12.942907  1145 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:12.928336   668 raft_consensus.cc:697] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:12.943053  1178 consensus_queue.cc:1059] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:12.943783 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1460) took 1972 ms. Trace:
I20260709 12:24:12.943923  1097 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:12.944154 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 180788us
I20260709 12:24:12.937068 32079 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
W20260709 12:24:12.944695 31542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1499) took 2248 ms (client timeout 1928 ms). Trace:
I20260709 12:24:12.944839  1195 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.945286  1191 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.946143 31540 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.947297 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1586) took 1405 ms. Trace:
I20260709 12:24:12.946102  1179 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:24:12.950578  1047 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.942407 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 307) took 1133 ms. Trace:
I20260709 12:24:12.952626 32076 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:12.938103   951 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.957242   644 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.958027  1174 consensus_queue.cc:1059] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:12.778046 31464 rpcz_store.cc:276] 0709 12:24:10.929057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.316982 (+1387925us) service_pool.cc:224] Handling call
0709 12:24:12.375791 (+ 58809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.376046 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:12.563128 (+187082us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.757224 (+194096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.757291 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:12.757355 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.757458 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.757800 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":323041,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4000,"raft.queue_time_us":5130,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8582,"thread_start_us":357902,"threads_started":2}
I20260709 12:24:12.765648  1129 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:12.968953 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 306) took 1164 ms. Trace:
I20260709 12:24:12.774631  1184 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:12.993911  1196 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.013720 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1574) took 2082 ms. Trace:
W20260709 12:24:13.010720 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 71376.9us
I20260709 12:24:13.052687 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.060981 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.064460 31463 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:13.066426 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.069819 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.072599 31462 raft_consensus.cc:606] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Received request to transfer leadership to TS 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:13.236819 31465 rpcz_store.cc:276] 0709 12:24:10.931121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.405606 (+1474485us) service_pool.cc:224] Handling call
0709 12:24:12.405881 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.406075 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:12.573276 (+167201us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.010348 (+437072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.010403 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:13.010449 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.013510 (+  3061us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.013659 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8023,"prepare.queue_time_us":332780,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":103,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":29868,"thread_start_us":603646,"threads_started":2,"wal-append.queue_time_us":431653}
W20260709 12:24:13.065784 31536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.009s
I20260709 12:24:13.238967  1196 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:13.239046   951 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.239444 31436 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:13.238972 31536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.009s	sys 0.022s
I20260709 12:24:13.240311  1047 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.240828  1047 raft_consensus.cc:697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:13.241246   951 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:13.241617  1047 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.242374  1179 raft_consensus.cc:3055] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:13.242745  1179 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:13.217182 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.012s	sys 0.018s
W20260709 12:24:13.243551 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.013s	sys 0.018s
W20260709 12:24:13.243932 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 760778us
I20260709 12:24:13.244585 31510 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:13.239398 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1587) took 1697 ms. Trace:
I20260709 12:24:13.245884 31463 rpcz_store.cc:276] 0709 12:24:11.541941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.059710 (+1517769us) service_pool.cc:224] Handling call
0709 12:24:13.060051 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.239133 (+179082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.239348 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:13.237776 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.246238 31393 rpcz_store.cc:276] 0709 12:24:11.804129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.804460 (+   331us) service_pool.cc:224] Handling call
0709 12:24:11.840975 (+ 36515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.841397 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.841435 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.879386 (+ 37951us) log.cc:844] Serialized 26 byte log entry
0709 12:24:12.390639 (+511253us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:12.390682 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.390752 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.968718 (+577966us) raft_consensus.cc:1685] finished
0709 12:24:12.968742 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.968891 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7154,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":25770,"thread_start_us":251606,"threads_started":1,"wal-append.queue_time_us":798569}
I20260709 12:24:13.244939 31467 rpcz_store.cc:276] 0709 12:24:10.971348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.424206 (+1452858us) service_pool.cc:224] Handling call
0709 12:24:12.424504 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.544207 (+119703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.943578 (+399371us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b540004d3d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:12.943728 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203782400}
I20260709 12:24:13.229852 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 310) took 1165 ms. Trace:
I20260709 12:24:13.249205 31392 rpcz_store.cc:276] 0709 12:24:12.064886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.065283 (+   397us) service_pool.cc:224] Handling call
0709 12:24:12.065773 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:12.485763 (+419990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.485806 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:12.513540 (+ 27734us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.063302 (+549762us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:13.063346 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.063417 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.229543 (+166126us) raft_consensus.cc:1685] finished
0709 12:24:13.229571 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.229777 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206051,"raft.queue_time_us":308900,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":16647,"thread_start_us":707758,"threads_started":2,"wal-append.queue_time_us":683267}
I20260709 12:24:13.187196 31538 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:13.187918 31543 raft_consensus.cc:3055] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:13.244292 31469 rpcz_store.cc:276] 0709 12:24:11.541648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.563807 (+ 22159us) service_pool.cc:224] Handling call
0709 12:24:12.947101 (+1383294us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54002c6d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:12.947224 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536499584}
I20260709 12:24:13.252310 31543 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:13.252625 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:13.251332 31542 rpcz_store.cc:269] 0709 12:24:10.696474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.802268 (+105794us) service_pool.cc:224] Handling call
0709 12:24:12.944504 (+2142236us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400032d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:12.944630 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113273728}
I20260709 12:24:13.254312   568 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:13.120570 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 280039us
I20260709 12:24:13.244721  1191 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.254923   568 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:13.255053  1191 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.255219   644 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:13.254344 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.257102 31389 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:13.256923   568 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.258744 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.259259 31389 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.259603 31393 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:13.243499  1179 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.261628  1179 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.261677 32081 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:13.222023 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:13.222760 31544 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:24:13.263944 31544 pending_rounds.cc:85] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 6
I20260709 12:24:13.264245 31544 pending_rounds.cc:107] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:24:13.264528 31544 raft_consensus.cc:2889] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:13.238279  1195 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.265690 31389 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:13.267287  1195 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:13.064857  1212 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.254143 31510 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:13.268985  1098 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.269462  1098 raft_consensus.cc:697] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:13.185721 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:13.270741 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.271054 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.271631 31393 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:13.271325  1224 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:13.062479  1205 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:13.272595  1205 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.273433  1093 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:13.273350 31543 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.274340 31543 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.274214  1221 consensus_queue.cc:1059] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:13.275094  1221 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:13.275290  1205 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:13.275357  1093 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:13.276392  1221 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:13.276461 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.276798  1093 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:13.277200  1093 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:13.270439  1098 consensus_queue.cc:237] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.279101 31394 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:13.280896 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.280998  1093 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.282452  1093 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.284261 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.282748 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.285004 31391 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:13.285545   849 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:13.292245 31510 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:13.293259 31510 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:13.286887 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.287091 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1535) took 1988 ms. Trace:
I20260709 12:24:13.287467  1211 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:13.304163 31391 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:13.304589   568 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:13.304718 31510 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:13.305055   568 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:13.304853  1211 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.305686   568 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.305951  1211 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.288055 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:13.096487 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 383526us
I20260709 12:24:13.174075 32078 raft_consensus.cc:2393] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:13.076251  1204 raft_consensus.cc:3055] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:13.307717  1145 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:13.308041 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:13.308934 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.300196 31388 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:13.309195 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.309930 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.310230 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.310501 31388 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.310312  1237 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.295737 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:13.308140  1145 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.305052 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.311553  1145 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.312242 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.303859 31537 rpcz_store.cc:276] 0709 12:24:11.298583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.912253 (+1613670us) service_pool.cc:224] Handling call
0709 12:24:12.942195 (+ 29942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.286831 (+344636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.287037 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:13.308590  1224 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:13.314567  1204 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:13.075984 31386 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:13.315583  1204 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.123051 31466 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:13.317993  1204 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.318320 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.245095 31390 rpcz_store.cc:276] 0709 12:24:11.809136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.811149 (+  2013us) service_pool.cc:224] Handling call
0709 12:24:11.848645 (+ 37496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.848970 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.849010 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.905450 (+ 56440us) log.cc:844] Serialized 26 byte log entry
0709 12:24:12.430982 (+525532us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b48002e02d8. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:24:12.819647 (+388665us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:12.819689 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.819753 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.942131 (+122378us) raft_consensus.cc:1685] finished
0709 12:24:12.942150 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.942345 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":512,"raft.run_cpu_time_us":8896,"raft.run_wall_time_us":554316,"spinlock_wait_cycles":10124928,"thread_start_us":611948,"threads_started":1,"wal-append.queue_time_us":841519}
I20260709 12:24:13.322185 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.322973 31394 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:13.323681 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:13.325105 31388 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:13.306900 31510 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:13.325567 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 62012.4us
I20260709 12:24:13.326069 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.326998 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.327701 31538 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:13.328049 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:13.232028  1232 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:24:13.329422 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.285678 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.367363 31393 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
I20260709 12:24:13.330576 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.325340  1084 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:13.331634 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 80538.4us
I20260709 12:24:13.372615 31433 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:13.373060 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.334132  1205 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:13.335796 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 81564.6us
I20260709 12:24:13.336347   997 raft_consensus.cc:3055] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:13.336921   971 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:13.377507 31434 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:13.336870 32048 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:13.379900 32048 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:13.337666   689 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.341428  1037 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:13.342032 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:13.343360 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.344328 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:13.344746  1192 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:13.345805  1184 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:13.346426   668 consensus_queue.cc:237] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.073168  1091 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:13.352363 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 63034.8us
I20260709 12:24:13.366549  1098 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:13.360929 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.361404 31466 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:13.361799  1093 consensus_queue.cc:1059] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:13.369115 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:13.294543  1244 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:13.371649 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:13.064031  1147 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.375264 32050 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:13.430033 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:13.326051  1122 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:13.385398 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.387328 31463 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:13.388124 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:13.390205 31469 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:13.253654   652 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.376266   997 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:24:13.436653 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.394098 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:13.349893  1183 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:13.350551  1071 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:13.353211 31461 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:13.401718 31434 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:13.425880 31543 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.460191 32076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 401) took 1012 ms. Trace:
I20260709 12:24:13.460600 32076 rpcz_store.cc:276] 0709 12:24:12.447569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.448041 (+   472us) service_pool.cc:224] Handling call
0709 12:24:13.459983 (+1011942us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54001333d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:13.460133 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151060224}
I20260709 12:24:13.425292 31535 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:13.390729   925 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.399139  1100 consensus_queue.cc:1059] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:24:13.426909 31388 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:13.463933   925 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.397451  1190 consensus_queue.cc:1059] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:24:13.397248 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:13.392233   836 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:13.392122   975 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:13.395848  1196 consensus_queue.cc:1059] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:13.396981 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1526) took 2116 ms. Trace:
I20260709 12:24:13.429016 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:13.570909 31466 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:13.430830 31544 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:13.373971 31433 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:13.572163 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 198245us
I20260709 12:24:13.573400 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:13.431285  1098 raft_consensus.cc:697] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:13.431731 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.580045 31390 raft_consensus.cc:2410] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:13.359323  1195 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:24:13.439162 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1582) took 2149 ms. Trace:
I20260709 12:24:13.365981  1178 consensus_queue.cc:1059] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:24:13.373700   830 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:24:13.632033  1178 raft_consensus.cc:3055] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:13.441555 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 58702.7us
I20260709 12:24:13.632441  1178 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:13.634094 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:13.464795  1185 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:13.403652  1192 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.397285  1216 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:13.449942 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 48318.3us
I20260709 12:24:13.646144 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:13.646553 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1515) took 2492 ms. Trace:
I20260709 12:24:13.647282 31434 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:13.450563  1183 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.452791 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 223) took 3815 ms. Trace:
I20260709 12:24:13.440143 31537 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:13.455865   568 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.655368 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:13.658672   568 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:13.425705  1244 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:13.659471  1244 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.660538  1147 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:13.663188 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.464391   925 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.663990 31389 raft_consensus.cc:2410] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:13.664753 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.665980 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.668710 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.669785 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:13.670246 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:13.670992  1246 log.cc:927] Time spent T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 12:24:13.672935 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.673704 31394 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:13.674018 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.675457 31537 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:13.681442 31394 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:13.485713 31387 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:13.537070 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.687224 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:13.687906 31463 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.688660 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 311) took 1180 ms. Trace:
I20260709 12:24:13.397732  1145 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.390233  1194 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:24:13.383762  1084 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.689350 31395 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:13.538784 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.690789  1084 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:13.691036 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.691713 31395 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:13.398392  1205 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.692436 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:13.568521   975 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.693219   975 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.693395 31542 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:13.693882  1205 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:13.568470   836 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.694430 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.695752   836 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:13.695900 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.583170 31466 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [3.5-6.7]
I20260709 12:24:13.697504 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:13.698200 31466 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.704487  1117 raft_consensus.cc:3055] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:13.574740 31433 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:13.466079   542 raft_consensus.cc:3055] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:13.705294   542 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:13.705533  1094 raft_consensus.cc:3055] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:13.705945  1094 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:13.706318   542 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.567389  1086 consensus_queue.cc:1059] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:24:13.707679   542 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.708765  1086 raft_consensus.cc:3055] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:13.709131  1086 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:13.625699   689 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:13.709911  1086 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.625003  1098 consensus_queue.cc:237] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.626451 31468 rpcz_store.cc:276] 0709 12:24:11.289301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.615216 (+1325915us) service_pool.cc:224] Handling call
0709 12:24:12.651357 (+ 36141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.652057 (+   700us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:13.083425 (+431368us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.438873 (+355448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.438918 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:13.438960 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.439018 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.439113 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187035,"prepare.queue_time_us":109265,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1212,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":29019,"thread_start_us":733978,"threads_started":2,"wal-append.queue_time_us":488569}
I20260709 12:24:13.465265  1190 raft_consensus.cc:3055] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:13.712358  1190 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:13.712591 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55830 (request call id 11) took 1271 ms. Trace:
I20260709 12:24:13.713222  1190 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.633761   997 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.714433  1190 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.715188   997 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:13.718720 31466 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:13.435895  1093 raft_consensus.cc:3055] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:13.447621 31541 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 12:24:13.719377  1093 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:13.720441 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1527) took 2442 ms. Trace:
I20260709 12:24:13.720247  1093 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.720773 31541 rpcz_store.cc:276] 0709 12:24:11.277717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.301430 (+1023713us) service_pool.cc:224] Handling call
0709 12:24:12.301810 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.719478 (+1417668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.720225 (+   747us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003feb54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:13.720388 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634344320}
I20260709 12:24:13.721316  1093 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.721643 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:13.721838 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:13.722869 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.636219 32082 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEARNER]: Advancing to term 5
W20260709 12:24:13.723755 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.724454 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.569550 31543 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:13.725425 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.726111 31543 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:13.726750 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.646903 31540 rpcz_store.cc:276] 0709 12:24:11.154257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.157079 (+  2822us) service_pool.cc:224] Handling call
0709 12:24:12.945965 (+1788886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.241930 (+295965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.646382 (+404452us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b5400032d50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:13.646502 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4113264512}
I20260709 12:24:13.627287  1212 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:13.679220 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.689038 31387 rpcz_store.cc:276] 0709 12:24:12.507947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.508106 (+   159us) service_pool.cc:224] Handling call
0709 12:24:12.544287 (+ 36181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.687541 (+1143254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.688479 (+   938us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54002d05d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:13.688612 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164478208}
I20260709 12:24:13.581477 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:13.696316 31388 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.753816 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1592) took 1291 ms. Trace:
I20260709 12:24:13.754237 31465 rpcz_store.cc:276] 0709 12:24:12.461994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.238528 (+776534us) service_pool.cc:224] Handling call
0709 12:24:13.238850 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.373628 (+134778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.373656 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.373700 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:13.373732 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.753594 (+379862us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b54000faad4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:13.753636 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.753764 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105398,"raft.queue_time_us":119611,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6677,"spinlock_wait_cycles":66840320}
I20260709 12:24:13.704872  1117 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:24:13.759156 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 184477us
I20260709 12:24:13.760447 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:13.706653  1094 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.711908 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.624369 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.634425  1071 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:13.712994 31462 rpcz_store.cc:276] 0709 12:24:12.441465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.446401 (+  4936us) service_pool.cc:224] Handling call
0709 12:24:13.712455 (+1266054us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b5400271d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912b6853 00007f6e9628460a 00007f6e8f80a7d4 00007f6e8f80a762 00007f6e8f80a691 00007f6e8f80a60c 00007f6e8f8098c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:13.712530 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426653952}
I20260709 12:24:13.721261 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:13.632265   652 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:13.728655 31543 raft_consensus.cc:2410] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:24:13.729228 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.729773 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 82573.9us
I20260709 12:24:13.653806 31470 rpcz_store.cc:276] 0709 12:24:09.637622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.795573 (+2157951us) service_pool.cc:224] Handling call
0709 12:24:11.809733 (+ 14160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.821071 (+ 11338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.821117 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:12.580614 (+759497us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b2c00000a78. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc5372 00007f6e912f7a01 00007f6e912bc43a 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2
0709 12:24:12.581054 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:24:12.932818 (+351764us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:12.970910 (+ 38092us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.971168 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.973746 (+  2578us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.452419 (+478673us) raft_consensus.cc:1685] finished
0709 12:24:13.452552 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.452719 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38286,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":6629,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":83294,"spinlock_wait_cycles":29146368,"thread_start_us":198345,"threads_started":1,"wal-append.queue_time_us":291147}
I20260709 12:24:13.731830 31463 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:13.790045 31542 raft_consensus.cc:2368] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5.
I20260709 12:24:13.730443 31541 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:13.734858 32082 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:13.688865 31394 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:13.740029 31510 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:13.711177  1086 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.753005  1037 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:13.748728 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.433789 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.587765  1224 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:13.750345 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 375144us
I20260709 12:24:13.743083 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:13.755817 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 243) took 1087 ms. Trace:
I20260709 12:24:13.756937 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1585) took 2215 ms. Trace:
I20260709 12:24:13.642366   830 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:13.758003 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 358742us
I20260709 12:24:13.810119 31537 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:13.766028 31392 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:13.753453   849 consensus_queue.cc:1059] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:24:13.783619 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:13.783875 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:13.784809 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.837109 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:13.640110  1195 consensus_queue.cc:1243] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:13.728080   463 consensus_queue.cc:1059] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:24:13.791651 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 51695.1us
I20260709 12:24:13.736199 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.792007 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.739758 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:13.585220  1234 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:13.796087 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:13.752838  1184 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:13.753611  1212 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.751485  1185 raft_consensus.cc:697] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:13.809806 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:13.761340  1122 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:13.810711 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:13.829026 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:13.735502  1100 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:24:13.781319  1071 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.830740 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.794494 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:13.783063 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:13.837440 31539 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:13.799521  1221 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:13.837918 31395 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:13.794996  1208 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:13.633345  1178 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.826946  1206 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.807492  1179 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:13.845752 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:13.785620 31388 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:13.762152 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:13.845999 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:14.385748 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:14.386372 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.647s (SENT) [suppressed 24 similar messages]
I20260709 12:24:14.386510 31392 raft_consensus.cc:2376] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5. Re-sending same reply.
W20260709 12:24:14.388257 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 592185us
I20260709 12:24:14.389400 31433 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:14.390547 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:14.229027 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.391376 31466 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:14.391882 31470 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.801904 32076 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:13.810683  1084 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:14.392278 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 563329us
I20260709 12:24:14.386399 31394 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:14.410310 32050 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:14.410444 31539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
W20260709 12:24:14.406985 31361 connection.cc:256] RPC call timeout handler was delayed by -2.7081835490002959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 12:24:13.920979 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.570353 31536 rpcz_store.cc:276] 0709 12:24:11.277433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.238519 (+961086us) service_pool.cc:224] Handling call
0709 12:24:12.238813 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.239025 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:12.417607 (+178582us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.324312 (+906705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.330171 (+  5859us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:13.358324 (+ 28153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.366616 (+  8292us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.393489 (+ 26873us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":677701,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":13884,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":74,"thread_start_us":924375,"threads_started":2,"wal-append.queue_time_us":760669}
I20260709 12:24:14.414894 31389 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:14.030874 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:14.397341 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:14.398139 32083 raft_consensus.cc:2410] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:14.418977 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:14.188338  1190 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:14.420230 32083 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:14.420434  1190 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.308375   836 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:24:14.171764 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.890717 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.428186 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:14.429731 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:14.404083 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 614610us
I20260709 12:24:14.405038 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:14.404644 31464 rpcz_store.cc:276] 0709 12:24:12.668217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.243499 (+575282us) service_pool.cc:224] Handling call
0709 12:24:13.243803 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.352947 (+109144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.352976 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.353015 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:13.353044 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.755620 (+402576us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001c8ed4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:13.755659 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.755766 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2850,"raft.queue_time_us":7196,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":16072,"spinlock_wait_cycles":250360704}
I20260709 12:24:14.405162 31461 rpcz_store.cc:276] 0709 12:24:11.541326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.921190 (+1379864us) service_pool.cc:224] Handling call
0709 12:24:12.921552 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.448955 (+527403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.756747 (+307792us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54002a58d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:13.756885 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989325056}
W20260709 12:24:14.416265 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.436120 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.396057 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:14.399689 32077 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.025s
I20260709 12:24:14.421290 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:14.443651 31392 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:14.433461 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:13.976509  1205 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.425s
W20260709 12:24:13.859736  1191 consensus_meta.cc:287] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.001s
I20260709 12:24:14.450227 32083 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:14.449806 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:14.021690  1251 consensus_queue.cc:1059] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.525s
I20260709 12:24:13.969564  1095 consensus_queue.cc:1059] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.525s
I20260709 12:24:13.874769   925 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:13.833909  1224 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:14.422520  1206 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:14.425064  1179 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:13.846328 32075 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:14.076140  1145 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:14.391090  1208 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.838785   975 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.413276  1094 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.498193 31539 raft_consensus.cc:606] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:14.517792 31539 raft_consensus.cc:614] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:14.499076 31467 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:14.499136 31541 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.511708 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:14.519474 31464 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.502985 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1547) took 1103 ms. Trace:
I20260709 12:24:14.520500 31388 rpcz_store.cc:276] 0709 12:24:13.399724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.464527 (+ 64803us) service_pool.cc:224] Handling call
0709 12:24:14.502792 (+1038265us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b540028cb54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:14.502914 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19840256}
I20260709 12:24:14.505337 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:14.502919 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:14.403496   668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.000s	sys 0.012s
I20260709 12:24:14.523511 31461 raft_consensus.cc:2410] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:14.522495 31395 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:14.525700 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.527426 31462 raft_consensus.cc:2410] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:14.422693  1192 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:14.533187 31539 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:14.410375  1184 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:14.410789  1071 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.410064  1195 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:14.443261 32077 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.003s	sys 0.025s
I20260709 12:24:14.500137  1178 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.502506 32075 pending_rounds.cc:85] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Aborting all ops after (but not including) 5
I20260709 12:24:14.499869  1234 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:14.442917  1077 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.505728  1208 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.505419  1100 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:14.607506  1194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.006s	sys 0.007s
I20260709 12:24:14.505116 31537 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:13.903923  1117 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.633085 31464 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:14.664804 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:14.665455 31464 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.495616  1095 raft_consensus.cc:3055] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:14.592612 31387 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:14.499163  1047 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:14.501358  1179 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:14.497941   925 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:14.506819   971 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:14.502692  1221 raft_consensus.cc:697] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:14.691325 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.691697 31540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.041s	sys 0.057s
I20260709 12:24:14.642951 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:14.522436 31470 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:14.692348 31436 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:14.499584  1224 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:14.592777  1098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.007s	sys 0.011s
W20260709 12:24:14.593119   668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.005s	sys 0.013s
W20260709 12:24:14.537446  1129 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.000s	sys 0.015s
I20260709 12:24:14.624737 32080 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:14.591274  1235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.051s	sys 0.088s
I20260709 12:24:14.607574  1040 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.657116 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1598) took 1302 ms. Trace:
W20260709 12:24:14.725278 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 311514us
W20260709 12:24:14.725772 31361 connection.cc:256] RPC call timeout handler was delayed by -2.4271220569999059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
I20260709 12:24:14.725643 31467 rpcz_store.cc:276] 0709 12:24:13.355130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.465446 (+110316us) service_pool.cc:224] Handling call
0709 12:24:13.465784 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.518578 (+1052794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.656859 (+138281us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002995d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:14.657055 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2375762816}
I20260709 12:24:14.500597  1206 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:14.700258  1179 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:14.675459 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 315) took 1302 ms. Trace:
I20260709 12:24:14.622524  1192 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:14.647526 32075 pending_rounds.cc:107] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:14.502615  1122 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.145s
I20260709 12:24:14.634260 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:14.680650 31469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.007s	sys 0.043s
I20260709 12:24:14.591243   463 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:24:14.494024   836 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:14.658835  1194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.007s	sys 0.008s
I20260709 12:24:14.610723  1184 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.828085  1084 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:14.693116 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:14.672866  1095 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:14.721087 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:14.855166 31462 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:14.855274 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 354061us
W20260709 12:24:14.697551  1098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.007s	sys 0.011s
I20260709 12:24:14.722891 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:14.659672  1077 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:14.702490  1129 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.000s	sys 0.017s
I20260709 12:24:14.698189 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1552) took 1125 ms. Trace:
I20260709 12:24:14.728667 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:14.799176  1183 consensus_meta.cc:287] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.119s	user 0.009s	sys 0.002s
I20260709 12:24:14.498039  1191 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:14.704439  1235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.052s	sys 0.088s
I20260709 12:24:14.731107 31393 rpcz_store.cc:276] 0709 12:24:13.373213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.373382 (+   169us) service_pool.cc:224] Handling call
0709 12:24:13.373661 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.379444 (+  5783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.379486 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:13.392503 (+ 13017us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.468237 (+ 75734us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b1800424de0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:24:14.395673 (+927436us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:14.395726 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.395826 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.644786 (+248960us) raft_consensus.cc:1685] finished
0709 12:24:14.644803 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.675392 (+ 30589us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7764,"raft.queue_time_us":18934,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":28273,"spinlock_wait_cycles":6101888,"thread_start_us":319408,"threads_started":1,"wal-append.queue_time_us":1218468}
I20260709 12:24:14.731084  1179 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:14.736478 31361 connection.cc:256] RPC call timeout handler was delayed by -1.3509664240000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 12:24:14.795802   668 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.776999 31464 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:14.651140  1185 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.782217  1250 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:14.918031   668 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.920197   668 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:14.920511  1267 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.921018  1267 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.922947  1208 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:14.924140 31461 raft_consensus.cc:2393] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:14.925042  1208 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:14.927515 32079 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:14.780202 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 469) took 1143 ms. Trace:
W20260709 12:24:14.798437 31469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.007s	sys 0.054s
I20260709 12:24:14.928471 32080 rpcz_store.cc:276] 0709 12:24:13.636934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.637063 (+   129us) service_pool.cc:224] Handling call
0709 12:24:14.779995 (+1142932us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54006aed54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:14.780137 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194102656}
I20260709 12:24:14.929049 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1600) took 1573 ms. Trace:
I20260709 12:24:14.784608  1117 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.929441 31469 rpcz_store.cc:276] 0709 12:24:13.355690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.652175 (+296485us) service_pool.cc:224] Handling call
0709 12:24:13.652605 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.781632 (+129027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.781662 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:13.802197 (+ 20535us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.933353 (+131156us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b18003dc1e0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:24:14.259161 (+325808us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4800272358. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:24:14.928707 (+669546us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:14.928745 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.928819 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.928858 (+    39us) raft_consensus.cc:1685] finished
0709 12:24:14.928868 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.928999 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128664,"raft.queue_time_us":136161,"raft.run_cpu_time_us":3651,"raft.run_wall_time_us":469210,"spinlock_wait_cycles":10628864,"thread_start_us":995162,"threads_started":1,"wal-append.queue_time_us":1015881}
I20260709 12:24:14.735924 32075 raft_consensus.cc:2889] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:14.930799  1095 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.932046  1095 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.732157  1040 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:14.829386  1086 consensus_meta.cc:287] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.029s	user 0.008s	sys 0.002s
I20260709 12:24:14.934334  1040 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:14.692045 31540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.041s	sys 0.057s
I20260709 12:24:14.780804 32083 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:14.830448  1255 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:24:14.832005   975 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:14.833544   997 consensus_meta.cc:287] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.118s	user 0.005s	sys 0.005s
I20260709 12:24:14.834779  1192 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:14.839538 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:14.856485 31470 raft_consensus.cc:2393] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:14.872244 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:14.777905 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 387379us
I20260709 12:24:14.877120 31510 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:14.879491 31462 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:14.954941 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1605) took 1318 ms. Trace:
I20260709 12:24:14.881990 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:14.955615 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 83440.5us
I20260709 12:24:14.954311 31433 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:14.956194 31464 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:14.956419 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:14.959089 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 82066.6us
I20260709 12:24:14.959596 31361 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:14.955392 31462 rpcz_store.cc:276] 0709 12:24:13.636052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.953971 (+1317919us) service_pool.cc:224] Handling call
0709 12:24:14.954322 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.954531 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.954569 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:14.954626 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:14.954672 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.954743 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.954877 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:14.962082 31462 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:14.962838 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1609) took 1242 ms. Trace:
I20260709 12:24:14.963213 31462 rpcz_store.cc:276] 0709 12:24:13.720199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.961397 (+1241198us) service_pool.cc:224] Handling call
0709 12:24:14.961791 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.962528 (+   737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.962775 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:14.965469 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:14.966670 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:14.967024 31462 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:14.967938 32050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.007s	sys 0.015s
I20260709 12:24:14.895984  1212 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:14.899469 31386 consensus_meta.cc:287] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.066s	user 0.005s	sys 0.005s
I20260709 12:24:14.859987 32077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 463) took 1668 ms. Trace:
I20260709 12:24:14.899647  1071 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.900722  1077 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:14.904603  1244 consensus_meta.cc:287] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.245s	user 0.011s	sys 0.000s
I20260709 12:24:14.870849  1183 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:14.786945  1221 consensus_queue.cc:237] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:14.906062  1037 consensus_meta.cc:287] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.097s	user 0.002s	sys 0.008s
I20260709 12:24:14.907559   836 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:14.911185 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.980935   925 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:14.967579  1270 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:14.881520  1179 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.917579   652 raft_consensus.cc:3055] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:14.918206  1250 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.925096 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1463) took 1188 ms. Trace:
I20260709 12:24:15.024163 31461 rpcz_store.cc:276] 0709 12:24:13.737189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.696493 (+959304us) service_pool.cc:224] Handling call
0709 12:24:14.924922 (+228429us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54000fa5d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:14.925044 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155489664}
W20260709 12:24:14.929239 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1519) took 1587 ms (client timeout 1859 ms). Trace:
W20260709 12:24:15.025555 31538 rpcz_store.cc:269] 0709 12:24:13.341513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.372844 (+ 31331us) service_pool.cc:224] Handling call
0709 12:24:14.929068 (+1556224us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002b5a54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:14.929185 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3441468800}
I20260709 12:24:14.799149 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:14.936031 32081 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:14.829927  1190 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:14.968170 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1469) took 1222 ms. Trace:
I20260709 12:24:14.893265 31466 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:24:14.970988 32050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.007s	sys 0.015s
W20260709 12:24:14.973757 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.037055 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.039319 31462 rpcz_store.cc:276] 0709 12:24:13.746052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.966274 (+1220222us) service_pool.cc:224] Handling call
0709 12:24:14.966612 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.967938 (+  1326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.968122 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:14.979868 32082 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:24:14.987867 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 438804us
I20260709 12:24:14.923168  1267 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:14.994789 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.040628 31463 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:14.958789  1205 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:14.917514  1184 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:14.967996   463 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:14.998095 31510 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:14.993156 31464 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:24:15.000669 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:14.912529  1191 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:15.001394 31391 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:15.002571 31434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.008s	sys 0.019s
W20260709 12:24:15.064224 31434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.008s	sys 0.019s
W20260709 12:24:15.064800 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 631386us
I20260709 12:24:15.065529 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:15.013737 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.014930 31465 raft_consensus.cc:2393] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:14.860113 31537 rpcz_store.cc:276] 0709 12:24:13.571675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.874889 (+303214us) service_pool.cc:224] Handling call
0709 12:24:14.449274 (+574385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.661884 (+212610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.696551 (+ 34667us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:15.015612 31509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.010s	sys 0.022s
W20260709 12:24:15.072597 31509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.011s	sys 0.022s
W20260709 12:24:15.017390 31392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.017s
W20260709 12:24:15.074503 31392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.003s	sys 0.017s
I20260709 12:24:14.981693 31386 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:15.027778 31467 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:14.998955  1077 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.995931  1195 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.994410  1208 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.012933  1037 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:14.980618  1206 consensus_queue.cc:1059] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:24:15.049630 31507 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.023s	sys 0.020s
W20260709 12:24:15.109171 31507 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.023s	sys 0.020s
W20260709 12:24:15.109532 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 723124us
W20260709 12:24:15.110214 31507 leader_election.cc:336] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.942s (SENT)
I20260709 12:24:15.110682 31507 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:15.067112 31434 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:15.112016 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 44972.2us
I20260709 12:24:15.113492 31434 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:14.999107  1100 raft_consensus.cc:697] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:14.996255   849 consensus_queue.cc:1059] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:15.001797  1122 consensus_queue.cc:1059] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:24:15.032097   925 raft_consensus.cc:697] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:15.025293   652 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:15.092849 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1478) took 1305 ms. Trace:
I20260709 12:24:15.073627  1183 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:15.105010  1086 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.108385 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:15.128486 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:15.092605  1094 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:15.046875   463 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:15.130540   463 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.131927 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1520) took 1790 ms. Trace:
I20260709 12:24:15.132759 31540 rpcz_store.cc:276] 0709 12:24:13.341773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.727533 (+385760us) service_pool.cc:224] Handling call
0709 12:24:13.727817 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.728009 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:14.935552 (+1207543us) log.cc:844] Serialized 14 byte log entry
0709 12:24:15.131447 (+195895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:15.131517 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:15.131577 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.131656 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.131837 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9262,"prepare.queue_time_us":1154079,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"thread_start_us":1393349,"threads_started":3,"wal-append.queue_time_us":173523}
I20260709 12:24:14.996860  1244 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:14.999388  1271 consensus_queue.cc:1059] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:24:15.118955 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 226) took 1440 ms. Trace:
I20260709 12:24:15.135959 31542 rpcz_store.cc:276] 0709 12:24:13.678420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.925374 (+246954us) service_pool.cc:224] Handling call
0709 12:24:14.548425 (+623051us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:14.548672 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.548916 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:15.002235 (+453319us) log.cc:844] Serialized 14 byte log entry
0709 12:24:15.118642 (+116407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:15.118690 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:15.118731 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.118800 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.118903 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29999,"prepare.queue_time_us":367615,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"spinlock_wait_cycles":43632512,"thread_start_us":453799,"threads_started":2,"wal-append.queue_time_us":119823}
I20260709 12:24:15.119963 31467 rpcz_store.cc:276] 0709 12:24:13.787560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.775799 (+988239us) service_pool.cc:224] Handling call
0709 12:24:15.092785 (+316986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:15.035755  1178 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:15.121007 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 154405us
I20260709 12:24:15.099630 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:15.098371 31386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1587) took 1709 ms (client timeout 2053 ms). Trace:
I20260709 12:24:15.126052 32080 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:15.137516 31535 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:15.124925 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.116631   836 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:15.120797  1040 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:15.339541 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 196960us
I20260709 12:24:15.255915 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:15.382385 31467 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:24:15.382875 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.143491  1244 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:15.115885  1195 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:15.115679  1208 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:15.121805  1234 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:15.176059 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.388525  1234 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:15.156950  1191 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.395164 31361 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:15.159605  1205 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:15.405371 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 407257us
I20260709 12:24:15.143224  1086 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:15.395562  1098 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:15.493110 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.437667 31467 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:15.156217  1178 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:15.517686 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:15.156586 31386 rpcz_store.cc:269] 0709 12:24:13.384492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.392588 (+  8096us) service_pool.cc:224] Handling call
0709 12:24:15.093687 (+1701099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:15.515583   925 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:15.520387 31467 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:15.405046   975 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.524977 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:15.527828 31467 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:15.529732 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:15.536336 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 158886us
I20260709 12:24:15.432379  1281 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:15.519169  1098 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.509162  1047 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:15.520227   830 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:15.544241 32084 consensus_meta.cc:287] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 12:24:15.406582  1191 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:15.549612 32084 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:15.432919  1266 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:15.533565  1037 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.530385  1212 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:15.560235 32050 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:15.527390 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:15.396590   652 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:15.548025  1098 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:15.574298 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0703278360001605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 12:24:15.431540  1100 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:15.576330 31542 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:15.579164 31538 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:15.579615 31538 pending_rounds.cc:85] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 6
I20260709 12:24:15.579875 31538 pending_rounds.cc:107] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:15.580130 31538 raft_consensus.cc:2889] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:14.981927 32077 rpcz_store.cc:276] 0709 12:24:13.184949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.216842 (+ 31893us) service_pool.cc:224] Handling call
0709 12:24:13.347183 (+130341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.757507 (+410324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.762440 (+  4933us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:13.836871 (+ 74431us) log.cc:844] Serialized 26 byte log entry
0709 12:24:14.642510 (+805639us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:14.642556 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.785459 (+142903us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b5400530cd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:14.785509 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.785567 (+    58us) raft_consensus.cc:1685] finished
0709 12:24:14.785583 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.853674 (+ 68091us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7692,"raft.queue_time_us":31768,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"spinlock_wait_cycles":112221440,"thread_start_us":1080534,"threads_started":2,"wal-append.queue_time_us":659022}
I20260709 12:24:15.548239  1071 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:15.576889 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:15.576889 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:15.551863  1206 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:15.566129  1037 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:15.535287   975 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:15.551838  1047 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:15.548902  1281 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:15.564606  1266 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:15.561033  1301 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.587347 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:15.588004 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:15.571741  1308 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:15.577623 31358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.012s
I20260709 12:24:15.583038 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:15.888428  1285 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:24:15.961835 31467 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.887693 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 225) took 2210 ms. Trace:
I20260709 12:24:15.670588 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1604) took 2312 ms. Trace:
I20260709 12:24:15.891583 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1603) took 2535 ms. Trace:
W20260709 12:24:15.950208 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.002s	sys 0.011s
W20260709 12:24:15.582334  1258 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.737s	user 0.004s	sys 0.000s
W20260709 12:24:15.621238 32081 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 416) took 1900 ms (client timeout 1627 ms). Trace:
W20260709 12:24:15.872885 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 118210us
I20260709 12:24:15.679567 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:15.962764 31543 rpcz_store.cc:276] 0709 12:24:13.677330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.925736 (+248406us) service_pool.cc:224] Handling call
0709 12:24:14.593874 (+668138us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:14.594124 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.594422 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.594458 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.595000 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:24:14.997653 (+402653us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:14.997686 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.997748 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:15.887294 (+889546us) raft_consensus.cc:1685] finished
0709 12:24:15.887342 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.887615 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39069568,"thread_start_us":339376,"threads_started":1,"wal-append.queue_time_us":1152586}
I20260709 12:24:15.572471  1194 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:15.693398 31434 connection.cc:256] RPC call timeout handler was delayed by -1.1972705260000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
I20260709 12:24:15.964819 31470 rpcz_store.cc:276] 0709 12:24:13.357694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.951541 (+1593847us) service_pool.cc:224] Handling call
0709 12:24:14.951896 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.952655 (+   759us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:15.117069 (+164414us) log.cc:844] Serialized 14 byte log entry
0709 12:24:15.539998 (+422929us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:15.540778 (+   780us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.541088 (+   310us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:15.541145 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.541295 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:15.670299 (+129004us) raft_consensus.cc:1685] finished
0709 12:24:15.670327 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.670512 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19146,"prepare.queue_time_us":451200,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":99751,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":28174,"thread_start_us":300262,"threads_started":2,"wal-append.queue_time_us":442026}
W20260709 12:24:16.006719 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.004s	sys 0.012s
I20260709 12:24:16.010951 31467 raft_consensus.cc:2410] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:24:16.005707 32081 rpcz_store.cc:269] 0709 12:24:13.720854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.721444 (+   590us) service_pool.cc:224] Handling call
0709 12:24:15.621055 (+1899611us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540064c154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:15.621164 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791298304}
I20260709 12:24:15.582592  1297 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.964987 31469 rpcz_store.cc:276] 0709 12:24:13.356591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.931141 (+1574550us) service_pool.cc:224] Handling call
0709 12:24:14.936183 (+  5042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.936527 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.936565 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.939950 (+  3385us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.126440 (+186490us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:15.126565 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.126781 (+   216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:15.891312 (+764531us) raft_consensus.cc:1685] finished
0709 12:24:15.891339 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.891505 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238,"raft.queue_time_us":607,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4151,"thread_start_us":141516,"threads_started":1,"wal-append.queue_time_us":908556}
W20260709 12:24:15.650626  1288 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:24:15.632057  1234 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:15.632824  1293 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:24:15.944798   463 consensus_meta.cc:287] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.004s
I20260709 12:24:15.622509 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:16.037827 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 643719us
I20260709 12:24:16.534343 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:15.995929 31359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.000s	sys 0.013s
W20260709 12:24:16.536795 31359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.494s	user 0.000s	sys 0.015s
I20260709 12:24:16.537174 31361 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:16.037055 31358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.003s	sys 0.016s
I20260709 12:24:16.540031 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:16.541041 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.542165 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.542706 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.544869 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:16.547644 31386 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:16.549551 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:16.551301 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.552915 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.553625 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.554198 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.554924 31392 raft_consensus.cc:2393] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:16.555115 31390 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:16.555970  1342 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:16.556377 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:16.556421 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.557531 31392 raft_consensus.cc:2393] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:16.557471 31390 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:16.558581 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:16.558614 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.559556 31392 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.560227 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 320) took 2043 ms. Trace:
I20260709 12:24:16.560752 31391 rpcz_store.cc:276] 0709 12:24:14.517185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.517326 (+   141us) service_pool.cc:224] Handling call
0709 12:24:14.517657 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:15.071917 (+554260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.559690 (+1487773us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540027f954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:16.560022 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106699136}
I20260709 12:24:16.562413 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.563975 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:16.556522  1342 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:16.564954 31394 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.565038  1342 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.565698 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:16.566538 31393 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:16.051011 31434 leader_election.cc:336] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.928s (SENT)
I20260709 12:24:16.571394 31434 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:16.573957 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 522932us
I20260709 12:24:16.577574 31434 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:16.581398 31394 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:16.582491 31388 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:16.586165 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:16.587838 31436 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:16.588096 31463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1472) took 2835 ms (client timeout 1910 ms). Trace:
W20260709 12:24:16.589257 31466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1479) took 2801 ms (client timeout 2152 ms). Trace:
W20260709 12:24:16.590399 31465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1464) took 2852 ms (client timeout 1680 ms). Trace:
I20260709 12:24:16.592234 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 249) took 1548 ms. Trace:
I20260709 12:24:16.037235 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:16.038682 31469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
W20260709 12:24:16.289322 31509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.024s	sys 0.048s
I20260709 12:24:16.071336 31507 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:16.594545 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.032653 31537 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:15.900072   689 raft_consensus.cc:3055] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:16.625181 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1538) took 1047 ms. Trace:
I20260709 12:24:16.625731 31537 rpcz_store.cc:276] 0709 12:24:15.577907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.578080 (+   173us) service_pool.cc:224] Handling call
0709 12:24:16.625007 (+1046927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.626514  1192 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:16.626528 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 555164us
I20260709 12:24:16.625219   689 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:16.628021 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.626932  1299 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:16.331720 32050 leader_election.cc:336] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.611s (SENT)
I20260709 12:24:15.636723  1292 raft_consensus.cc:3055] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:16.629933  1040 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:16.630704  1292 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:16.631065  1094 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:16.632110  1094 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:16.631121  1040 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:16.632566  1224 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:16.633397  1040 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.057751  1297 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.185462 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1551) took 2752 ms. Trace:
I20260709 12:24:16.094043 32079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 466) took 2459 ms. Trace:
I20260709 12:24:16.209511 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:16.101054 32082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 445) took 2315 ms (client timeout 2152 ms). Trace:
I20260709 12:24:15.634580  1071 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.647624  1331 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:16.648463  1071 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.648788  1267 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:16.649711  1267 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.649914 31535 rpcz_store.cc:276] 0709 12:24:13.433572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.803523 (+369951us) service_pool.cc:224] Handling call
0709 12:24:13.835327 (+ 31804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:15.157106 (+1321779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.185138 (+1028032us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400322dd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:16.185367 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2994275584}
I20260709 12:24:16.651407 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.629338  1315 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:16.652383 31470 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:16.104735  1184 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.652781  1315 raft_consensus.cc:697] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:15.634864  1204 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.605154   463 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:16.197248 32084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 443) took 2451 ms (client timeout 2229 ms). Trace:
I20260709 12:24:16.654141  1204 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:16.652252 32082 rpcz_store.cc:269] 0709 12:24:13.785318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.799450 (+ 14132us) service_pool.cc:224] Handling call
0709 12:24:16.095134 (+2295684us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54001d24d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.098438 (+  3304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270726912}
I20260709 12:24:15.583379   652 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:15.899063   668 consensus_queue.cc:1059] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.757s
I20260709 12:24:16.606191  1234 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:16.619971  1205 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:15.898228   830 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:16.607654   925 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.657785  1313 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:16.658259 31389 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:15.839551  1284 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.440s	user 0.001s	sys 0.000s
I20260709 12:24:15.686792  1250 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.133164 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 471) took 1101 ms. Trace:
W20260709 12:24:16.100833  1257 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 1.417s	user 0.006s	sys 0.001s
I20260709 12:24:16.178247  1047 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:15.592136  1206 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.169106  1235 raft_consensus.cc:3055] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:16.212622  1098 consensus_meta.cc:287] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 12:24:16.661707  1235 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:16.662238  1098 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:15.925104  1271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.000s	sys 0.010s
I20260709 12:24:16.037825  1320 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.587s
I20260709 12:24:16.617527  1321 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.633949  1212 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.984s
I20260709 12:24:15.827965  1302 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:16.314608  1270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.172s	user 0.005s	sys 0.011s
I20260709 12:24:16.035319  1194 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.618870 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1541) took 1031 ms. Trace:
I20260709 12:24:16.691802 31538 rpcz_store.cc:276] 0709 12:24:15.587214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.587349 (+   135us) service_pool.cc:224] Handling call
0709 12:24:16.618498 (+1031149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.692641 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:16.663205  1235 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.166992  1191 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:15.883970  1310 consensus_queue.cc:1059] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.736s
I20260709 12:24:15.856731  1086 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:16.693797 31539 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:16.693859  1235 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.693207 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.108035  1195 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.046548  1304 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.691982 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.696705 31541 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 1.
I20260709 12:24:16.696166  1304 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.337424  1281 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:15.883508  1145 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:16.699491  1270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.580s	user 0.007s	sys 0.020s
I20260709 12:24:16.699205  1145 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.699869  1270 raft_consensus.cc:697] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:16.014873  1095 consensus_meta.cc:287] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.082s	user 0.009s	sys 0.005s
I20260709 12:24:16.701273  1270 consensus_queue.cc:237] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.702546 31395 raft_consensus.cc:2410] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:16.703821 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 322) took 1899 ms. Trace:
I20260709 12:24:16.704151 31395 rpcz_store.cc:276] 0709 12:24:14.804183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.804350 (+   167us) service_pool.cc:224] Handling call
0709 12:24:16.703571 (+1899221us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002e2cd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.703747 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4027723648}
I20260709 12:24:16.704758  1206 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.705731  1340 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.706380  1340 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.706710  1234 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:16.707613  1122 raft_consensus.cc:3055] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:16.708041  1122 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:16.709185  1122 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.705729  1321 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.660458 32080 rpcz_store.cc:276] 0709 12:24:15.031409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.584966 (+553557us) service_pool.cc:224] Handling call
0709 12:24:15.653681 (+ 68715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:15.654229 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:15.654267 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:15.669234 (+ 14967us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.859905 (+190671us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:15.859961 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.860052 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.132892 (+272840us) raft_consensus.cc:1685] finished
0709 12:24:16.132921 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.133088 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":12069,"thread_start_us":189635,"threads_started":1,"wal-append.queue_time_us":370012}
I20260709 12:24:16.695093 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.137230  1037 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.621028 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.714850 31391 raft_consensus.cc:2410] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:24:16.611447 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 65662.2us
I20260709 12:24:16.627635  1273 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.718353  1273 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:16.719419  1314 consensus_queue.cc:1175] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "503bef451a2b424fa35e8e46b8c06f29" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 5 index: 4 } }
I20260709 12:24:16.628479  1325 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.720582  1325 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:16.214202 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.722752 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.722915  1302 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:15.887072 32075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 417) took 1525 ms. Trace:
I20260709 12:24:15.851991 32078 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:16.726202  1297 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.727090 32078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 419) took 1625 ms. Trace:
I20260709 12:24:16.162295  1208 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.635563  1084 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.727514 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:16.728158  1084 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:16.639707 31509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.028s	sys 0.051s
W20260709 12:24:15.749109  1290 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.491s	user 0.000s	sys 0.001s
I20260709 12:24:16.629621 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:16.625144 31469 raft_consensus.cc:606] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:16.730230 31469 raft_consensus.cc:614] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:16.640527 31540 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 12:24:16.731117  1281 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.727527 32078 rpcz_store.cc:276] 0709 12:24:15.101657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.591986 (+490329us) service_pool.cc:224] Handling call
0709 12:24:15.688825 (+ 96839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.726551 (+1037726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.726898 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.733078 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:16.725978 32075 rpcz_store.cc:276] 0709 12:24:14.362068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.501956 (+139888us) service_pool.cc:224] Handling call
0709 12:24:14.502298 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:14.931749 (+429451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.931779 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:14.932385 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 12:24:15.404133 (+471748us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:15.415384 (+ 11251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.415492 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:15.886806 (+471314us) raft_consensus.cc:1685] finished
0709 12:24:15.886834 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.887001 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1652,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":669568,"thread_start_us":298868,"threads_started":1,"wal-append.queue_time_us":838715}
I20260709 12:24:16.737140 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:16.738134 32081 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:16.738236 31433 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:16.152926  1179 consensus_meta.cc:287] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.116s	user 0.010s	sys 0.001s
I20260709 12:24:16.739601  1208 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:16.740018  1208 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:16.740474  1208 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.740175  1179 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.730950 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55830 (request call id 12) took 1326 ms. Trace:
I20260709 12:24:16.741142 31469 rpcz_store.cc:276] 0709 12:24:15.405314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.038565 (+633251us) service_pool.cc:224] Handling call
0709 12:24:16.730835 (+692270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.741685 31461 raft_consensus.cc:2368] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 7. Current term is 8.
I20260709 12:24:16.742563 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:16.743022 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:16.744433  1179 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.744729 31540 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:16.745206 31540 pending_rounds.cc:85] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 6
I20260709 12:24:16.745509 31540 pending_rounds.cc:107] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:16.745807 31540 raft_consensus.cc:2889] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:16.635551 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:16.629426 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.747781 31390 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:16.322425  1266 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.607092   542 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.748164 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:16.748296 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:16.748885   542 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.750644 31462 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:24:16.623095 31466 rpcz_store.cc:269] 0709 12:24:13.787856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.429418 (+641562us) service_pool.cc:224] Handling call
0709 12:24:16.588807 (+2159389us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400299fd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.589014 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1014217472}
I20260709 12:24:16.751438 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1473) took 2965 ms. Trace:
I20260709 12:24:16.642663 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.646245 32079 rpcz_store.cc:276] 0709 12:24:13.634769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.641321 (+  6552us) service_pool.cc:224] Handling call
0709 12:24:13.657867 (+ 16546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.927923 (+1270056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.093636 (+1165713us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000dbbd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:16.093928 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2919211776}
I20260709 12:24:16.756369  1084 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.646963 31388 raft_consensus.cc:3055] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:16.647285  1272 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:16.757016 31388 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:16.758087  1302 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.758224 31388 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.760851 32048 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:16.763074  1086 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.763449  1086 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:16.763842  1086 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.766801  1321 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.768041  1273 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.769631 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:16.769825  1267 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.770511 32081 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:16.771449 31542 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:16.771672 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:16.771924  1098 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.772909 31388 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:16.773214 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:16.773881 32075 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.652133  1071 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.094692 32083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 442) took 2350 ms. Trace:
I20260709 12:24:16.625823  1183 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:15.668527  1276 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:16.607786   836 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:15.920122   849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.004s	sys 0.010s
I20260709 12:24:16.339025   975 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:16.288185  1077 consensus_meta.cc:287] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.181s	user 0.012s	sys 0.000s
I20260709 12:24:15.928665  1221 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.688s
I20260709 12:24:16.658270   925 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.211694  1300 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:16.659581  1192 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:15.965734  1178 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.664338 31394 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:16.664927 31386 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:16.623394 31465 rpcz_store.cc:269] 0709 12:24:13.737882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.783657 (+ 45775us) service_pool.cc:224] Handling call
0709 12:24:16.589896 (+2806239us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003a89d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.590165 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2707567488}
W20260709 12:24:16.654942 32084 rpcz_store.cc:269] 0709 12:24:13.745372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.834239 (+ 88867us) service_pool.cc:224] Handling call
0709 12:24:16.197023 (+2362784us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54000daf54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.197156 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199331584}
W20260709 12:24:16.663823 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 54400.9us
W20260709 12:24:16.678050 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 133280us
I20260709 12:24:16.654379  1315 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:16.622781 31463 rpcz_store.cc:269] 0709 12:24:13.752029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.790344 (+ 38315us) service_pool.cc:224] Handling call
0709 12:24:16.587623 (+2797279us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54002a5dd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.587844 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431419136}
W20260709 12:24:15.592414  1268 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 12:24:16.193462 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:16.688585 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 466973us
I20260709 12:24:16.686698   463 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.691943  1194 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.693048   689 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:16.164150  1282 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.583s	user 0.001s	sys 0.000s
W20260709 12:24:15.827373  1295 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.411s	user 0.001s	sys 0.000s
I20260709 12:24:16.623520 31467 rpcz_store.cc:276] 0709 12:24:15.044185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.529425 (+485240us) service_pool.cc:224] Handling call
0709 12:24:16.591767 (+1062342us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54002c6354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.592028 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991028480}
W20260709 12:24:16.086921  1303 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:24:16.751966   542 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.756094 31543 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:16.751811 31462 rpcz_store.cc:276] 0709 12:24:13.785999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.749425 (+2963426us) service_pool.cc:224] Handling call
0709 12:24:16.749995 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.751120 (+  1125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.751354 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:16.777400 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 445681us
I20260709 12:24:16.779709  1281 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:16.780814   849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.627s	user 0.010s	sys 0.029s
I20260709 12:24:16.781041 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:16.786140 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:16.791257 32076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 447) took 1767 ms (client timeout 1888 ms). Trace:
I20260709 12:24:16.791963  1077 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.792129 32083 rpcz_store.cc:276] 0709 12:24:13.744012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.513481 (+769469us) service_pool.cc:224] Handling call
0709 12:24:14.780636 (+267155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.936161 (+155525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.094463 (+1158302us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54006aed50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.094627 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613596416}
I20260709 12:24:16.842758 31470 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:16.794621  1300 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:16.789081 31461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 245) took 1793 ms (client timeout 1611 ms). Trace:
I20260709 12:24:16.789590 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.787835 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.179515  1323 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:16.816918   689 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:16.817416 31436 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:16.817826 31467 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:16.796278 31510 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:16.014387  1301 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.902230   849 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:16.902858   849 raft_consensus.cc:697] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:16.903302 31470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1616) took 1365 ms (client timeout 1726 ms). Trace:
I20260709 12:24:16.903975   849 consensus_queue.cc:237] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.904897  1301 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.905772 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.906683 31394 raft_consensus.cc:2410] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:16.906898 31539 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:16.907567 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1475) took 3120 ms. Trace:
I20260709 12:24:16.907950 31467 rpcz_store.cc:276] 0709 12:24:13.786632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.817045 (+3030413us) service_pool.cc:224] Handling call
0709 12:24:16.817514 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.907297 (+ 89783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.907481 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.908946 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:16.909307 31467 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:16.909953 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1482) took 2512 ms. Trace:
I20260709 12:24:16.910529 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.910933  1281 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:16.911533 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 94228us
I20260709 12:24:16.912262  1281 raft_consensus.cc:3055] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:16.912676  1281 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:16.912792  1037 raft_consensus.cc:2764] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:16.913695  1281 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.914976 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:16.915936  1194 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.822914  1122 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.916177 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:16.917150 32080 raft_consensus.cc:2368] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6.
W20260709 12:24:16.822463 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.824519 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.823843 31462 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 12:24:16.827067 31393 raft_consensus.cc:2410] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:16.919406 31390 raft_consensus.cc:2410] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:16.822927 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.827427  1292 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.920166 31543 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:16.920495  1292 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:16.920784  1303 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:24:16.921016  1281 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.921181 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.922528 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.828231 31388 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
W20260709 12:24:16.829171 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.829282  1340 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.829604  1084 consensus_queue.cc:1059] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:16.830762  1266 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:16.923149 31543 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:16.938778  1244 raft_consensus.cc:3055] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:16.933596 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.948401  1244 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:16.948972 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:16.903733 31470 rpcz_store.cc:269] 0709 12:24:15.537567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.036959 (+499392us) service_pool.cc:224] Handling call
0709 12:24:16.903077 (+866118us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5400018954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.903193 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63202560}
I20260709 12:24:16.949456  1244 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.950169 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:16.837033 31392 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
W20260709 12:24:16.925715 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 187718us
W20260709 12:24:16.842691 32076 rpcz_store.cc:269] 0709 12:24:15.028321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.035421 (+  7100us) service_pool.cc:224] Handling call
0709 12:24:16.193324 (+1157903us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197eee 000000000036eb39 00007f6e9620b1e0 00007f6e962d40c4 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:16.791029 (+597705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23604992}
I20260709 12:24:16.848716 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 227) took 2099 ms. Trace:
I20260709 12:24:16.930307 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:16.849459 31541 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:16.851457  1234 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.852697 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:16.845142  1183 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:24:16.854151 31387 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
W20260709 12:24:16.843802 31461 rpcz_store.cc:269] 0709 12:24:14.995541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.128151 (+132610us) service_pool.cc:224] Handling call
0709 12:24:16.782383 (+1654232us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540029a9d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:16.789002 (+  6619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707465472}
I20260709 12:24:16.924461 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1606) took 3288 ms. Trace:
I20260709 12:24:16.861366 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1602) took 3504 ms. Trace:
I20260709 12:24:16.863492  1204 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.871542  1071 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:16.876130  1300 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.878690 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:16.783589  1342 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.858912 31359 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:16.030540  1308 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.886337  1341 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:16.887240 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:16.887948 31389 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:16.987506 31542 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:16.888741  1179 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.874930  1208 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.890951  1323 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.893021   925 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.893426 31463 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:16.893816  1040 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.004642  1040 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.820627  1272 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:17.005599  1272 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.006870  1323 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.898350 32047 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:16.900604 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 69710.7us
W20260709 12:24:16.901997 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 106835us
I20260709 12:24:16.915974 32083 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:16.825280 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:16.919693 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1476) took 3132 ms. Trace:
I20260709 12:24:16.974473 31388 pending_rounds.cc:85] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 4
I20260709 12:24:16.962180 31539 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
W20260709 12:24:16.971001 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.014348 31388 pending_rounds.cc:107] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:24:17.014254 31462 rpcz_store.cc:276] 0709 12:24:13.786948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.823142 (+3036194us) service_pool.cc:224] Handling call
0709 12:24:16.823572 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.919458 (+ 95886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.919642 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.014743 31388 raft_consensus.cc:2889] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:17.007586  1341 consensus_queue.cc:1243] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:17.015544 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:17.015753 31462 raft_consensus.cc:1240] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:16.978011 31544 rpcz_store.cc:276] 0709 12:24:14.732714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.733229 (+   515us) service_pool.cc:224] Handling call
0709 12:24:14.733643 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.734062 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.734101 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.734661 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:24:14.985004 (+250343us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:14.998464 (+ 13460us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.999887 (+  1423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.999958 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.163464 (+1163506us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:16.830925 (+667461us) raft_consensus.cc:1685] finished
0709 12:24:16.831057 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.832363 (+  1306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1125,"prepare.queue_time_us":13288,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":3331,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":57439,"spinlock_wait_cycles":2366336,"thread_start_us":249979,"threads_started":1,"wal-append.queue_time_us":802234}
I20260709 12:24:17.016637 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1486) took 2525 ms. Trace:
I20260709 12:24:17.011148  1342 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.018633 31510 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:16.961211  1086 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:16.941314 31436 leader_election.cc:400] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6.
I20260709 12:24:17.021059 31436 leader_election.cc:403] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:24:17.021628 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 80673.2us
I20260709 12:24:16.945523 31466 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:24:16.910363 31467 rpcz_store.cc:276] 0709 12:24:14.397868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.908664 (+2510796us) service_pool.cc:224] Handling call
0709 12:24:16.909084 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.909709 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.909889 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.847767 31386 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:16.954667 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.842592  1192 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.859460  1077 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:16.924691  1320 raft_consensus.cc:3055] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:16.951129  1244 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.923358  1194 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.048312  1235 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.890157  1325 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.945142  1310 raft_consensus.cc:3055] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:17.049396  1310 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:17.049664 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 151385us
I20260709 12:24:17.050817  1310 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:17.052245 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.052626  1310 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:16.996047 31507 connection.cc:256] RPC call timeout handler was delayed by -1.6655966750004154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 12:24:17.053627 31507 connection.cc:256] RPC call timeout handler was delayed by -1.6484966750003878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 12:24:17.053944 31507 connection.cc:256] RPC call timeout handler was delayed by -1.6459074809999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 12:24:17.054212 31507 connection.cc:256] RPC call timeout handler was delayed by -1.640507480999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:24:16.997359  1179 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:16.930728  1273 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.054487 31389 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:17.054972  1273 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.056524  1179 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.001120 31535 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:17.057071  1273 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.996227  1071 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.002279  1191 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:17.007596 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 77397.4us
I20260709 12:24:17.007961  1272 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:16.895649 31465 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:24:17.008497 31538 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:17.008575 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1477) took 3221 ms. Trace:
I20260709 12:24:17.009338  1308 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:17.009462 31469 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:17.010484   836 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.011374 31540 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:17.017102 31462 rpcz_store.cc:276] 0709 12:24:14.490910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.015116 (+2524206us) service_pool.cc:224] Handling call
0709 12:24:17.015522 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.016341 (+   819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.016563 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.937501 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:16.951104 31470 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:17.018688 31391 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
W20260709 12:24:17.020107 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 161295us
I20260709 12:24:16.989363  1234 raft_consensus.cc:3055] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:16.999090 31536 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.981153 31468 rpcz_store.cc:276] 0709 12:24:13.356303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.711631 (+355328us) service_pool.cc:224] Handling call
0709 12:24:13.711941 (+   310us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:24:13.781552 (+ 69611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.781585 (+    33us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:24:13.795756 (+ 14171us) log.cc:844] Serialized 104 byte log entry
0709 12:24:14.857066 (+1061310us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:15.137775 (+280709us) log.cc:844] Serialized 14 byte log entry
0709 12:24:15.138190 (+   415us) log.cc:844] Serialized 14 byte log entry
0709 12:24:15.420625 (+282435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.421158 (+   533us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.109711 (+688553us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b180048dae0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e19d2a6 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1
0709 12:24:16.171880 (+ 62169us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b180048dae0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:16.860662 (+688782us) raft_consensus.cc:1685] finished
0709 12:24:16.860727 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.861077 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65606,"prepare.queue_time_us":936687,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":581479,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":43267,"spinlock_wait_cycles":44945024,"thread_start_us":884584,"threads_started":3,"wal-append.queue_time_us":623220}
I20260709 12:24:17.046489  1341 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:17.075870 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.076651 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 61275.7us
I20260709 12:24:17.058058  1040 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.046851  1320 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:17.048415  1100 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.089354  1100 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.089784  1320 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.091147  1320 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.091615  1100 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.054313 31388 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:17.092166 31388 pending_rounds.cc:85] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 6
I20260709 12:24:17.092453 31388 pending_rounds.cc:107] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:17.092681 31388 raft_consensus.cc:2889] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:17.056674 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1474) took 3259 ms. Trace:
W20260709 12:24:17.054508 31507 connection.cc:256] RPC call timeout handler was delayed by -1.63060748099997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:24:17.094086 31507 connection.cc:256] RPC call timeout handler was delayed by -1.6241966750003485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:24:17.094447 31507 connection.cc:256] RPC call timeout handler was delayed by -1.6007966750003106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 12:24:17.093997 31466 rpcz_store.cc:276] 0709 12:24:13.786327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.751861 (+2965534us) service_pool.cc:224] Handling call
0709 12:24:16.945071 (+193210us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b54000187a8. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e96260ebc 00007f6e9629608c 00007f6e9628093b 00007f6e962803d2 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c
0709 12:24:16.945235 (+   164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.044153 (+ 98918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.045865 (+  1712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58724736}
W20260709 12:24:17.094847 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5811074810003447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 12:24:17.095188 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5802074810003433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 12:24:17.095486 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5368966750002073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 12:24:17.095806 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5071966750001593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 12:24:17.074534  1234 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:17.095994 31436 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:17.095703 31466 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:17.097152 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 246) took 2101 ms. Trace:
I20260709 12:24:17.097079 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:17.096961  1234 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.097890 31468 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:17.097606 31466 rpcz_store.cc:276] 0709 12:24:14.996136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.095111 (+2098975us) service_pool.cc:224] Handling call
0709 12:24:17.095468 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.096918 (+  1450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.097087 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.098759 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 247) took 2102 ms. Trace:
I20260709 12:24:17.099560  1183 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.099980  1183 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.100051  1208 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:16.928735  1145 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:17.100411  1183 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.012498 32075 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:17.101179  1300 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.102053 31462 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:17.065321 31461 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:17.102653 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1613) took 2110 ms. Trace:
I20260709 12:24:17.102964 31462 rpcz_store.cc:276] 0709 12:24:14.992534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.101334 (+2108800us) service_pool.cc:224] Handling call
0709 12:24:17.101719 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.102420 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.102582 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.103649 31470 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:17.104241 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1610) took 2112 ms. Trace:
I20260709 12:24:17.104429 31462 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:17.104547 31470 rpcz_store.cc:276] 0709 12:24:14.991668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.103021 (+2111353us) service_pool.cc:224] Handling call
0709 12:24:17.103340 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.104041 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.104197 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.105077 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1615) took 1567 ms. Trace:
I20260709 12:24:17.067065  1315 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.067732 31463 rpcz_store.cc:276] 0709 12:24:13.787264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.892545 (+3105281us) service_pool.cc:224] Handling call
0709 12:24:16.893091 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.008231 (+115140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.008500 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.105818 31470 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:17.106369 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1617) took 1568 ms. Trace:
I20260709 12:24:17.107014 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1618) took 1518 ms. Trace:
I20260709 12:24:17.107388 31463 rpcz_store.cc:276] 0709 12:24:15.588761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.106155 (+1517394us) service_pool.cc:224] Handling call
0709 12:24:17.106482 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.106662 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.106686 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.106754 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:17.106804 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.106854 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.106950 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.108683 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:17.109113 31463 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:17.109754 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1619) took 1488 ms. Trace:
I20260709 12:24:17.109938  1315 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:17.067263 31465 pending_rounds.cc:85] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 3
I20260709 12:24:17.110471  1315 raft_consensus.cc:697] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:17.110724 31465 pending_rounds.cc:107] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:24:17.110991 31465 raft_consensus.cc:2889] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:17.111765 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1480) took 2725 ms. Trace:
I20260709 12:24:17.111532  1315 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.112078 31465 rpcz_store.cc:276] 0709 12:24:14.386045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.894575 (+2508530us) service_pool.cc:224] Handling call
0709 12:24:16.895063 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.111530 (+216467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.111700 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.113391 31465 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:17.113541  1292 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.113933 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1620) took 1343 ms. Trace:
I20260709 12:24:17.114313 31465 rpcz_store.cc:276] 0709 12:24:15.770612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.112849 (+1342237us) service_pool.cc:224] Handling call
0709 12:24:17.113167 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.113732 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.113889 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.022327  1270 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.118148  1270 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:17.118659  1270 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.084206 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.123883 31541 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:17.124073 32048 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:17.074782  1077 raft_consensus.cc:3055] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:17.124920  1077 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:17.125373 32048 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:17.125917  1077 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.084986 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:17.085536 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 91281us
W20260709 12:24:17.127626 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 61853.1us
I20260709 12:24:17.128305  1267 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.128719  1267 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.128978   971 consensus_queue.cc:1059] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:17.129209 31433 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:17.085947 31510 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:17.088177 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.088567 32080 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:17.129854   971 raft_consensus.cc:3055] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:17.129792  1250 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:17.130417   971 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:17.131294  1100 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.086051 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:17.076241   836 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:17.131312 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.134164   836 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.134583 31359 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:17.134253   971 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.131945  1100 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.135722   971 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.085029  1204 raft_consensus.cc:3055] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:17.136849  1340 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:17.137284  1340 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.136888  1204 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:17.107740 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1485) took 2665 ms. Trace:
I20260709 12:24:17.057621 31467 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:17.139129 31461 rpcz_store.cc:276] 0709 12:24:14.442348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.980934 (+2538586us) service_pool.cc:224] Handling call
0709 12:24:16.998699 (+ 17765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.102836 (+104137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.107537 (+  4701us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b540029aed4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:17.107688 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139093376}
I20260709 12:24:17.139736 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1488) took 2627 ms. Trace:
I20260709 12:24:17.140141 31467 rpcz_store.cc:276] 0709 12:24:14.512542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.022728 (+2510186us) service_pool.cc:224] Handling call
0709 12:24:17.057377 (+ 34649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.139496 (+ 82119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.139688 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.098130  1234 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.109766 31361 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:16.929159  1304 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:17.160022 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 74202.5us
I20260709 12:24:17.078745 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.105422 31462 rpcz_store.cc:276] 0709 12:24:15.537264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.103803 (+1566539us) service_pool.cc:224] Handling call
0709 12:24:17.104175 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.104855 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.105035 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280}
I20260709 12:24:17.106678 31470 rpcz_store.cc:276] 0709 12:24:15.537800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.105324 (+1567524us) service_pool.cc:224] Handling call
0709 12:24:17.105638 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.106164 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.106328 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.981007 31464 rpcz_store.cc:276] 0709 12:24:13.636315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.956890 (+1320575us) service_pool.cc:224] Handling call
0709 12:24:14.957245 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.981243 (+ 23998us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:15.085327 (+104084us) log.cc:844] Serialized 14 byte log entry
0709 12:24:16.011999 (+926672us) log.cc:844] Serialized 14 byte log entry
0709 12:24:16.012188 (+   189us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:16.012590 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.036205 (+ 23615us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:16.048624 (+ 12419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.048718 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.923945 (+875227us) raft_consensus.cc:1685] finished
0709 12:24:16.923988 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.924218 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36592,"prepare.queue_time_us":28758,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":98632,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":30530,"thread_start_us":865987,"threads_started":2,"wal-append.queue_time_us":799106}
I20260709 12:24:17.110116 31463 rpcz_store.cc:276] 0709 12:24:15.621904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.108456 (+1486552us) service_pool.cc:224] Handling call
0709 12:24:17.108851 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.109510 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.109701 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.129098  1267 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.161700 31359 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:17.114218  1292 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.099153 31468 rpcz_store.cc:276] 0709 12:24:14.996413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.097305 (+2100892us) service_pool.cc:224] Handling call
0709 12:24:17.097623 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.098536 (+   913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.098701 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.076514  1341 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:17.173488 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.137662  1340 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:17.177654 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.179026 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:17.183619 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.152118  1077 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.210218 31467 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:17.207551 31470 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:17.152396  1192 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:17.208254 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 46657.2us
I20260709 12:24:17.131917  1071 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.215387 31465 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:17.219635 31436 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:17.217466 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 88328.4us
I20260709 12:24:17.160097  1204 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.192952  1341 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:17.229758 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 133430us
I20260709 12:24:17.209980   836 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.213163  1206 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.232892 31461 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:17.240468 31436 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:17.242340 31536 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:17.228652  1122 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:17.223678   925 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:17.229420  1342 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.241554 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:17.257102 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 147436us
I20260709 12:24:17.240849  1206 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.244414  1273 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:17.220381  1192 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:17.269196 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.273131 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:17.278012 31507 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.717s (SENT)
I20260709 12:24:17.262255  1304 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.288475 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:17.294759 31507 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:17.279556  1122 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:17.272047  1204 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.272794  1206 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.308326 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:17.320277 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.293434  1304 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.323242 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:17.328023 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 95031.9us
I20260709 12:24:17.326072  1272 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.305130   836 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.285849  1273 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:17.330772 31359 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:17.335006 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.335740  1292 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:17.335979 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 67211.3us
I20260709 12:24:17.336335  1292 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:17.336882  1292 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:17.337466 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4792966750001142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 12:24:17.337828 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4684966750000967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 12:24:17.338258 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4477966750000633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
I20260709 12:24:17.337872  1292 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.338501 32076 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
W20260709 12:24:17.326131  1346 log.cc:927] Time spent T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:24:17.284551   925 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.339046  1308 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:17.338582 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4162966750004671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 12:24:17.326604   975 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:17.343930 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.347059 31507 connection.cc:256] RPC call timeout handler was delayed by -1.3577966750003725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 12:24:17.350069 31507 connection.cc:256] RPC call timeout handler was delayed by -1.3109966750002968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 12:24:17.350449 31507 connection.cc:256] RPC call timeout handler was delayed by -1.001396675000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2499s for a response
I20260709 12:24:17.322765  1086 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.327812  1304 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.352072 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:17.356101 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:17.358826 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.360200 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:17.360648 31433 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:17.316272  1306 consensus_queue.cc:1059] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:24:17.363049 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.363381  1095 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:17.363721 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:17.363063  1331 raft_consensus.cc:1064] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:24:17.329285  1342 consensus_queue.cc:1059] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:24:17.376834 31361 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:17.377319 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 54176.8us
I20260709 12:24:17.339176  1183 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.378798 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:17.378654  1331 raft_consensus.cc:1068] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Unable to promote non-voter 8d38acb9ce494ceb917c8441666104c4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:17.383306  1276 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:17.383464 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 256773us
I20260709 12:24:17.385012 32048 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:17.386634 32048 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:17.388867 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 251) took 2283 ms. Trace:
I20260709 12:24:17.383796  1276 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.403169  1071 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:17.403765  1071 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:17.403992 31537 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:17.404268  1071 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.405030  1095 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:17.405920  1095 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.406610  1191 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:17.389257 31469 rpcz_store.cc:276] 0709 12:24:15.105904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.103755 (+1997851us) service_pool.cc:224] Handling call
0709 12:24:17.104249 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.104543 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.104573 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.105121 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.226523 (+121402us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:17.226570 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.226661 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.388630 (+161969us) raft_consensus.cc:1685] finished
0709 12:24:17.388649 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.388804 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26752,"thread_start_us":121025,"threads_started":1,"wal-append.queue_time_us":187536}
W20260709 12:24:17.411412 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 55359.8us
I20260709 12:24:17.412405 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:17.416414 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.358629  1308 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.422587 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:17.402987  1100 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:17.431394   975 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:17.437196   975 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.437645  1270 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.439541 31543 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:17.440840 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:17.441447 31465 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:17.431950 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:17.442479  1178 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.443102 31391 raft_consensus.cc:2410] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:17.410116  1194 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:17.396734  1276 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.449332 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.448622 31469 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
W20260709 12:24:17.446642 31436 consensus_peers.cc:597] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d762e82a994f48968e08b715c9df4a7a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.420394  1342 consensus_queue.cc:1243] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:17.420207  1208 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:17.458307 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 86403.7us
I20260709 12:24:17.423774  1191 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.464215 31436 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:17.466169 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:17.451793  1194 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:17.479498 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.459297  1037 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:17.390617  1122 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.490352 31433 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:17.466557  1191 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:17.476435  1234 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:17.522342 31462 raft_consensus.cc:1275] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:17.518379 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.518882 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:17.529150 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.505928 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:17.515678 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.556067 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:17.556120 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.558689 31542 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:17.480273 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:17.558056 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:17.494585  1194 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:17.561437 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 180211us
W20260709 12:24:17.568820 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.488139 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.570596 31540 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:17.476498  1273 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.505643  1315 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:17.575435 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.577199 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.524956  1191 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.585515  1071 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.586452  1206 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.590507 31388 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:17.469256  1306 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:24:17.591852 31463 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:17.565882 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 75636.7us
I20260709 12:24:17.521375   668 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.521064  1183 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:17.519538  1270 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:17.513689 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:17.567629  1208 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:17.514518  1221 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:24:17.619289 31433 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:24:17.639998 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 292567us
I20260709 12:24:17.632891 32075 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:17.612360   971 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.634728 32078 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.656526  1273 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:17.663612   971 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.664750  1273 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.665133  1273 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:17.665527  1273 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.665798   971 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:17.656545 31361 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:17.644481  1208 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:17.659978  1331 consensus_queue.cc:1059] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:17.660908 31510 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:17.658469 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.668358 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.653223 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.676741 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:17.685842 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.652601  1040 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6.
W20260709 12:24:17.695281 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.691571 31391 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:17.699800 31361 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:17.672640   925 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.650038  1183 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 12:24:17.710754 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.705031 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.707168 31461 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:17.674475  1244 consensus_queue.cc:1059] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:24:17.683349  1315 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:17.734606 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.695773  1071 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.670508  1208 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.740547  1325 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.741110  1308 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.742372  1341 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.707438  1314 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:24:17.706073   849 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.683955  1145 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:17.752645 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 248) took 2749 ms. Trace:
W20260709 12:24:17.754909 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.755360 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.689484  1323 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:17.746670  1077 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:24:17.764977  1206 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:17.711118  1340 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:17.769343 32078 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
W20260709 12:24:17.769836  1352 log.cc:927] Time spent T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:24:17.769536   975 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.771543 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:17.772933  1267 consensus_meta.cc:287] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.001s
I20260709 12:24:17.773604  1191 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:17.774566  1310 consensus_meta.cc:287] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.003s
I20260709 12:24:17.776162   849 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:17.775336  1194 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:17.755555 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:17.778949 31466 rpcz_store.cc:276] 0709 12:24:14.997314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.098803 (+2101489us) service_pool.cc:224] Handling call
0709 12:24:17.099160 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.152438 (+ 53278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.152479 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.178712 (+ 26233us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.319256 (+140544us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:17.319294 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.319381 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.746601 (+427220us) raft_consensus.cc:1685] finished
0709 12:24:17.746619 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.746732 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57119,"raft.queue_time_us":53289,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":61590,"thread_start_us":73893,"threads_started":1,"wal-append.queue_time_us":521829}
I20260709 12:24:17.816366  1365 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:17.817384  1361 log.cc:927] Time spent T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:24:17.817550  1300 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.004s
W20260709 12:24:17.781505 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.751924  1315 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.125771   975 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:17.930404 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.127537  1267 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.129693  1267 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:17.836686 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:18.131493 32076 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:18.132033 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.132689  1354 log.cc:927] Time spent T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.378s	user 0.000s	sys 0.000s
I20260709 12:24:18.009011  1341 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:17.821834 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 202623us
I20260709 12:24:17.778673   836 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:17.976411 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 276723us
W20260709 12:24:18.099478 31435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.014s
I20260709 12:24:18.135118 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:18.150504 31435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.009s	sys 0.014s
I20260709 12:24:18.150744 31542 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:18.135330 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.151432 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.151808 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.027702 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 281288us
I20260709 12:24:18.153380 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:18.153441 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 319486us
I20260709 12:24:18.154707 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:18.152714 32083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 431) took 1044 ms. Trace:
W20260709 12:24:18.159906 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.160353 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.162199 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:18.164363 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.165431 31387 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:18.166440 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.124471  1298 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.167073 31391 raft_consensus.cc:2376] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6. Re-sending same reply.
I20260709 12:24:18.156926 32083 rpcz_store.cc:276] 0709 12:24:17.090934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.091720 (+   786us) service_pool.cc:224] Handling call
0709 12:24:17.092057 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.126769 (+ 34712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.126798 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.127357 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.170556 (+ 43199us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.170617 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.170720 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:18.135461 (+964741us) raft_consensus.cc:1685] finished
0709 12:24:18.135481 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.135604 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34292,"raft.queue_time_us":35608,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"thread_start_us":42652,"threads_started":1,"wal-append.queue_time_us":560888}
I20260709 12:24:18.164330 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.173942 31389 raft_consensus.cc:2393] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:18.149684   849 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.168690   689 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.169407 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.177392 31393 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:18.171970 31467 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:17.825696 32075 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:17.976552  1323 raft_consensus.cc:3055] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:18.175531 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.182395 31394 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.166918  1145 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:18.184222  1363 log.cc:927] Time spent T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
W20260709 12:24:18.187714 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 412225us
I20260709 12:24:18.187873 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:18.176611  1276 consensus_meta.cc:287] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.000s
I20260709 12:24:18.188531 31390 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:18.188552 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.200300 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.191731 31395 raft_consensus.cc:2410] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:18.205276 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.182121  1323 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:18.208217  1364 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:18.208324  1323 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.209610  1323 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.212806   668 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:18.209647 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 242) took 1310 ms. Trace:
I20260709 12:24:18.213286   668 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.213357 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:18.215989 32084 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.228389 31542 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:18.229066 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:18.229434 31542 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.186038  1365 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:18.230312 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.232375 31390 raft_consensus.cc:2410] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:18.183495  1191 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.214124 31539 rpcz_store.cc:276] 0709 12:24:16.899703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.047787 (+148084us) service_pool.cc:224] Handling call
0709 12:24:17.056385 (+  8598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.068863 (+ 12478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.068893 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.077727 (+  8834us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.407963 (+330236us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b48002001d8. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:24:17.464007 (+ 56044us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:17.464317 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.464852 (+   535us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:18.209348 (+744496us) raft_consensus.cc:1685] finished
0709 12:24:18.209365 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.209587 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9171,"raft.queue_time_us":9305,"raft.run_cpu_time_us":3931,"raft.run_wall_time_us":339805,"spinlock_wait_cycles":8592128,"thread_start_us":233104,"threads_started":1,"wal-append.queue_time_us":816175}
I20260709 12:24:18.235692 31394 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:18.237041 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.237818 31389 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:18.241204 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.241767 31390 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.244886  1382 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.247704 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.248136  1315 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.252360 31390 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:18.252507 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:18.253656 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:18.253319 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.180330  1298 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.256487 31539 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:18.254709 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.258185 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.259402 31389 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.263072 31461 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:18.263718 31394 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:18.203136  1276 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:18.257349  1273 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.005s
I20260709 12:24:18.266769 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:18.268162  1304 consensus_meta.cc:287] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.896s	user 0.007s	sys 0.004s
I20260709 12:24:18.256718 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:18.269152  1276 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.269454  1194 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.271307  1298 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:18.275063 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.250173  1365 raft_consensus.cc:697] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:18.278062 32084 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:18.280413 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.275520 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:18.282508 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:18.258247  1340 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.286736 32050 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:18.288177 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.281675 31434 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:18.290251 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.270978   668 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.298995 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:18.297101 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:18.302485 31463 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:18.281651  1204 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:18.295812 31394 raft_consensus.cc:2410] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:18.327809 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:18.296445 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:18.330193 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:18.334585 31542 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:18.350330 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:18.335539 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 59522.2us
I20260709 12:24:18.336036 31390 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:18.336519  1194 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.341010  1301 raft_consensus.cc:3055] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.356798 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:18.341010 31461 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:18.292652 31433 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:18.344944 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 331) took 1201 ms. Trace:
W20260709 12:24:18.352267 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 131846us
I20260709 12:24:18.255681  1382 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.359472 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:18.358630 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:18.350239  1234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.036s	sys 0.030s
I20260709 12:24:18.358978 31388 rpcz_store.cc:276] 0709 12:24:17.144047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.144234 (+   187us) service_pool.cc:224] Handling call
0709 12:24:18.344636 (+1200402us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540028da54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:18.344838 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882067200}
I20260709 12:24:18.361946 31535 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:24:18.361680 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 80098.8us
I20260709 12:24:18.282913  1273 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.287730  1304 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.356674  1191 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.376233   836 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:18.377044  1191 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.369059 31542 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:18.358246  1266 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.365705 31387 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:18.371100  1375 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:18.375432   971 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:18.356231  1301 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:18.359843  1204 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:18.381850 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 89268.2us
W20260709 12:24:18.363370  1234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.036s	sys 0.031s
I20260709 12:24:18.399829 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:18.400434 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:18.381551  1194 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:24:18.404233 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 129109us
I20260709 12:24:18.383574 31535 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:18.384856  1301 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.386817  1382 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:18.387338 31539 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:18.387538 31542 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:18.387769 31434 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:18.387691  1365 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.389853  1273 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.393633   849 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.395376 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:18.395573 31466 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:18.395637  1304 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:18.395941 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:18.394994   668 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:18.383200  1375 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:18.403609 31510 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:18.416591  1382 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.417275   836 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.432055  1375 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.434309   652 raft_consensus.cc:3055] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:18.434911   652 raft_consensus.cc:740] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:18.423965 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 54019.9us
I20260709 12:24:18.423725  1204 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.424422   463 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.424515  1191 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:18.399287  1234 raft_consensus.cc:697] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:18.440577  1276 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.443806  1276 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.410480  1298 consensus_queue.cc:1059] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:18.444123  1234 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:18.446627  1355 log.cc:927] Time spent T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 1.085s	user 0.011s	sys 0.005s
I20260709 12:24:18.425173 31389 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:18.447866 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:18.426182 31507 leader_election.cc:336] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.780s (SENT)
I20260709 12:24:18.428403 31434 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:18.429155   849 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:18.429885  1192 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.430752 31433 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:18.467549  1382 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.468307  1382 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:18.468642  1382 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.469065  1382 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.469591 32084 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:18.442579   652 consensus_queue.cc:260] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.458796 31507 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:18.467075  1300 raft_consensus.cc:3055] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:18.487227  1300 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:18.487320 32048 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:18.488207  1300 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.481240  1191 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.489764  1191 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.491287 32047 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:18.492260  1272 raft_consensus.cc:3055] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:18.492667  1272 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:18.492847  1095 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:18.493513  1095 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.493561  1272 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.483359  1178 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:18.495146 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.510972 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.545764 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.549518 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.494751  1272 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.553267  1276 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:18.553752  1353 log.cc:927] Time spent T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.850s	user 0.000s	sys 0.010s
I20260709 12:24:18.492877  1250 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:18.553187  1382 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:18.555830 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.556556 32048 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:18.550932 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 82646.1us
W20260709 12:24:18.557672 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 114450us
I20260709 12:24:18.560575 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:18.560470 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:18.555800 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 63145.2us
I20260709 12:24:18.562695  1191 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.563417  1276 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:18.563930  1292 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:18.569337  1292 consensus_queue.cc:1059] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:18.570012 31359 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:18.571208   463 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:18.571858   463 raft_consensus.cc:697] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:18.572901 31359 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:18.555626 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1568) took 1793 ms. Trace:
I20260709 12:24:18.466436  1323 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:18.574530 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:18.466614   668 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.576066 31434 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:18.577226 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1630) took 1215 ms. Trace:
I20260709 12:24:18.555122  1250 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.551083  1300 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.588652 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:18.588968 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.584584 31544 rpcz_store.cc:276] 0709 12:24:16.762145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.016833 (+254688us) service_pool.cc:224] Handling call
0709 12:24:17.017177 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.067187 (+ 50010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.067221 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.078748 (+ 11527us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.207124 (+128376us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:17.207165 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.207394 (+   229us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:18.553192 (+1345798us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:18.555366 (+  2174us) raft_consensus.cc:1685] finished
0709 12:24:18.555384 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.555558 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19834,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":3334,"spinlock_wait_cycles":16463232,"thread_start_us":122115,"threads_started":1,"wal-append.queue_time_us":393013}
I20260709 12:24:18.589509 31389 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.585917 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:18.591351 31540 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.550922  1178 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.555878   652 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.591827 31433 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:18.589306 31542 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:18.574765  1301 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.573908  1194 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.581993  1375 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:18.580974   849 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.599186 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:18.610445 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:18.610749 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 195888us
I20260709 12:24:18.573004   463 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.581835  1191 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.605438 31433 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:18.587085 31464 rpcz_store.cc:276] 0709 12:24:17.361525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.770987 (+409462us) service_pool.cc:224] Handling call
0709 12:24:17.776384 (+  5397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.783041 (+  6657us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:17.976012 (+192971us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.343385 (+367373us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b180009e0e0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c23a 00007f6e912c6a2a
0709 12:24:18.576903 (+233518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:18.576948 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:18.576997 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.577068 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.577175 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":192957,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":4535,"spinlock_wait_cycles":5460352,"thread_start_us":233296,"threads_started":1}
I20260709 12:24:18.609637 31389 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:18.612344 31434 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:18.617314 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:18.593854  1250 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:18.618069 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.595345  1292 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:18.622776  1292 raft_consensus.cc:697] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:18.624212 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:18.624519 32083 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.624456 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:18.624877 32084 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.625161 32081 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.623752  1292 consensus_queue.cc:237] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.626354 32075 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:18.627496 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:18.628123 32078 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:18.628901 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:18.596136  1323 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:18.597859  1304 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.640004 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:18.616016  1234 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:18.612756  1375 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:18.593122   668 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:18.620823  1273 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.655895 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:18.629347  1387 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.658432 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:18.629142 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:18.637231  1192 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:18.631651  1077 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.655740  1375 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.658747  1194 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:18.666412 31507 leader_election.cc:336] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.807s (SENT)
W20260709 12:24:18.695001 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.639988  1266 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
W20260709 12:24:18.708168 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 49812.9us
I20260709 12:24:18.713207 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:18.704862 32084 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:18.717480 31461 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:18.662160  1208 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.743865 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:18.686842  1304 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:18.744652 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:18.743886 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:18.759744 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.699584  1183 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:18.762266  1392 log.cc:927] Time spent T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:24:18.664837   849 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:24:18.699088  1095 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.690130  1192 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.708443  1382 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:18.667374  1331 consensus_queue.cc:1059] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:24:18.689647  1387 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:18.708443  1383 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:18.767541 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:19.043579 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:19.046375 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.051358 31465 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:18.752640 31466 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:18.699754 31537 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.767925 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:18.821465 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.051542 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.762555 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:19.053974 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 411101us
W20260709 12:24:19.060119 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 447802us
W20260709 12:24:19.032246  1394 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 12:24:18.942044 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 277085us
I20260709 12:24:18.943691 32083 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:18.781723 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:18.766650 32081 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:19.058409 31470 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.941843 31463 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:19.054034 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:19.054476 31540 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:19.003760 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:18.716981  1194 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:19.057981 31469 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:19.061282 31434 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:18.941846  1389 log.cc:927] Time spent T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 12:24:18.713019  1077 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:18.854066  1361 log.cc:927] Time spent T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:24:19.084180 31464 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
W20260709 12:24:19.071924 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 358600us
I20260709 12:24:18.834584  1281 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.052748  1304 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:19.059054  1192 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.059887 31468 raft_consensus.cc:2393] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:19.058846  1234 raft_consensus.cc:697] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:19.091040 31433 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:19.122503 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:19.124372 31465 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.091786 31538 raft_consensus.cc:2393] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:19.091909 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:19.125432 31466 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:18.867527  1235 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:19.092518 31507 leader_election.cc:336] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.833s (SENT)
W20260709 12:24:18.905927  1395 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:24:19.100675   668 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:19.102766  1301 consensus_meta.cc:287] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.004s
W20260709 12:24:19.104645   652 consensus_meta.cc:287] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.506s	user 0.004s	sys 0.004s
W20260709 12:24:19.087802  1272 consensus_meta.cc:287] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 12:24:19.137673 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:19.106351  1300 consensus_meta.cc:287] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.000s
W20260709 12:24:19.076486  1390 log.cc:927] Time spent T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:24:19.106856 32075 raft_consensus.cc:1217] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Deduplicated request from leader. Original: 5.6->[6.7-6.7]   Dedup: 6.7->[]
W20260709 12:24:19.109249 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 48042.4us
I20260709 12:24:19.141136 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.141670 31434 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:19.109833  1266 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:19.112112 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.112545 31470 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:18.942924  1273 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.139590  1183 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:19.126911  1281 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:19.141976  1250 consensus_meta.cc:287] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 12:24:19.150045  1250 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:19.160593 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.991039  1179 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.053623  1383 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.084095 31461 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:24:19.125285 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1550) took 1663 ms (client timeout 1973 ms). Trace:
I20260709 12:24:19.132040 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:19.089969  1331 raft_consensus.cc:3055] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.762996  1208 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.130568 32050 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:19.136648 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:18.891083  1400 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.241s
I20260709 12:24:19.139037 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:19.126587  1178 consensus_meta.cc:287] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.000s
I20260709 12:24:19.139631 31389 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:19.141875 31390 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:18.868814 32078 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:19.142141 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:19.143057 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:18.811743  1323 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:19.145134 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.148276 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.164722 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:19.115520 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.167681 31538 rpcz_store.cc:269] 0709 12:24:17.462043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.469961 (+  7918us) service_pool.cc:224] Handling call
0709 12:24:17.782663 (+312702us) spinlock_profiling.cc:243] Waited 892 us on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:19.003565 (+1220902us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197e9c 00007f6e8e197a5b 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:19.125225 (+121660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4988160}
I20260709 12:24:19.180047 31387 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.182508 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:19.138610  1235 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:19.302533 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 172005us
I20260709 12:24:19.404628 31391 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.405386 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:19.406457 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.406908 31461 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:19.320020 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.403666 31388 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:19.305595 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 163983us
W20260709 12:24:19.425051 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 344061us
I20260709 12:24:19.426826 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:19.427712 31361 connection.cc:256] RPC call timeout handler was delayed by -3.145139411999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 12:24:19.427934   836 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.428221 31434 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:19.166301 32075 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:19.439507 31461 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:19.163962  1340 raft_consensus.cc:3055] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:19.172377  1383 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.424486 31466 raft_consensus.cc:2410] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:19.437894 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.171823  1315 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.404098 31470 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
W20260709 12:24:19.428105 31361 connection.cc:256] RPC call timeout handler was delayed by -3.1406394119999277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 12:24:19.458144 31361 connection.cc:256] RPC call timeout handler was delayed by -2.999339412000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 12:24:19.458626 31361 connection.cc:256] RPC call timeout handler was delayed by -2.9075394120000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260709 12:24:19.458986 31361 connection.cc:256] RPC call timeout handler was delayed by -2.8382394119998935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 12:24:19.430217   971 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.460155 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:19.278625  1276 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:19.460764 32076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 435) took 2103 ms. Trace:
I20260709 12:24:19.461067  1276 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:19.461261 32076 rpcz_store.cc:276] 0709 12:24:17.357203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.359550 (+  2347us) service_pool.cc:224] Handling call
0709 12:24:17.417532 (+ 57982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.131918 (+714386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.460494 (+1328576us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540069e6d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:19.460662 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630005504}
I20260709 12:24:19.183595  1179 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.187691   652 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.463487   652 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.464332 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.465469   652 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:19.465994   652 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.466409   652 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.315356  1402 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:19.467374 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:19.467530  1402 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.468308 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:19.243847  1178 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:19.468855 31539 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.243973  1375 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:19.470378  1178 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:19.171949  1273 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.443033  1340 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:19.184958  1382 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:19.475795 31467 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:19.184760  1300 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:19.479895 31542 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:19.473867 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.904s (SENT) [suppressed 27 similar messages]
I20260709 12:24:19.300985  1400 raft_consensus.cc:3055] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:19.446380 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.484138 32050 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:19.316926  1281 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:19.180960  1183 raft_consensus.cc:697] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:19.457228  1401 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:19.494297 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:19.494957 31470 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:19.476187   668 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.463771  1413 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.467959 31540 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:19.472419 31434 leader_election.cc:336] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.585s (SENT)
I20260709 12:24:19.460757 31468 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:19.474408 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:19.467039 31544 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:19.502393 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:19.173031  1331 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:19.243664  1095 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:19.222186  1407 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:19.281811 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:19.472785 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.473137 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.491613  1399 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:19.442538   849 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.486069 31387 raft_consensus.cc:2410] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:19.488623 31436 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:19.476600  1391 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:24:19.471735  1340 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.447530 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:19.499946 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.446024  1266 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:24:19.502223 31434 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:19.502945 31543 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:19.479319  1276 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:19.482447  1304 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:19.513505 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.483688  1400 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:19.289377 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1593) took 1046 ms. Trace:
I20260709 12:24:19.269933  1194 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:19.481990  1403 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.524504 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.528128 31537 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:19.530462 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.493167  1387 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:19.290514  1234 consensus_queue.cc:237] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.540661 31388 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:19.541353 31465 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:19.543380  1250 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:19.565651 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.519901  1077 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:19.549824 31540 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:19.493400  1315 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.532207  1399 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.553462 31394 rpcz_store.cc:276] 0709 12:24:18.252117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.361094 (+108977us) service_pool.cc:224] Handling call
0709 12:24:18.375568 (+ 14474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.375936 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.375961 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.376420 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.593993 (+217573us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:18.594032 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.594094 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.289150 (+695056us) raft_consensus.cc:1685] finished
0709 12:24:19.289174 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.289312 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3563,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":1715,"thread_start_us":217209,"threads_started":1,"wal-append.queue_time_us":375316}
W20260709 12:24:19.558391 31543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1557) took 1844 ms (client timeout 1585 ms). Trace:
I20260709 12:24:19.538494  1407 raft_consensus.cc:697] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:19.579408 31461 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:19.564235 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.511700  1301 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.545950 31464 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:19.581257 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.581888 31387 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:19.576889 31543 rpcz_store.cc:269] 0709 12:24:17.713556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.713687 (+   131us) service_pool.cc:224] Handling call
0709 12:24:19.120108 (+1406421us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:19.558316 (+438208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6836480}
I20260709 12:24:19.567008 31388 raft_consensus.cc:2410] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:19.567265 31390 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:19.550305  1340 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.523097  1095 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:19.570218 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.515070   668 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:19.578151 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.541213   849 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.583334 31539 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:19.588042 31391 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:19.567668  1387 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:19.578501  1404 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.372s	user 0.001s	sys 0.001s
I20260709 12:24:19.619518 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.630774 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1582) took 1853 ms. Trace:
I20260709 12:24:19.567886  1382 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.632876 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.644359 31391 raft_consensus.cc:2368] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7.
I20260709 12:24:19.635243 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.632028 31387 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:19.635857 31390 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:19.605791  1301 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:19.636839  1411 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:24:19.638435   668 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:19.578804  1399 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:19.646705 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.648041 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.665869 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.662665 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 188823us
I20260709 12:24:19.666512 31389 raft_consensus.cc:2410] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:24:19.666862 31507 leader_election.cc:336] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.937s (SENT)
I20260709 12:24:19.662839 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.512331  1401 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:19.606745   652 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:19.668823 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.516005  1413 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.670307 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.667493 31507 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:19.671445 31387 raft_consensus.cc:2368] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6.
W20260709 12:24:19.671904 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.672550 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.673359 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.673661 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.643529  1387 raft_consensus.cc:697] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:19.672885 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 200479us
W20260709 12:24:19.676294 31434 connection.cc:256] RPC call timeout handler was delayed by -1.104450838000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 12:24:19.679049 31391 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:19.682331 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.682983 31394 raft_consensus.cc:2410] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:19.689105 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.689958 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.690884 31388 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:19.692467 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.675768  1408 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.569036  1331 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:19.698146 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 209613us
W20260709 12:24:19.693691  1409 log.cc:927] Time spent T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:24:19.699950 31388 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:19.701371 31394 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:19.647295  1183 consensus_queue.cc:237] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.703171 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.703788 31394 raft_consensus.cc:2376] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5. Re-sending same reply.
I20260709 12:24:19.711566 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.712517 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 341) took 1125 ms. Trace:
I20260709 12:24:19.712930 31386 rpcz_store.cc:276] 0709 12:24:18.587323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.316506 (+729183us) service_pool.cc:224] Handling call
0709 12:24:19.316961 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.473933 (+156972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.473980 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:19.474037 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:19.474093 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.712292 (+238199us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400405e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:19.712338 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.712456 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360338688}
I20260709 12:24:19.714661 31391 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:19.715430 31387 raft_consensus.cc:2410] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:24:19.727082 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 60246.3us
W20260709 12:24:19.732744 31507 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.968s (SENT)
W20260709 12:24:19.733685 31507 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.980s (SENT)
I20260709 12:24:19.734053 31507 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:19.731194 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.734890 31391 raft_consensus.cc:2368] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7.
I20260709 12:24:19.667167  1400 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:19.700392  1235 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:19.714514  1331 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.756765 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:19.758677 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.758870 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 75865us
I20260709 12:24:19.760025 31436 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:19.761675 31436 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:19.762915 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.763455 31386 raft_consensus.cc:2376] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5. Re-sending same reply.
I20260709 12:24:19.770572 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.780359 31394 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:19.757689  1408 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.786504 31386 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:19.788318 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:19.788754 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.764410  1234 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:19.791131 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.762765  1266 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:24:19.796427 31507 leader_election.cc:336] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.003s (SENT)
I20260709 12:24:19.797019 31507 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:19.793490 31386 raft_consensus.cc:2376] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4. Re-sending same reply.
W20260709 12:24:19.793795 31462 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.040s	sys 0.005s
I20260709 12:24:19.699918  1407 consensus_queue.cc:237] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:19.798048 31462 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.040s	sys 0.005s
I20260709 12:24:19.736811  1420 consensus_queue.cc:1059] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:24:19.796175  1431 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:19.804385 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:19.805562 31386 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:19.792634  1234 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.764384  1421 consensus_queue.cc:1059] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:24:19.811050 31388 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:19.762821  1387 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:19.812768 31507 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.005s (SENT)
I20260709 12:24:19.812633  1399 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:19.823371 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.824668 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.804394  1095 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:19.803313  1315 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:19.811086   668 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.828241  1401 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:19.828953  1399 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:19.829092 31388 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:19.830682 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:19.830798 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.832453 31388 raft_consensus.cc:2376] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7. Re-sending same reply.
I20260709 12:24:19.833685 31388 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:19.834580 31386 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 12:24:19.834919 31388 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:19.834985 31386 pending_rounds.cc:85] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 1
I20260709 12:24:19.820562  1234 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.835691 31386 pending_rounds.cc:107] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260709 12:24:19.840185 31386 raft_consensus.cc:2889] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:19.847054 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.851943 31544 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:19.855708 31433 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:19.860704 31544 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:19.865883  1418 log.cc:927] Time spent T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.166s	user 0.001s	sys 0.001s
I20260709 12:24:19.866065 31540 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:19.866221 31386 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:19.859063 31433 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:19.866463 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.870535 31539 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 2.
I20260709 12:24:19.870635 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.865931 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.867441 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.871703 31543 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:19.877938 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.843513   849 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:19.886471 31507 leader_election.cc:336] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.022s (SENT)
I20260709 12:24:19.886706 31544 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:19.851112  1413 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:19.888043 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:19.888883 31359 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:19.889989 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:19.890724 31386 raft_consensus.cc:2376] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4. Re-sending same reply.
W20260709 12:24:19.915531  1384 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 1.633s	user 0.000s	sys 0.005s
W20260709 12:24:19.883242  1424 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:24:19.918883 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:19.882539  1077 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:19.962330 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 55467.8us
I20260709 12:24:19.869166  1315 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:24:19.869315  1340 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:24:19.982573 32048 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:19.944743  1204 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:20.056958  1432 log.cc:927] Time spent T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:24:19.977524  1095 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:20.074946 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:20.083141 31395 raft_consensus.cc:2376] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5. Re-sending same reply.
I20260709 12:24:20.059022  1235 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:20.061322  1204 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:19.977734  1077 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:20.181542 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.128635 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 255267us
I20260709 12:24:20.182821 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:20.183676 31470 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:20.184113 31395 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:20.129012 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 146533us
I20260709 12:24:20.114634  1095 raft_consensus.cc:697] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:20.187733 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:20.188689 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:20.192036 32048 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:20.195708 31544 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:20.195539 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 336547us
I20260709 12:24:20.230319  1340 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.407s
W20260709 12:24:20.330492  1431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.026s	sys 0.034s
W20260709 12:24:20.629550  1431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.049s	sys 0.081s
I20260709 12:24:20.629892  1431 raft_consensus.cc:697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:20.185346  1383 consensus_meta.cc:287] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.000s
W20260709 12:24:20.389374  1234 consensus_meta.cc:287] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260709 12:24:20.630812  1383 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.265738 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:20.631346  1234 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.633407  1383 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:20.633596 31395 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:20.633934  1234 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:20.265056  1387 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:20.250800 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.634579 31541 rpcz_store.cc:276] 0709 12:24:17.777664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.777974 (+   310us) service_pool.cc:224] Handling call
0709 12:24:19.188567 (+1410593us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:19.471453 (+282886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.471650 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:19.471966 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.630308 (+158342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:19.630381 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:19.630458 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.630546 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.630703 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5993,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":4252,"spinlock_wait_cycles":77449600,"thread_start_us":157956,"threads_started":1}
I20260709 12:24:19.579103 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:20.455598 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.642994 31544 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:20.644675  1273 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:20.647785 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.648104 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.648510 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.648665 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.648928 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.650262 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:20.651417 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:20.652107  1403 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:20.652501  1403 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:20.652820 31466 raft_consensus.cc:1275] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:20.653388  1403 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:20.232782 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.370319   849 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.654461  1403 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.655066   849 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:20.655776  1400 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.657397   849 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:20.215008 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.658797 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.661542  1340 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:20.662267  1340 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.663381  1383 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:20.209312 31359 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:20.663944  1383 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:20.664386 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 455139us
I20260709 12:24:20.664482  1412 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:20.665148  1412 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:20.665372 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:20.665552  1412 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.665928  1383 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:20.666461 31359 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:20.590888 31507 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.038s (SENT)
W20260709 12:24:20.667724 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 478081us
W20260709 12:24:20.668291 31507 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.077s (SENT)
I20260709 12:24:20.668790 31507 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:20.669801  1383 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:20.670464  1383 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.230561  1315 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.406s
W20260709 12:24:20.670845 31507 leader_election.cc:336] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.103s (SENT)
I20260709 12:24:20.670907  1383 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:20.265247  1399 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:20.278913 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 268) took 1145 ms. Trace:
I20260709 12:24:20.671803  1399 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.230173  1331 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.672335 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 270) took 1538 ms. Trace:
W20260709 12:24:20.672838 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.672571  1331 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:20.673625 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.673872  1383 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:20.287938 31386 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:20.627483 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:20.622956 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 430940us
I20260709 12:24:20.627897  1446 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.231310  1421 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:20.693105 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1626) took 1102 ms. Trace:
I20260709 12:24:20.625051 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:20.625900 31540 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:20.693994 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1495) took 1980 ms. Trace:
W20260709 12:24:20.628787 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 202416us
I20260709 12:24:20.624552 31388 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:20.384891  1077 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:20.640089 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.671304  1315 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:20.356712  1192 consensus_meta.cc:287] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.214s	user 0.012s	sys 0.000s
I20260709 12:24:20.297915  1204 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:20.693535 32048 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:20.724424 32048 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:20.697368 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.671841 31462 rpcz_store.cc:276] 0709 12:24:19.133715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.133841 (+   126us) service_pool.cc:224] Handling call
0709 12:24:19.141206 (+  7365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.141419 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:19.799456 (+658037us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.278429 (+478973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.278501 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:20.278578 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.278669 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.278836 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162440,"prepare.queue_time_us":598953,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":216845,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":953236,"threads_started":2,"wal-append.queue_time_us":454676}
I20260709 12:24:20.672792 31468 rpcz_store.cc:276] 0709 12:24:19.134151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.514466 (+380315us) service_pool.cc:224] Handling call
0709 12:24:19.537709 (+ 23243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.684417 (+146708us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:19.756068 (+ 71651us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.791782 (+ 35714us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:19.791873 (+    91us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:19.791971 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.974612 (+182641us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b1800464f20. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:20.672082 (+697470us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400414e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:20.672125 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.672277 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7607,"prepare.queue_time_us":119183,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":45448,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":340144640,"thread_start_us":88560,"threads_started":2,"wal-append.queue_time_us":68149}
I20260709 12:24:20.693555 31387 rpcz_store.cc:276] 0709 12:24:19.591267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.672321 (+ 81054us) service_pool.cc:224] Handling call
0709 12:24:20.692882 (+1020561us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400230d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:20.693031 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96276736}
I20260709 12:24:20.694373 31467 rpcz_store.cc:276] 0709 12:24:18.713688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.713820 (+   132us) service_pool.cc:224] Handling call
0709 12:24:20.693808 (+1979988us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54002a62d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:20.693941 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973601152}
I20260709 12:24:20.672334  1399 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.692588  1437 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.741526 31507 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.499s (SENT)
I20260709 12:24:20.735576  1301 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:20.724323  1267 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.729617  1235 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:20.707583  1387 raft_consensus.cc:697] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:20.722208  1234 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.383729  1095 consensus_queue.cc:237] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:20.751575 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.723481  1315 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.785426  1315 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:20.750495  1421 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:20.787801  1340 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:20.788072  1421 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:20.788635  1422 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.788333  1399 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.789098  1422 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.725756  1077 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.791632 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.791500  1077 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:20.793645  1410 log.cc:927] Time spent T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 1.490s	user 0.000s	sys 0.023s
I20260709 12:24:20.793902  1077 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:20.670873   652 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:20.770212 31462 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:20.794895  1235 raft_consensus.cc:697] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:20.795938  1235 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.790944  1399 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:20.733808  1331 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:20.630822  1431 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.778568 31394 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:20.778992  1450 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.779871 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 54411.5us
W20260709 12:24:20.780651 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 50471.9us
W20260709 12:24:20.781854 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 46818.2us
I20260709 12:24:20.749956  1437 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:20.725133  1192 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:20.807627  1331 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:20.808693 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:20.806926 32048 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:20.815840 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:20.776656  1434 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.794845   652 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:20.847141 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 180721us
I20260709 12:24:20.791177  1422 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:20.827641  1450 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:20.854182 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.871536 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.722659  1446 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.860836 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1636) took 1033 ms. Trace:
I20260709 12:24:20.876981  1422 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:24:20.879865 31361 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:20.848378  1301 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:20.826851  1451 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:20.859331   652 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.884291 31470 rpcz_store.cc:276] 0709 12:24:19.827402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.722795 (+895393us) service_pool.cc:224] Handling call
0709 12:24:20.723123 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.752104 (+ 28981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.752152 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.752839 (+   687us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.833016 (+ 80177us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:20.833072 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.833162 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.860564 (+ 27402us) raft_consensus.cc:1685] finished
0709 12:24:20.860594 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.860763 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36598,"raft.queue_time_us":53437,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":25774,"thread_start_us":41253,"threads_started":1,"wal-append.queue_time_us":69422}
I20260709 12:24:20.848212   849 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:20.806792  1234 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:20.826987  1399 consensus_queue.cc:1059] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:24:20.904134  1399 raft_consensus.cc:3055] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:20.904481  1399 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:20.904973  1315 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:20.905402  1399 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.906677  1399 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.907768  1315 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:20.889072 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:20.911597 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:20.912374 32083 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:20.918767 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:20.919606 31541 raft_consensus.cc:2410] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:20.827562  1331 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.888028  1301 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:20.930171 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 50404.6us
I20260709 12:24:20.898685  1077 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:20.940004 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:20.940729 31543 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:20.942354 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:20.892230  1448 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.942955 32081 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.849073  1434 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.943560 32082 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:20.948654  1450 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:20.949626 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:20.919603  1267 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.918891  1340 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:20.913573  1451 raft_consensus.cc:697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:20.928054  1301 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.923877 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:20.954885 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:20.951668   849 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:24:20.939639  1315 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:20.948819  1331 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:20.962728 32081 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:20.970927 32079 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:20.900468  1387 consensus_queue.cc:237] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.022059 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:21.022603 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 71756.4us
I20260709 12:24:20.952517  1448 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.024423 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:21.024667 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:21.029327 31361 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:21.029608 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:20.958884  1267 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:20.960877  1340 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.037002 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:21.037619 31394 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:21.038856 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:21.039916 31386 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:20.974466  1315 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.049237 31386 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:21.058324  1414 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 1.414s	user 0.004s	sys 0.014s
I20260709 12:24:21.059393 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1571) took 2789 ms. Trace:
I20260709 12:24:21.060564 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 267) took 1927 ms. Trace:
I20260709 12:24:21.060962 31463 rpcz_store.cc:276] 0709 12:24:19.133450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.133560 (+   110us) service_pool.cc:224] Handling call
0709 12:24:19.143373 (+  9813us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:19.164838 (+ 21465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.164870 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:19.269922 (+105052us) log.cc:844] Serialized 78 byte log entry
0709 12:24:19.499599 (+229677us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:19.687012 (+187413us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.694084 (+  7072us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.696887 (+  2803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.696996 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.797363 (+1100367us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b4800272358. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:24:21.038794 (+241431us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:21.060359 (+ 21565us) raft_consensus.cc:1685] finished
0709 12:24:21.060381 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.060512 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96512,"prepare.queue_time_us":420761,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":63,"raft.queue_time_us":38583,"raft.run_cpu_time_us":22777,"raft.run_wall_time_us":1163994,"spinlock_wait_cycles":18900608,"thread_start_us":381360,"threads_started":2,"wal-append.queue_time_us":282420}
W20260709 12:24:21.063087 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.062988  1383 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:21.063599  1383 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.064096 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:21.064222 32050 connection.cc:256] RPC call timeout handler was delayed by -1.0207241029997931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 12:24:21.065744 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1639) took 1104 ms. Trace:
I20260709 12:24:21.066435 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:21.066191 31462 rpcz_store.cc:276] 0709 12:24:19.961690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.795721 (+834031us) service_pool.cc:224] Handling call
0709 12:24:20.796151 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.796622 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.796664 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.797195 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.888996 (+ 91801us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:20.889035 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.889109 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.065566 (+176457us) raft_consensus.cc:1685] finished
0709 12:24:21.065584 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.065689 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1062,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":74807,"thread_start_us":91239,"threads_started":1,"wal-append.queue_time_us":145501}
I20260709 12:24:21.039021  1077 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:21.075418 31395 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:21.059790 31536 rpcz_store.cc:276] 0709 12:24:18.269761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.398703 (+128942us) service_pool.cc:224] Handling call
0709 12:24:18.399863 (+  1160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.409113 (+  9250us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:18.425332 (+ 16219us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.657493 (+232161us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.696008 (+ 38515us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.712260 (+ 16252us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:18.712491 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.058826 (+2346335us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b1800421180. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e90e644bc 00007f6e8e1b248b 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cc455 00007f6e912b4060 00007f6e912c6716 00007f6e912d7287
0709 12:24:21.058953 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.059039 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.059170 (+   131us) raft_consensus.cc:1685] finished
0709 12:24:21.059185 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.059334 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7025,"prepare.run_cpu_time_us":22840,"prepare.run_wall_time_us":324899,"raft.queue_time_us":175542,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":20672,"spinlock_wait_cycles":157440896,"thread_start_us":433225,"threads_started":2,"wal-append.queue_time_us":365995,"wal-append.run_cpu_time_us":3010,"wal-append.run_wall_time_us":1264589}
I20260709 12:24:21.035898   652 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.046442  1460 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:21.051028  1451 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.072079  1431 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:21.109952  1340 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.164494 31387 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:21.151571  1266 raft_consensus.cc:3055] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:21.081105  1399 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.109208 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:21.126909 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.168641 31462 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:21.120338 31386 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:21.170418 31392 raft_consensus.cc:2410] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:24:21.172219 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.168421 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 102090us
I20260709 12:24:21.175272 32050 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:21.176404 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1641) took 1091 ms. Trace:
I20260709 12:24:21.177086 31462 rpcz_store.cc:276] 0709 12:24:20.085227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.074642 (+989415us) service_pool.cc:224] Handling call
0709 12:24:21.090087 (+ 15445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.176059 (+ 85972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.176329 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.082641  1077 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:21.179363 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.189029 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.103649  1204 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:21.170833  1266 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:21.201212 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.201665 31462 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:21.119551  1208 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.110824  1315 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.206290 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1642) took 1120 ms. Trace:
I20260709 12:24:21.182442  1420 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.183784  1267 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:21.206669 31462 rpcz_store.cc:276] 0709 12:24:20.085636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.184073 (+1098437us) service_pool.cc:224] Handling call
0709 12:24:21.201438 (+ 17365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.206007 (+  4569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.206223 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:21.200434  1454 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 12:24:21.200629  1412 consensus_meta.cc:287] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
W20260709 12:24:21.221550 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.164556  1431 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.180380  1077 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.190442  1460 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:21.249713 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.246006  1415 raft_consensus.cc:3055] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:21.242733  1267 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:21.260560  1459 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:24:21.212729  1204 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:21.264153 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 59086.7us
I20260709 12:24:21.241309  1420 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.257166  1267 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.265159 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.265479  1267 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.266733  1446 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.267203  1402 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.267902  1437 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.246075  1412 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:21.272624 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.256642  1415 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:21.261952  1301 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:21.279716 31461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1508) took 1959 ms (client timeout 1962 ms). Trace:
W20260709 12:24:21.280117 31461 rpcz_store.cc:269] 0709 12:24:19.320382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.447047 (+126665us) service_pool.cc:224] Handling call
0709 12:24:21.279563 (+1832516us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b5400018954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:21.279660 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84701056}
W20260709 12:24:21.272910  1403 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.005s
I20260709 12:24:21.284798 31462 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:21.286305 31507 connection.cc:256] RPC call timeout handler was delayed by -2.6906427119997716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:24:21.286870 31507 connection.cc:256] RPC call timeout handler was delayed by -2.6195427120001114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 12:24:21.277030 32078 raft_consensus.cc:2376] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8. Re-sending same reply.
I20260709 12:24:21.296135  1415 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.297259  1415 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.297837  1460 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:21.298193 31507 connection.cc:256] RPC call timeout handler was delayed by -2.395442711999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 12:24:21.298902 31507 connection.cc:256] RPC call timeout handler was delayed by -2.3738427119997141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 12:24:21.299414 31507 connection.cc:256] RPC call timeout handler was delayed by -2.3567427119996864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 12:24:21.300040 31507 connection.cc:256] RPC call timeout handler was delayed by -2.3396427120001135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 12:24:21.304649 31507 connection.cc:256] RPC call timeout handler was delayed by -2.3252427120000903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 12:24:21.305116 31507 connection.cc:256] RPC call timeout handler was delayed by -2.3225427120000859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 12:24:21.305558 31507 connection.cc:256] RPC call timeout handler was delayed by -2.2505427119999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 12:24:21.308049  1460 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.308755  1460 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:21.310451  1458 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:24:21.311383  1204 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.312914  1431 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.313511  1431 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.314039  1431 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.314761 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1640) took 1266 ms. Trace:
I20260709 12:24:21.315125 31470 rpcz_store.cc:276] 0709 12:24:20.047986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.891141 (+843155us) service_pool.cc:224] Handling call
0709 12:24:20.898340 (+  7199us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:20.942150 (+ 43810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.942195 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:20.948709 (+  6514us) log.cc:844] Serialized 52 byte log entry
0709 12:24:21.028184 (+ 79475us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:21.028218 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.314361 (+286143us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b54002c6d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:21.314409 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.314460 (+    51us) raft_consensus.cc:1685] finished
0709 12:24:21.314474 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.314703 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":9966,"spinlock_wait_cycles":68854528,"thread_start_us":79132,"threads_started":1,"wal-append.queue_time_us":132635}
I20260709 12:24:21.316903 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:21.318060 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:21.318773 31470 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:21.320045 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1637) took 1451 ms. Trace:
I20260709 12:24:21.320490 31467 rpcz_store.cc:276] 0709 12:24:19.868499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.728397 (+859898us) service_pool.cc:224] Handling call
0709 12:24:20.740940 (+ 12543us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:21.065216 (+324276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.065255 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:21.072387 (+  7132us) log.cc:844] Serialized 52 byte log entry
0709 12:24:21.242470 (+170083us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:21.242512 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.319679 (+ 77167us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400416254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:21.319719 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.319763 (+    44us) raft_consensus.cc:1685] finished
0709 12:24:21.319777 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.319986 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":762,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5683,"spinlock_wait_cycles":744800128,"thread_start_us":82132,"threads_started":1,"wal-append.queue_time_us":128024}
I20260709 12:24:21.322243 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:21.282135  1446 consensus_queue.cc:1059] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:21.324110  1446 raft_consensus.cc:3055] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:21.324519  1446 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:21.324863  1466 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:24:21.325538  1446 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:21.326867  1446 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.283250  1301 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:21.327325  1460 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:21.328449 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:21.328835  1412 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.259358  1266 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.329489 31470 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:21.329892  1266 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:21.330703 31434 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.683s (SENT)
I20260709 12:24:21.334592  1434 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.333334  1448 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:21.337821 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.375416 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.377413 31433 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:24:21.378564 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 47887.1us
I20260709 12:24:21.331694  1460 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:21.330628 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:21.332840 31507 connection.cc:256] RPC call timeout handler was delayed by -1.2317515009999624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:24:21.381809 31507 connection.cc:256] RPC call timeout handler was delayed by -1.220951500999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 12:24:21.382234 31507 connection.cc:256] RPC call timeout handler was delayed by -1.2182515009999406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:24:21.382608 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1021515010002076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 12:24:21.382959 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0733515010001611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:24:21.383322 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0373515010001029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 12:24:21.392323 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:21.419565 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 145072us
I20260709 12:24:21.405277  1460 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.515905 31466 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:21.469225 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 48277.8us
I20260709 12:24:21.518038 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:21.518652 31467 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
W20260709 12:24:21.519405 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 138462us
I20260709 12:24:21.503223 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:21.525190 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 147848us
I20260709 12:24:21.527197 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:21.527824 31467 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:21.526674 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:21.529234 31464 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.418206  1267 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.540357 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:21.542205 31467 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:21.543442 31361 connection.cc:256] RPC call timeout handler was delayed by -1.1058127400001467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 12:24:21.543820 31361 connection.cc:256] RPC call timeout handler was delayed by -1.0968127400001322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 12:24:21.544062 31361 connection.cc:256] RPC call timeout handler was delayed by -1.0950127400001293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 12:24:21.544458 31361 connection.cc:256] RPC call timeout handler was delayed by -1.0428127400000449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:24:21.544915 31361 connection.cc:256] RPC call timeout handler was delayed by -1.039212740000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 12:24:21.546679 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.517309  1451 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:21.570163 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:21.604640 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.632815 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.527875  1077 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.594223 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.644598 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.529016  1434 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:21.547909  1412 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.607369  1365 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.615326  1431 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:21.653724 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.533041  1448 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
I20260709 12:24:21.660205 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.746083 32081 raft_consensus.cc:2393] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:21.648093  1234 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.699463  1422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48406 (request call id 10) took 14170 ms. Trace:
I20260709 12:24:21.648669  1451 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.709769 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.550086  1208 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.147s
I20260709 12:24:21.764183 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:21.764576  1456 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.743s	user 0.009s	sys 0.007s
I20260709 12:24:21.712355  1482 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:21.764880 31467 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:21.616586  1465 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 12:24:21.765815 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:21.532810  1301 consensus_queue.cc:1059] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:24:21.716917  1267 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:21.616789  1450 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.721401 32084 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:21.741092  1403 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.648265  1382 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:21.722853  1460 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:21.768354  1403 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:21.722903 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.771651  1301 raft_consensus.cc:3055] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:21.772049  1301 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:21.772414 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:21.773444 31544 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:21.774484  1383 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.653620  1077 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.775851  1420 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.776454  1077 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.729729 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:21.731773  1437 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:21.777348 32076 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:21.777246  1437 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.778602 32076 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:21.729310 32079 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:21.732874  1266 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.779743  1437 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.779650  1266 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.780676 32076 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:21.780833  1403 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.781250 32079 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:21.732462  1192 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.733544 31470 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:21.645123   836 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.782491   836 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.784541   836 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:21.739442 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 199423us
W20260709 12:24:21.742328 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.786851  1267 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.787384  1267 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.788105 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:21.788671 31388 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:21.789407  1267 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.789508 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:21.790714 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:21.733053  1421 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.753298  1365 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.791534 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:21.791505  1421 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.792758 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:21.793277  1365 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.793864 31467 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:21.793797 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:21.796676 32047 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:21.652082 31387 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
W20260709 12:24:21.655725 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 85688.2us
I20260709 12:24:21.761263 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.760098  1451 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:21.767519  1450 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.723948   652 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.768505  1382 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.644426  1402 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:24:21.772944  1301 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.772970 31542 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.725442 31390 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:21.781776  1266 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.653514  1434 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:21.799450 32081 raft_consensus.cc:2410] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:21.756639  1422 rpcz_store.cc:276] 0709 12:24:07.488984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.491313 (+  2329us) service_pool.cc:224] Handling call
0709 12:24:07.624726 (+133413us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b58006206d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912180aa 00007f6e9129a447 00007f6e912b770a 00007f6e912b876a 00007f6e912b791b 00007f6e912c303c 00007f6e912c26b3 00007f6e96282d29 00007f6e8f8011d4 00007f6e8f801162
0709 12:24:07.761174 (+136448us) log.cc:844] Serialized 513 byte log entry
0709 12:24:21.653069 (+13891895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28290,"raft.queue_time_us":44038,"raft.run_cpu_time_us":2288,"raft.run_wall_time_us":37709,"spinlock_wait_cycles":31180288,"thread_start_us":280055,"threads_started":2,"wal-append.queue_time_us":329633,"wal-append.run_cpu_time_us":7309,"wal-append.run_wall_time_us":1552658}
W20260709 12:24:21.802627 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.744293 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.827669 31507 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:21.832751 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:21.834259 31434 leader_election.cc:336] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.752s (SENT)
I20260709 12:24:21.881078 31434 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:21.882067 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 47848.7us
W20260709 12:24:21.834857 31389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1611) took 2359 ms (client timeout 1780 ms). Trace:
W20260709 12:24:21.844528 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.793958  1421 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:21.846963  1489 ts_tablet_manager.cc:933] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:21.848532 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 190814us
I20260709 12:24:21.856992 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1643) took 1771 ms. Trace:
I20260709 12:24:21.867861 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:21.740061  1412 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:21.875759 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1610) took 2397 ms. Trace:
W20260709 12:24:21.883145 31389 rpcz_store.cc:269] 0709 12:24:19.460871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.563607 (+102736us) service_pool.cc:224] Handling call
0709 12:24:21.820263 (+2256656us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540033d1d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:21.820475 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136865152}
I20260709 12:24:21.890944 32079 raft_consensus.cc:1240] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:21.931998 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.932205 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:21.933697 31468 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.935377 31462 rpcz_store.cc:276] 0709 12:24:20.085957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.217851 (+1131894us) service_pool.cc:224] Handling call
0709 12:24:21.281428 (+ 63577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.285335 (+  3907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.852165 (+566830us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400018950. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:21.856903 (+  4738us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80628608}
I20260709 12:24:21.918990 31542 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:21.931965 31390 rpcz_store.cc:276] 0709 12:24:19.460597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.677471 (+216874us) service_pool.cc:224] Handling call
0709 12:24:21.707913 (+2030442us) spinlock_profiling.cc:243] Waited 923 us on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:21.725225 (+ 17312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.858139 (+132914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.858388 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124032}
I20260709 12:24:21.875111  1434 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.939036  1490 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:21.954309 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.885159  1179 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.954957 32083 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:21.950241  1383 consensus_queue.cc:1059] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:24:21.955928 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.879583  1478 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:21.959434 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 161022us
W20260709 12:24:21.903869 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 71195us
I20260709 12:24:21.964228 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:21.968564 31436 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:21.886339  1266 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:21.969964 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:21.970799 31462 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:21.939538  1421 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.944685  1301 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.943949   652 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:21.980757 31436 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:21.987784 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:21.952334 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.957425  1412 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:21.983908   836 consensus_queue.cc:1059] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:24:22.000734  1403 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:22.001006 32076 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:22.001298  1450 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:22.001348   836 raft_consensus.cc:3055] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:22.001928   836 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:22.009339 31507 leader_election.cc:400] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7.
I20260709 12:24:21.977860  1179 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.010396 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.013118 32048 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:22.017527 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:21.991691  1192 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.020926 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1503) took 2927 ms. Trace:
W20260709 12:24:22.060307 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 52280.7us
I20260709 12:24:21.997429  1365 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:22.077381 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:22.008910 31361 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:22.078006 31542 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:21.977922  1449 consensus_queue.cc:1059] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:24:22.079136 31543 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:22.079360 31544 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:22.056370 31469 rpcz_store.cc:276] 0709 12:24:19.093248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.093415 (+   167us) service_pool.cc:224] Handling call
0709 12:24:19.116246 (+ 22831us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:19.122187 (+  5941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.122226 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:19.124013 (+  1787us) log.cc:844] Serialized 52 byte log entry
0709 12:24:21.373599 (+2249586us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b180032e0c0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:24:21.653963 (+280364us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.969537 (+315574us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.011743 (+ 42206us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.012035 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.012121 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.020733 (+  8612us) raft_consensus.cc:1685] finished
0709 12:24:22.020753 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.020875 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39444,"raft.queue_time_us":12252,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":8182,"spinlock_wait_cycles":2901248,"thread_start_us":450186,"threads_started":2,"wal-append.queue_time_us":2634972}
I20260709 12:24:22.082216 31463 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 12:24:22.086372 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 145381us
W20260709 12:24:22.088259 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 98660.4us
W20260709 12:24:22.088701 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 79875.2us
I20260709 12:24:22.012404  1273 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:22.074855  1487 log.cc:927] Time spent T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:24:22.020978  1488 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:22.089993 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:22.002846   836 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:21.993719  1421 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.100824 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.075882  1235 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.078317  1365 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.087368 32077 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:22.017148  1402 consensus_queue.cc:1059] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:24:22.124035 31510 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:22.133355 31464 consensus_meta.cc:287] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
W20260709 12:24:22.134622 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 44743.2us
I20260709 12:24:22.156908 31464 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:22.157426 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:22.158980 31361 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:22.055804  1179 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.164592 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:22.168735 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:22.078298  1266 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:24:22.170040 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 72728.8us
I20260709 12:24:22.103022   652 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:22.114085  1365 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.114511  1315 raft_consensus.cc:3055] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:22.172845 31543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:22.207492 31543 raft_consensus.cc:606] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:22.207903 31543 raft_consensus.cc:614] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:22.173039 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 49103.3us
I20260709 12:24:22.106958 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.204365 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:22.204433 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.160317  1450 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:22.209813 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:22.218945 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:22.207790 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.220904 31467 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:22.148732  1412 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.171859  1501 raft_consensus.cc:3055] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:22.230279 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.230216 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.231137 31392 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:22.231787 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.231987 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.233070 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.233606 31467 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:22.234378 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:22.222713 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.225314 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.101651  1273 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.236461 31359 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:22.237116 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.237905 31467 raft_consensus.cc:2410] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:24:22.242174 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.199219  1402 consensus_queue.cc:1243] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:22.170353  1077 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:22.178134   836 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:22.251787 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:22.252297 31389 raft_consensus.cc:2376] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5. Re-sending same reply.
I20260709 12:24:22.249958 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.253615 31387 raft_consensus.cc:2393] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:22.253547 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:22.254173 31464 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.203799 32077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 484) took 1294 ms. Trace:
I20260709 12:24:22.206926  1482 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:22.218041  1487 log.cc:927] Time spent T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:22.247632 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.292100 31392 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:22.207053  1315 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:22.258373 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.259487 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:22.149034  1235 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.259712 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.290509 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:22.227674 32076 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:22.265913 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.246850  1095 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:22.304396 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:22.305420 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:22.229923  1501 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:22.298024 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.326941 31392 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:22.255496  1077 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.327579  1077 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.327947 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.329401 31392 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:22.330632 31392 raft_consensus.cc:1275] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:22.298241 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:22.298833 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 89098.7us
I20260709 12:24:22.334506 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:22.301491 31536 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.291285 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.217857  1449 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:24:22.306075 31389 raft_consensus.cc:2368] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6.
I20260709 12:24:22.257560  1450 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:22.294945 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:22.311592 31394 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
W20260709 12:24:22.311655 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 60180.3us
I20260709 12:24:22.248059  1382 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.316980 31464 raft_consensus.cc:2410] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:22.293042  1482 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.336655 31389 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:22.349570 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.248586  1483 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.336987 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:22.337788  1497 log.cc:927] Time spent T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:24:22.338585 31540 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:22.340811 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.342089 32050 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:22.361925 32050 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:22.297181  1412 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:22.304214  1479 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
I20260709 12:24:22.334245 31535 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:22.314359  1095 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.356002 31536 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:22.371460 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:22.357633 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:22.369547 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:22.341542  1267 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.257011 32077 rpcz_store.cc:276] 0709 12:24:20.909603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.918406 (+  8803us) service_pool.cc:224] Handling call
0709 12:24:21.888137 (+969731us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:22.199058 (+310921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4576128}
I20260709 12:24:22.349828  1465 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:22.381810 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:22.391166 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 45251.2us
I20260709 12:24:22.391966 31541 raft_consensus.cc:2410] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:22.392515 31507 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:22.393884 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:22.394618 31540 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:22.356703  1482 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.366598  1412 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.371383  1475 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.373664  1382 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:22.383086  1422 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:22.367606  1488 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:24:22.373457  1492 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.378615  1095 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.391209  1465 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:22.400311 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 155125us
I20260709 12:24:22.356770  1077 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.435346 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1634) took 2634 ms. Trace:
W20260709 12:24:22.405453 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 169049us
I20260709 12:24:22.441211 31537 raft_consensus.cc:2410] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:22.367928  1489 tablet_copy_client.cc:323] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:24:22.375618  1494 consensus_queue.cc:1059] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:24:22.399559  1510 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:22.405205  1412 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.457432 31466 rpcz_store.cc:276] 0709 12:24:19.800897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.653613 (+852716us) service_pool.cc:224] Handling call
0709 12:24:20.653889 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.516336 (+862447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.435064 (+918728us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54000fafd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:22.435284 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982026624}
I20260709 12:24:22.470850 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.390771  1267 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.456977  1508 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:22.472088 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.482705 31466 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:22.443610  1465 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.372267  1315 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.439595  1422 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:22.434515  1407 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.449733  1421 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:22.460683 31468 consensus_meta.cc:287] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.003s
W20260709 12:24:22.483471 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 91019.4us
I20260709 12:24:22.536077 31468 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
W20260709 12:24:22.484833 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 140088us
I20260709 12:24:22.402592  1501 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.477065  1383 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.527926 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.463053  1179 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.471935  1510 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:22.552959  1510 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:22.456382  1301 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:24:22.557168  1077 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.557034  1518 consensus_queue.cc:1059] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:22.558080  1518 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:22.560698  1267 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:22.561447  1434 consensus_meta.cc:287] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 12:24:22.561815  1434 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.563519 31464 raft_consensus.cc:2393] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:22.565725  1501 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:22.568349  1383 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.570371  1383 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:22.575549 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1510) took 3087 ms. Trace:
I20260709 12:24:22.543972  1517 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:22.577657   652 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:22.578596  1434 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.538324 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:22.597049 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:22.597209 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 58962.4us
W20260709 12:24:22.485203  1498 log.cc:927] Time spent T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:24:22.551697 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.535334  1508 raft_consensus.cc:697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:22.583638  1235 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:22.457931  1450 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.543490  1407 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.539201  1422 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:22.588243 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1656) took 1311 ms. Trace:
I20260709 12:24:22.588316  1431 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:22.589174  1375 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.590252 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.592039  1478 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.570868  1383 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.575965 31465 rpcz_store.cc:276] 0709 12:24:19.488242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.831645 (+343403us) service_pool.cc:224] Handling call
0709 12:24:19.831991 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:19.832408 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:19.868955 (+ 36547us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.854018 (+985063us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18002d6340. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf522 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:21.820837 (+966819us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18002d6340. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c23a 00007f6e912c6a2a
0709 12:24:22.013241 (+192404us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:22.045479 (+ 32238us) log.cc:844] Serialized 52 byte log entry
0709 12:24:22.045701 (+   222us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:22.116602 (+ 70901us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.117047 (+   445us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.117262 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.117326 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.339817 (+222491us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b18002d6340. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:22.575331 (+235514us) raft_consensus.cc:1685] finished
0709 12:24:22.575354 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.575491 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75704,"prepare.queue_time_us":388412,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":28807,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":50319,"spinlock_wait_cycles":136409856,"thread_start_us":185855,"threads_started":2,"wal-append.queue_time_us":2170265}
W20260709 12:24:22.598681 31461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1657) took 1313 ms (client timeout 1500 ms). Trace:
I20260709 12:24:22.599264 31510 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:22.601439  1517 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:22.604846 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.608762 32050 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:22.611387 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 140855us
W20260709 12:24:22.634589 31461 rpcz_store.cc:269] 0709 12:24:21.285411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.551441 (+1266030us) service_pool.cc:224] Handling call
0709 12:24:22.598599 (+ 47158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:22.625986 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 161366us
I20260709 12:24:22.625959 31470 rpcz_store.cc:276] 0709 12:24:21.277314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.330327 (+ 53013us) service_pool.cc:224] Handling call
0709 12:24:22.588070 (+1257743us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54001306d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:22.588182 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809118464}
I20260709 12:24:22.636245 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.636165 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.637295 31461 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:22.638271 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.630743 31389 raft_consensus.cc:2410] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:22.596608  1208 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:22.623747  1192 consensus_meta.cc:287] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.003s
I20260709 12:24:22.636819 31470 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
W20260709 12:24:22.640056 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 102313us
I20260709 12:24:22.641259 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.610989  1481 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.644127 31359 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:22.644799 31470 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:22.647616 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.658246 31461 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:22.660410 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1650) took 2293 ms. Trace:
I20260709 12:24:22.660951 31461 rpcz_store.cc:276] 0709 12:24:20.367123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.659390 (+2292267us) service_pool.cc:224] Handling call
0709 12:24:22.659741 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.659975 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.660010 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.660065 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:22.660129 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.660220 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.660344 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.690706 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:22.692981 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 93801.4us
I20260709 12:24:22.693694 31510 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:22.696578 31467 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:22.702567 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 340) took 4122 ms. Trace:
I20260709 12:24:22.633081 32078 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:22.643991  1399 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:22.663967 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1649) took 2363 ms. Trace:
I20260709 12:24:22.708063 32084 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:22.703001 31393 rpcz_store.cc:276] 0709 12:24:18.580239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.960973 (+1380734us) service_pool.cc:224] Handling call
0709 12:24:21.820451 (+1859478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.820722 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.820762 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.820817 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:21.820877 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.820950 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.702384 (+881434us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540033d1d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:22.702502 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4275059456}
I20260709 12:24:22.709511 31470 rpcz_store.cc:276] 0709 12:24:20.300283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.642017 (+2341734us) service_pool.cc:224] Handling call
0709 12:24:22.642303 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.663724 (+ 21421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.663915 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.642124  1517 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.634788  1478 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:22.718935  1528 consensus_queue.cc:1059] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:22.719957  1528 consensus_queue.cc:1059] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:22.722729  1407 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.723436 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:22.723698 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.724283 31389 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:22.724655 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.663760  1208 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.663396  1192 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:22.631873  1431 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.736259 31465 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:22.714447 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet d762e82a994f48968e08b715c9df4a7a from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:24:22.736980 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1665) took 1193 ms. Trace:
I20260709 12:24:22.738891 31465 rpcz_store.cc:276] 0709 12:24:21.543163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.691897 (+1148734us) service_pool.cc:224] Handling call
0709 12:24:22.712981 (+ 21084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.736701 (+ 23720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.736923 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:22.741775 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 48166.8us
W20260709 12:24:22.746217 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.746713 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.750708 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 51066.2us
I20260709 12:24:22.686635  1481 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.754958  1529 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:22.791347 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet d762e82a994f48968e08b715c9df4a7a from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-d762e82a994f48968e08b715c9df4a7a
I20260709 12:24:22.901589 31470 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:22.752440 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:22.903491 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 151148us
I20260709 12:24:22.799360 31462 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
W20260709 12:24:22.904497 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.905611  1529 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:22.905887 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 279) took 1148 ms. Trace:
I20260709 12:24:22.906754  1529 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.909845  1273 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.910008  1523 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:22.741250  1399 raft_consensus.cc:697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:22.911136  1480 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.911257  1399 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.801810  1450 raft_consensus.cc:3055] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:22.790154 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:22.912415  1450 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:22.913064 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 122994us
I20260709 12:24:22.913125 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.913302  1450 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.913905 32079 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:22.914501  1450 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.797850 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.914783  1500 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:22.915621  1500 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:22.915956 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.904521 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:22.793848  1482 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:22.814008  1519 log.cc:927] Time spent T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:22.916898  1500 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:24:22.814919  1520 log.cc:927] Time spent T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:24:22.814802  1463 raft_consensus.cc:3055] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:22.917800 31510 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:22.918005  1463 raft_consensus.cc:740] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:22.918627  1383 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:22.816411  1437 raft_consensus.cc:3055] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:22.822448  1488 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.918911  1482 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.823446 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.919521  1488 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.920228 32077 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:22.921298 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.921931 32077 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:22.898934 32078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 453) took 1170 ms. Trace:
I20260709 12:24:22.800918  1483 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:22.823837 31540 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:22.920295 31480 tablet_copy_source_session.cc:215] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:22.826443 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.828071 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:22.824518  1387 raft_consensus.cc:3055] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:22.923885 31535 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:22.924072  1387 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:22.829526 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:22.835940 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.925457 31468 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:22.830546 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:22.802471  1448 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:24:22.837080 31469 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:22.840607  1502 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.669s	user 0.004s	sys 0.000s
W20260709 12:24:22.926345 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 95879.9us
I20260709 12:24:22.753789  1301 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:22.727607  1517 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.927094  1301 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.927578  1301 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.927883  1490 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:22.916814  1501 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:24:22.930377  1267 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:22.930836  1267 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.848716 32050 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:22.931200  1267 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:22.849277  1493 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.678s	user 0.002s	sys 0.000s
I20260709 12:24:22.851186 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.796236  1431 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:22.852276  1522 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:24:22.933530  1527 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:22.727303  1365 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.934017  1527 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.934468  1527 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:22.855027  1510 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.935658 31386 raft_consensus.cc:2368] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7.
I20260709 12:24:22.935892  1365 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.936029 31536 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:22.855594 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1648) took 2659 ms. Trace:
I20260709 12:24:22.937359 31395 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:22.937043  1492 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:22.936676 31463 rpcz_store.cc:276] 0709 12:24:20.196340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.338606 (+1142266us) service_pool.cc:224] Handling call
0709 12:24:21.338953 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:22.085991 (+747038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.855317 (+769326us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54000fa0d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:22.855538 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701360512}
I20260709 12:24:22.911886  1480 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.944132 32076 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:22.831089 31464 raft_consensus.cc:1275] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.945689 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:22.865758  1499 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.648s	user 0.004s	sys 0.004s
W20260709 12:24:22.862874 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.871171 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:22.870633  1518 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:22.946868 31544 raft_consensus.cc:606] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:22.947137  1518 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.947738  1501 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:22.948596  1501 consensus_queue.cc:1243] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer 842fbe33f4144fa69f1fd428652b6998 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:22.949663  1518 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:22.949693 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:22.922636 32078 rpcz_store.cc:276] 0709 12:24:21.728561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.763885 (+ 35324us) service_pool.cc:224] Handling call
0709 12:24:22.898733 (+1134848us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54000dbbd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:22.898864 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988572544}
I20260709 12:24:22.952291 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74b96090004c463795628c0134d8ecac"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:22.952955 31544 raft_consensus.cc:606] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:22.953369 31544 raft_consensus.cc:614] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:22.938819  1492 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:22.844137  1315 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:22.882798 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.896446  1504 log.cc:927] Time spent T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.485s	user 0.002s	sys 0.000s
I20260709 12:24:22.897435  1506 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.923053 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.955063  1506 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:22.956552 32077 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:22.954901 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.906417 31462 rpcz_store.cc:276] 0709 12:24:21.757396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.987444 (+230048us) service_pool.cc:224] Handling call
0709 12:24:22.905670 (+918226us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b540036c754. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:22.905814 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743530240}
I20260709 12:24:22.919040  1383 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:22.914857 31507 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:22.959059 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44303.8us
I20260709 12:24:22.856890  1095 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.825084 31541 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:22.923302  1437 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:22.692332  1508 consensus_queue.cc:237] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.918962  1463 consensus_queue.cc:260] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.924268 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.921774  1488 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.924968  1387 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.825448 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:22.914857 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:22.937407  1510 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:22.797590  1208 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:23.020537 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:23.020777 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 172108us
I20260709 12:24:23.021377 31462 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:23.021726 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:23.022539 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:22.708797  1511 raft_consensus.cc:3055] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:22.793994  1412 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.723165  1465 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:22.922772  1481 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:22.881206  1478 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:22.992108 31465 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:23.051942 31465 pending_rounds.cc:85] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 3
I20260709 12:24:23.052217 31465 pending_rounds.cc:107] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:23.052451 31465 raft_consensus.cc:2889] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.053683 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:23.001058 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.006325 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 277) took 1435 ms. Trace:
I20260709 12:24:23.011025 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:23.013801 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 376347us
I20260709 12:24:23.015156 31468 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:22.990163  1522 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.057s	user 0.010s	sys 0.009s
I20260709 12:24:23.007877  1475 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.056267 31470 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:23.063241 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:23.064924 31468 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:23.026482  1537 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.077s	user 0.004s	sys 0.004s
I20260709 12:24:23.026669  1387 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.016175  1480 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:23.076500 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 149109us
I20260709 12:24:22.990007  1501 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:23.080701  1501 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:23.081161  1501 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.081102  1267 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.082332 32081 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:23.083644 31536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:23.084287 31536 raft_consensus.cc:606] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:23.084648 31536 raft_consensus.cc:614] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:23.034000  1517 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:23.087177  1517 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:23.087991 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.037438 31386 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.041419 31463 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:23.045969 31436 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:23.047530  1488 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:23.056741 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 56024.9us
I20260709 12:24:23.096443 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:23.007439  1499 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.061s	user 0.000s	sys 0.005s
I20260709 12:24:23.058126 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:23.056042 31469 rpcz_store.cc:276] 0709 12:24:21.578753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.115093 (+536340us) service_pool.cc:224] Handling call
0709 12:24:23.006090 (+890997us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54001900d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:23.006251 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541190912}
I20260709 12:24:23.055051 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:23.025550 31462 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:23.101311 31462 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:22.998241  1500 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.005772  1460 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:23.018872  1523 raft_consensus.cc:697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:23.062505  1475 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.073734 31387 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:23.078192 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1663) took 1566 ms. Trace:
W20260709 12:24:23.027690  1526 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.106s	user 0.002s	sys 0.004s
I20260709 12:24:23.050494 32050 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:23.091010 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 45165.7us
I20260709 12:24:23.129724 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.041772  1511 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:23.092607 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:23.131018 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 388426us
I20260709 12:24:23.132030 31536 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:23.133198 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.133980 31536 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:23.137383 31540 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:23.126128 31461 rpcz_store.cc:276] 0709 12:24:21.511760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.662202 (+1150442us) service_pool.cc:224] Handling call
0709 12:24:22.662566 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.710019 (+ 47453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.710059 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.740062 (+ 30003us) log.cc:844] Serialized 26 byte log entry
0709 12:24:23.013722 (+273660us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:23.013774 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.013850 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.077967 (+ 64117us) raft_consensus.cc:1685] finished
0709 12:24:23.077986 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.078123 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39231,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3650,"thread_start_us":131534,"threads_started":1,"wal-append.queue_time_us":268832}
I20260709 12:24:23.104646  1315 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.108760 32048 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:23.099422 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:23.065428  1463 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.068818 32082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 447) took 1379 ms. Trace:
I20260709 12:24:23.122280 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:23.150594 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 100213us
I20260709 12:24:23.151048 31544 raft_consensus.cc:2368] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6.
I20260709 12:24:23.122867 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:23.152355 31539 raft_consensus.cc:2410] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:23.123808 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:23.042245  1516 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:24:23.062579  1506 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:23.108094 31391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.027s
I20260709 12:24:23.129199 31543 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:23.050444  1407 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:24:23.141397 31436 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:23.146425 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 47070.2us
I20260709 12:24:23.070617  1301 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:23.149412 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.117223  1521 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:23.152602 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:23.154311 31543 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:23.104708  1273 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:23.064482  1524 consensus_queue.cc:1059] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:24:23.135004 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.107349  1383 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:23.089847  1437 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.150209 32082 rpcz_store.cc:276] 0709 12:24:21.689760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.729609 (+ 39849us) service_pool.cc:224] Handling call
0709 12:24:21.730016 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.730423 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.730457 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.731049 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.969864 (+238815us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:21.969919 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.970004 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.848632 (+878628us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:23.040033 (+191401us) raft_consensus.cc:1685] finished
0709 12:24:23.040055 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.068740 (+ 28685us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4356,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":36072192,"thread_start_us":238291,"threads_started":1,"wal-append.queue_time_us":356835}
W20260709 12:24:23.176895 31359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.011s	sys 0.013s
I20260709 12:24:23.646814 31389 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 2.
I20260709 12:24:23.191143 31469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69"
dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:55830
I20260709 12:24:23.594410  1480 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.139169  1095 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:23.656302 31361 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:23.269373  1501 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.658088 31538 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:23.658686  1528 consensus_queue.cc:1059] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:23.659698  1450 raft_consensus.cc:3055] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:23.660077  1450 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:23.660117 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.660975  1450 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:23.623767 31465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.007s
W20260709 12:24:23.564617  1527 consensus_meta.cc:287] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.630s	user 0.012s	sys 0.000s
I20260709 12:24:23.156827 32050 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:23.128791  1475 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.179764 32080 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:23.450651  1539 log.cc:927] Time spent T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:24:23.155210  1488 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:23.137840  1460 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:23.154388 31540 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:23.333943 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.650292  1478 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:23.491894  1489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d762e82a994f48968e08b715c9df4a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.657401  1095 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:23.662889 31465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.007s
W20260709 12:24:23.623512  1508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.000s
I20260709 12:24:23.661369 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.663448 31543 pending_rounds.cc:85] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 4
I20260709 12:24:23.689419 31543 pending_rounds.cc:107] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:23.689797 31543 raft_consensus.cc:2889] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:23.663918 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 507126us
I20260709 12:24:23.157183  1481 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.481106  1465 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:23.463083 31433 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.634s (SENT)
W20260709 12:24:23.694290 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 231259us
I20260709 12:24:23.664325  1541 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.696772 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.698374 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.699059 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:23.693298  1508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.011s	sys 0.000s
I20260709 12:24:23.700722  1301 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:23.701833 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.703598 31538 raft_consensus.cc:2393] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:23.146235  1434 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.523s
I20260709 12:24:23.667452  1540 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:23.703286 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:23.705430 31543 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.706833  1501 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:23.211633 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 61486.5us
W20260709 12:24:23.709378 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.173614 31539 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:23.710553 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:23.710264  1460 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:23.711633 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.290910  1511 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.283707  1490 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:23.712443  1511 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.712750 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.712612  1490 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.201140  1412 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:23.713524  1315 raft_consensus.cc:3055] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:23.713526 31539 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:23.173612  1523 consensus_queue.cc:237] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:23.242208 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1669) took 1009 ms. Trace:
W20260709 12:24:23.670480 31359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.022s	sys 0.060s
W20260709 12:24:23.670588 31391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.008s	sys 0.044s
W20260709 12:24:23.714892 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 1.07075e+06us
I20260709 12:24:23.714762 31387 rpcz_store.cc:276] 0709 12:24:22.232681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.291015 (+ 58334us) service_pool.cc:224] Handling call
0709 12:24:23.241977 (+950962us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54003f2d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:23.242141 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696823040}
I20260709 12:24:23.715751 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 362) took 1171 ms. Trace:
I20260709 12:24:23.668993 31461 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
W20260709 12:24:23.445286 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.716730 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.671331 31536 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:23.182837 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:23.717121 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 575751us
I20260709 12:24:23.717608 31544 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:23.717833 31436 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:23.718331 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.718401 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.716118 31391 rpcz_store.cc:276] 0709 12:24:22.544846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.590835 (+ 45989us) service_pool.cc:224] Handling call
0709 12:24:22.591270 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.591575 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.591603 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.592065 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:24:23.715077 (+1123012us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:23.715119 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.715191 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.715566 (+   375us) raft_consensus.cc:1685] finished
0709 12:24:23.715579 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.715696 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125910,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":1122618,"threads_started":1,"wal-append.queue_time_us":584451}
I20260709 12:24:23.719295 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.719439 31540 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:23.720005 31388 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:23.219733 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.680764 31361 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:23.174340  1532 log.cc:927] Time spent T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:24:23.150308  1235 consensus_queue.cc:1059] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.505s
I20260709 12:24:23.341512  1267 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:23.688259  1095 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:23.701249 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.728133 31434 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.505s (SENT)
I20260709 12:24:23.729086 31386 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:23.729451 31386 pending_rounds.cc:85] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 5
W20260709 12:24:23.729404 31434 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.518s (SENT)
W20260709 12:24:23.729883 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.730131 31434 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:23.729902 31386 pending_rounds.cc:107] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:23.731037 31386 raft_consensus.cc:2889] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.671414  1527 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.704541 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:23.176362  1422 consensus_meta.cc:287] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.004s
I20260709 12:24:23.713933  1315 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:23.623881 31464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.017s
W20260709 12:24:23.736115 31464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.007s	sys 0.018s
I20260709 12:24:23.736773 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 284) took 1482 ms. Trace:
I20260709 12:24:23.737097 31464 rpcz_store.cc:276] 0709 12:24:22.254171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.012076 (+757905us) service_pool.cc:224] Handling call
0709 12:24:23.012731 (+   655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.012993 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:23.048913 (+ 35920us) log.cc:844] Serialized 14 byte log entry
0709 12:24:23.736479 (+687566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:23.736527 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:23.736569 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.736626 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.736723 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38767,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":5207,"thread_start_us":687248,"threads_started":1,"wal-append.queue_time_us":639603}
I20260709 12:24:23.716576 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:23.738835 31395 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:23.721159 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.672269 31537 raft_consensus.cc:2393] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:23.740993 31461 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:23.741279 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:23.651490 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 542746us
I20260709 12:24:23.721093 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.742689 31389 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:23.720284 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:23.573299 31290 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45406 (request call id 161) took 19963 ms (client timeout 15000 ms). Trace:
I20260709 12:24:23.599581 31291 catalog_manager.cc:5697] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 3 to 5, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 5 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.722664 32047 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:23.724673 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.745337 31544 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:23.745373 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.746369 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.747149 31544 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:23.748245 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.691646  1488 raft_consensus.cc:697] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:23.753322 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:23.725638 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.754326 31539 raft_consensus.cc:2376] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6. Re-sending same reply.
I20260709 12:24:23.725862 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:23.754746 31386 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:23.726354 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.726550 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.724112 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.755805 31388 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
W20260709 12:24:23.723489 31468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.015s
W20260709 12:24:23.756531 31468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.016s
I20260709 12:24:23.732177 31538 raft_consensus.cc:2410] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:23.733419 32050 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:23.751814 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:23.734067 31393 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:23.728478  1208 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:23.734304  1095 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.761339 31291 catalog_manager.cc:5697] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 2, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:24:23.750561 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.725364  1412 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.751686 31389 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:23.786463 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.694929  1481 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.760372 31391 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:23.790405 31391 pending_rounds.cc:85] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 5
I20260709 12:24:23.790695 31391 pending_rounds.cc:107] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:23.790925 31391 raft_consensus.cc:2889] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.761452 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:23.732230  1273 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.762970 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:23.792665 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.793223 31537 raft_consensus.cc:2410] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:23.770612 31543 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:23.759107  1434 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.774993 31291 catalog_manager.cc:5697] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.778501 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:23.780449 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 62686.1us
I20260709 12:24:23.797415 31540 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:23.798142 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.798738 31389 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:23.799806 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.800422 31540 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:23.801294 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.802079 31540 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:23.797495 31436 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:23.774435 31536 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:23.802847 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.791666 31463 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.724277 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:23.804545 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 80376us
I20260709 12:24:23.805789 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:23.763489  1208 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.773258 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.810582 31539 raft_consensus.cc:2376] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6. Re-sending same reply.
I20260709 12:24:23.794310 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.757606  1540 consensus_queue.cc:1059] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:24:23.739192  1422 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.811918 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.812487 31543 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:23.760037  1478 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:23.785066 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.816676 31466 raft_consensus.cc:2393] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:23.816933 31544 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:23.803192 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.817121 31469 raft_consensus.cc:606] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:23.817559 31469 raft_consensus.cc:614] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:23.817802 31536 raft_consensus.cc:2410] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:23.794032 31394 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:23.809711 31387 raft_consensus.cc:2410] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:23.790287 31538 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:23.762380  1490 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:23.815143 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:23.798434 31291 catalog_manager.cc:5697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.815755 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:23.790179  1431 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.752013  1541 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:24:23.796571  1399 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.821815 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.822010 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:23.820294 31291 catalog_manager.cc:5697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.814227  1208 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.816315  1478 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.793612  1273 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.794373  1481 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.813273  1422 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:23.824925 31540 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:23.867803 31540 pending_rounds.cc:85] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 3
I20260709 12:24:23.820782 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.868065 31540 pending_rounds.cc:107] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:23.868214 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.868678 31540 raft_consensus.cc:2889] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.869059 31544 raft_consensus.cc:2393] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:23.813341  1528 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:23.825749  1540 raft_consensus.cc:3055] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:23.825485  1431 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:23.828646 31291 catalog_manager.cc:5697] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 5, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 5 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.821187  1553 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:23.875892 31467 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:23.845829 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:23.876715 31461 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:23.877754 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:23.878314 31461 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.841547 31510 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:23.817516  1412 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:23.820873  1524 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.870352 31394 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:23.868021 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 117416us
I20260709 12:24:23.843420  1463 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:23.840322 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:23.879429 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 136279us
I20260709 12:24:23.880319 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:23.875789 31466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1526) took 1639 ms (client timeout 2161 ms). Trace:
I20260709 12:24:23.851845  1478 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.882378 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:23.882596 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:23.899078 31468 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.901660 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.850525  1518 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:23.887945 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:23.884346 31434 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.643s (SENT)
I20260709 12:24:23.917835 31434 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:23.839489  1399 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.872721 31291 catalog_manager.cc:5697] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:23.895377 31466 rpcz_store.cc:269] 0709 12:24:22.236303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.603721 (+367418us) service_pool.cc:224] Handling call
0709 12:24:23.875585 (+1271864us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400414e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:23.875732 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2708731136}
I20260709 12:24:23.881199 31544 raft_consensus.cc:1275] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:24:23.921663 31544 pending_rounds.cc:85] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 2
I20260709 12:24:23.922008 31544 pending_rounds.cc:107] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:24:23.922297 31544 raft_consensus.cc:2889] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.922681 31544 pending_rounds.cc:107] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:23.922971 31544 raft_consensus.cc:2889] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.868990  1273 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.942414 31466 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:23.897969 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:23.944797 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 46898.2us
I20260709 12:24:23.885600 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:23.911026 31468 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:23.803934  1315 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.892355  1450 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:23.951310 31434 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.890s (SENT)
I20260709 12:24:23.917840 31464 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.955312 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:23.743610 31290 rpcz_store.cc:269] 0709 12:24:03.609933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.610109 (+   176us) service_pool.cc:224] Handling call
0709 12:24:23.573016 (+19962907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:13.184953 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:13.348693 (+163740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:13.348726 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:24:13.348747 (+    21us) tablet.cc:662] Decoding operations
0709 12:24:13.701506 (+352759us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:13.701592 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:13.701617 (+    25us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:24:13.702612 (+   995us) tablet.cc:701] Row locks acquired
0709 12:24:13.702634 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:24:13.702771 (+   137us) write_op.cc:270] Start()
0709 12:24:13.702879 (+   108us) write_op.cc:276] Timestamp: P: 1783599853702728 usec, L: 0
0709 12:24:13.702900 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:13.703522 (+   622us) log.cc:844] Serialized 4782 byte log entry
0709 12:24:16.099395 (+2395873us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:16.898164 (+798769us) op_driver.cc:464] REPLICATION: finished
0709 12:24:17.709931 (+811767us) write_op.cc:301] APPLY: starting
0709 12:24:17.745430 (+ 35499us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:17.761786 (+ 16356us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:17.778919 (+ 17133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:18.482890 (+703971us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b5c0026058c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e974ae331 00007f6e974ae221 00007f6e974a8f6c 00007f6e94c0930b 00007f6e94c08fd3 00007f6e94d07e34 00007f6e94cf397c 00007f6e94cf7d61 00007f6e94cf7d19 00007f6e94cf7ca9 00007f6e94cf7c71
0709 12:24:18.484178 (+  1288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:18.554361 (+ 70183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:24:18.554407 (+    46us) write_op.cc:312] APPLY: finished
0709 12:24:18.554876 (+   469us) log.cc:844] Serialized 89 byte log entry
0709 12:24:18.848102 (+293226us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:18.876737 (+ 28635us) write_op.cc:454] Released schema lock
0709 12:24:18.876826 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:19.098279 (+221453us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:19.098318 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1047972,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":746242,"apply.run_cpu_time_us":35343,"apply.run_wall_time_us":1403248,"num_ops":12,"prepare.queue_time_us":588747,"prepare.run_cpu_time_us":16349,"prepare.run_wall_time_us":1303104,"raft.queue_time_us":235554,"raft.run_cpu_time_us":35514,"raft.run_wall_time_us":315261,"replication_time_us":3195025,"spinlock_wait_cycles":42625664,"thread_start_us":1416726,"threads_started":5,"wal-append.queue_time_us":1514449,"wal-append.run_cpu_time_us":63242,"wal-append.run_wall_time_us":4862369}]]}
I20260709 12:24:23.958995 31540 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:23.959970 31434 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.946s (SENT)
W20260709 12:24:23.961046 31434 leader_election.cc:336] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.973s (SENT)
I20260709 12:24:23.961485 31434 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:23.871256  1528 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:23.875946  1540 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:23.940734 31291 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 3 to 6, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 6 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:24:23.942022 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 208685us
I20260709 12:24:23.876129  1553 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:23.891119  1490 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:23.952206  1399 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.950373  1527 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:23.949734  1518 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:23.947199 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:23.950555 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:23.958012 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:23.887607  1475 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:23.899618  1463 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:23.918030  1465 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:23.976171 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:24.075177  1465 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:24.075649  1465 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:24.016497 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 55485us
W20260709 12:24:24.077256 31434 leader_election.cc:336] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 2.206s (SENT)
I20260709 12:24:24.017777 31291 catalog_manager.cc:5697] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.986160  1528 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:23.957298  1529 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:23.954973  1266 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:24.052026 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:23.871629  1488 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:24.090684 31544 raft_consensus.cc:2376] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6. Re-sending same reply.
I20260709 12:24:24.086212 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:24.087383 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 140270us
I20260709 12:24:24.050839  1434 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.986192  1315 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.968251  1508 consensus_queue.cc:1059] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:24:23.978297 31461 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:24.079653 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.079128 31291 catalog_manager.cc:5697] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 6, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 6 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:24.081549 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:24.021767  1553 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.012462  1501 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:24.084542  1529 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:24.025323  1490 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:24.034116  1557 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.066293 31464 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:24.093495 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:24.139998 31544 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:24.074383  1524 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:24.082156  1535 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:24.091969 31538 raft_consensus.cc:2376] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6. Re-sending same reply.
I20260709 12:24:24.109752 31540 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:24.104018 31465 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:24.108647 31291 catalog_manager.cc:5697] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 4 to 6, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 6 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:24.126312  1549 log.cc:927] Time spent T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:24:24.091737  1437 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.083238 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:24.111155  1434 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:24.100083  1560 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:24.146232 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.122002 31539 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:24:24.172807  1560 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:24.163465 31291 catalog_manager.cc:5697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 4, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 4 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:24.155949  1545 log.cc:927] Time spent T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 12:24:24.126191  1529 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.125339  1501 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:24.178659  1501 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:24.153671  1463 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:24.126091  1550 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 12:24:24.161396  1524 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:24.181475 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 272) took 1090 ms. Trace:
I20260709 12:24:24.175064  1560 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:24.182683  1524 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:24.128583  1490 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.181854 31542 rpcz_store.cc:276] 0709 12:24:23.090760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.091256 (+   496us) service_pool.cc:224] Handling call
0709 12:24:23.091582 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.116029 (+ 24447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.116060 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:23.121435 (+  5375us) log.cc:844] Serialized 26 byte log entry
0709 12:24:23.624279 (+502844us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:23.624338 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.624442 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:24.181272 (+556830us) raft_consensus.cc:1685] finished
0709 12:24:24.181292 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.181419 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7942,"raft.queue_time_us":24566,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9017,"thread_start_us":467480,"threads_started":1,"wal-append.queue_time_us":588804}
W20260709 12:24:24.185537 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 92534.8us
I20260709 12:24:24.174772 31291 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 4 to 6, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 6 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:24.188004 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.188447 31291 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 4, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 4 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:24.190251 31291 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 5 to 7, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 7 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.192692 31291 catalog_manager.cc:5697] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.159305  1527 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:24.195000 31291 catalog_manager.cc:5697] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:24:24.109200  1540 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:24.317413 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.414728 31291 catalog_manager.cc:5697] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 5 to 7, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 7 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.240684 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:24.416893 31391 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.345002 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.234776 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.418007 31389 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:24.236199 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 407407us
I20260709 12:24:24.339504  1556 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.482944  1556 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:24.363361  1564 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:24:24.416760 31291 catalog_manager.cc:5697] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 5, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 5 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:24.353190  1562 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 12:24:24.516988 31463 consensus_meta.cc:287] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.006s
I20260709 12:24:24.517563 31463 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
W20260709 12:24:24.513917 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53610.3us
I20260709 12:24:24.339166 32076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 491) took 1243 ms. Trace:
I20260709 12:24:24.275027  1431 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:24.522603 31361 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:24.344637  1475 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:24.540635 31361 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:24.543767 31507 connection.cc:256] RPC call timeout handler was delayed by -1.7692447720000928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:24:24.544327 31507 connection.cc:256] RPC call timeout handler was delayed by -1.7485447720000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 12:24:24.544713 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5559447720002026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 12:24:24.545061 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5343447720001677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 12:24:24.545423 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5028447720001168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 12:24:24.545782 31507 connection.cc:256] RPC call timeout handler was delayed by -1.499244772000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 12:24:24.540896 32082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.012s
I20260709 12:24:24.530154 31291 catalog_manager.cc:5697] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 4, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 4 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:24.576092 32082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.012s
W20260709 12:24:24.546154 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4920447720000993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:24:24.578224 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4749447720000717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 12:24:24.578552 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4740447720000702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:24:24.578883 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4056447719999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 12:24:24.243624  1555 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.297s
I20260709 12:24:24.575418 31291 catalog_manager.cc:5697] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 2, term changed from 1 to 4, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to <none>, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
W20260709 12:24:24.579272 31507 connection.cc:256] RPC call timeout handler was delayed by -1.3147447719998127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 12:24:24.581158 31507 connection.cc:256] RPC call timeout handler was delayed by -1.3093447719998039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:24:24.581188 31291 catalog_manager.cc:5697] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 6, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 6 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.582463 31389 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:24:24.582363 31507 connection.cc:256] RPC call timeout handler was delayed by -1.2490447720001612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 12:24:24.583395 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1797447720000491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 12:24:24.583029 31291 catalog_manager.cc:5697] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 6, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 6 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:24:24.584408 31291 catalog_manager.cc:5697] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 5, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 5 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:24:24.585732 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.500s (SENT) [suppressed 46 similar messages]
I20260709 12:24:24.585944 31291 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 3 to 4, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 4 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.588575 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:24.592195 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.597363 31394 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.541287  1518 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:24.628398 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.629434 31394 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:24.635757 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.546657  1576 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:24.632932 31358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.005s	sys 0.014s
I20260709 12:24:24.640888 31391 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:24.574467  1508 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:24.618240 31291 catalog_manager.cc:5697] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 3, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:24:24.645727 31358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.006s	sys 0.014s
W20260709 12:24:24.649228 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.650825 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.649533 31291 catalog_manager.cc:5697] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 4, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 4 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:24:24.651494 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.593426  1492 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.003s	sys 0.013s
I20260709 12:24:24.652941 31291 catalog_manager.cc:5697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 3, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 3 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:24.646632  1576 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:24.657904  1492 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.003s	sys 0.013s
I20260709 12:24:24.652581  1434 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:24.672894 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 486298us
I20260709 12:24:24.655687  1508 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:24.673668 32048 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.008s	sys 0.013s
W20260709 12:24:24.704625 32048 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.009s	sys 0.013s
W20260709 12:24:24.674305 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 88395.7us
W20260709 12:24:24.706091 31507 leader_election.cc:336] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.761s (SENT)
I20260709 12:24:24.706611 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:24.708086 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:24.709137 31510 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:24.642971  1580 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:24.665622  1383 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.658022  1556 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:24.679119  1576 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.656433  1592 consensus_queue.cc:1059] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:24:24.724085 31507 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.796s (SENT)
I20260709 12:24:24.728189 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.728984 31391 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:24.701623 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 111330us
W20260709 12:24:24.732960 31507 leader_election.cc:336] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.904s (SENT)
I20260709 12:24:24.717166  1593 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:24.734916 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:24.736387  1508 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:24.736994  1508 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:24.737471  1508 raft_consensus.cc:697] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:24.738348  1508 consensus_queue.cc:237] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:24.536554 32076 rpcz_store.cc:276] 0709 12:24:23.095789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.104579 (+  8790us) service_pool.cc:224] Handling call
0709 12:24:23.149965 (+ 45386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:23.155402 (+  5437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.155445 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:23.156087 (+   642us) log.cc:844] Serialized 52 byte log entry
0709 12:24:23.594099 (+438012us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:23.594171 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.615659 (+ 21488us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:24.338909 (+723250us) raft_consensus.cc:1685] finished
0709 12:24:24.338932 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.339098 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"thread_start_us":437561,"threads_started":1,"wal-append.queue_time_us":586466}
I20260709 12:24:24.740361 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:24.741266 32082 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:24.741636  1566 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:24:24.741969  1556 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.742575  1556 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:24.744910  1556 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:24.718775  1511 consensus_meta.cc:287] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.993s	user 0.005s	sys 0.018s
I20260709 12:24:24.748435  1460 raft_consensus.cc:3055] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:24.748672  1593 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.748979  1460 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:24.749328  1593 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:24.750644 31394 raft_consensus.cc:2410] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:24.750109  1460 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:24.752947  1553 consensus_meta.cc:287] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.010s
I20260709 12:24:24.753397  1553 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:24.754148 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.711328  1597 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.755643  1527 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.756090  1527 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.757326  1597 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:24.757714  1478 consensus_meta.cc:287] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.000s
I20260709 12:24:24.757840  1597 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:24.758266  1478 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:24.770823  1208 consensus_meta.cc:287] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.901s	user 0.006s	sys 0.003s
I20260709 12:24:24.770970 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.758831  1597 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:24.787012 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:24.783159 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.773938 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:24.880234 31391 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:24.897926 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.880650 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.773546 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:24.783993 31507 leader_election.cc:336] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.011s (SENT)
W20260709 12:24:24.945186 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 236080us
I20260709 12:24:24.946527 31394 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:24.934756 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 147798us
I20260709 12:24:24.947451 31507 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:24.946996 32082 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:24.952920 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:24.727283  1529 consensus_meta.cc:287] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.551s	user 0.018s	sys 0.042s
I20260709 12:24:24.957222 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.957222 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.959900 31391 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:24.960151 31394 raft_consensus.cc:2410] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:24.959795 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.961453 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:24.783659 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55830 (request call id 13) took 1619 ms. Trace:
I20260709 12:24:24.775519 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1620) took 1059 ms. Trace:
W20260709 12:24:24.774981 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.773115 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 281) took 2947 ms. Trace:
I20260709 12:24:24.804347  1553 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:24.993482 31467 rpcz_store.cc:276] 0709 12:24:21.825677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.697489 (+871812us) service_pool.cc:224] Handling call
0709 12:24:23.875707 (+1178218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.876377 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.772863 (+896486us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400414e50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:24.773038 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2640406784}
I20260709 12:24:24.732020  1524 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:24.781423  1437 consensus_meta.cc:287] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.014s
I20260709 12:24:24.957931 31510 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:24.812459  1450 consensus_meta.cc:287] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.849s	user 0.005s	sys 0.015s
W20260709 12:24:24.779455  1463 consensus_meta.cc:287] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.010s
I20260709 12:24:24.979147 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:24.997795 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:24.931252  1095 consensus_meta.cc:287] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.141s	user 0.009s	sys 0.016s
I20260709 12:24:24.771572 32080 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:24.719054  1518 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.242s
I20260709 12:24:24.809877  1593 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:24.929823  1412 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:24.958392  1566 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 12:24:24.803407  1465 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.013s
I20260709 12:24:24.940155  1267 raft_consensus.cc:3055] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.938424  1407 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:24.779816  1434 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.933648  1208 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:24.992873 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.992755 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 208781us
W20260709 12:24:25.048126 31507 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.078s (SENT)
I20260709 12:24:24.779592 32050 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:25.004024 31470 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:25.048764 31470 pending_rounds.cc:85] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 6
I20260709 12:24:25.049072 31470 pending_rounds.cc:107] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:25.049327 31470 raft_consensus.cc:2889] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:25.049409 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:25.006788 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.050298 32083 raft_consensus.cc:2368] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3.
W20260709 12:24:25.051038 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 271529us
I20260709 12:24:25.008956 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:25.053109 31463 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 2.
W20260709 12:24:25.056100 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 245788us
I20260709 12:24:24.991395 31387 rpcz_store.cc:276] 0709 12:24:23.715961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.726315 (+ 10354us) service_pool.cc:224] Handling call
0709 12:24:24.775267 (+1048952us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b5400404054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:24.775450 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123753728}
I20260709 12:24:24.982818  1460 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.984421  1301 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:24.781752  1506 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:24.984565 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:24.988775 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.806068  1527 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:25.031791 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:25.057602 31507 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:25.058142 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:25.058876 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.018657 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 462) took 1175 ms. Trace:
I20260709 12:24:25.081995 32080 rpcz_store.cc:276] 0709 12:24:23.843731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.845004 (+  1273us) service_pool.cc:224] Handling call
0709 12:24:23.876479 (+ 31475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:24.771365 (+894886us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400494420. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e91233dc0 00007f6e912be1c0 00007f6e912bf231 00007f6e912bbd8f 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c
0709 12:24:25.001160 (+229795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.018578 (+ 17418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31512448}
I20260709 12:24:25.016129 31469 rpcz_store.cc:276] 0709 12:24:23.163924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.164108 (+   184us) service_pool.cc:224] Handling call
0709 12:24:24.783448 (+1619340us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400414e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912b6853 00007f6e9628460a 00007f6e8f80a7d4 00007f6e8f80a762 00007f6e8f80a691 00007f6e8f80a60c 00007f6e8f8098c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:24.783564 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372480768}
I20260709 12:24:25.064186 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1614) took 1353 ms. Trace:
I20260709 12:24:25.019470  1510 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:25.022588  1412 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:25.023149  1593 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.978962  1529 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:25.083171 31539 rpcz_store.cc:276] 0709 12:24:23.711057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.811325 (+100268us) service_pool.cc:224] Handling call
0709 12:24:23.818362 (+  7037us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:23.824302 (+  5940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.824341 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:23.877158 (+ 52817us) log.cc:844] Serialized 539 byte log entry
0709 12:24:24.121831 (+244673us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:24.179609 (+ 57778us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.229386 (+ 49777us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.550374 (+320988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.550484 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.063973 (+513489us) raft_consensus.cc:1685] finished
0709 12:24:25.063994 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.064132 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":170913,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":31,"raft.queue_time_us":449908,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":12655,"thread_start_us":541060,"threads_started":3,"wal-append.queue_time_us":648768}
I20260709 12:24:25.021521  1267 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:25.090270  1508 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:25.052307  1541 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.130723 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.061796  1570 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:25.132510 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:25.143131 31389 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:25.019788  1463 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:25.020061  1095 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:25.027756  1465 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:25.055752  1434 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:25.059909  1511 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 12:24:25.127578  1603 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.187s
I20260709 12:24:25.070611  1523 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:25.302956 31508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.020s	sys 0.041s
W20260709 12:24:25.135970  1273 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.173s	user 0.018s	sys 0.006s
I20260709 12:24:25.214908 31541 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 6. Ops: []
W20260709 12:24:25.473259 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.474982 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:25.470510 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 491432us
W20260709 12:24:25.879873 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.880319 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:25.374670  1492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.011s	sys 0.016s
I20260709 12:24:25.880988  1527 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:25.819408 31433 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.007s	sys 0.029s
I20260709 12:24:25.861577  1529 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:25.882848 31433 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.008s	sys 0.030s
W20260709 12:24:25.883304 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 835049us
I20260709 12:24:25.566114 31388 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:25.885030  1569 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:25.325876 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 375428us
W20260709 12:24:25.548727 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 500578us
I20260709 12:24:25.885762  1569 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:25.886229 31507 leader_election.cc:336] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.155s (SENT)
I20260709 12:24:25.886263  1541 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:25.887123 31507 leader_election.cc:336] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.836s (SENT)
W20260709 12:24:25.808777 31466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.016s	sys 0.043s
W20260709 12:24:25.887663 31466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.023s	sys 0.045s
I20260709 12:24:25.887564 31507 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:25.857345  1605 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.711s	user 0.001s	sys 0.001s
W20260709 12:24:25.179414 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 213393us
I20260709 12:24:25.201818  1610 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.889118 31359 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:25.888127  1569 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:25.672223  1601 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.613s	user 0.000s	sys 0.001s
I20260709 12:24:25.891028  1611 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.891180 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:25.892639 31359 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:25.363826 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.262908  1301 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:25.894136 31359 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:25.145257  1609 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.763s
I20260709 12:24:25.127626  1506 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:25.408478  1267 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:25.477087  1399 consensus_meta.cc:287] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.403s	user 0.011s	sys 0.013s
I20260709 12:24:25.897049  1570 raft_consensus.cc:697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:25.897218  1506 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:25.897651 31508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.024s	sys 0.051s
W20260709 12:24:25.274449  1315 consensus_meta.cc:287] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.168s	user 0.012s	sys 0.000s
I20260709 12:24:25.898458  1315 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:25.898917  1315 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:25.898314  1569 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:25.132189 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:25.304910  1481 consensus_meta.cc:287] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.421s	user 0.020s	sys 0.005s
I20260709 12:24:25.899508 31539 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:25.144786  1593 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:25.900161 31392 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:24:25.026654  1524 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:25.900692  1529 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:25.901508  1611 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:25.902644 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:25.941284 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:25.896545  1609 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:25.388111  1592 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:25.614969 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.903884 31434 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:25.923983 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:25.928738 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.933827 31392 pending_rounds.cc:85] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 7
I20260709 12:24:25.946269 31392 pending_rounds.cc:107] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:24:25.946539 31392 raft_consensus.cc:2889] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:25.422359  1613 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:25.896554  1267 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.936794  1506 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.936877 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:25.675889  1208 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:25.263509  1598 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:24:25.942965 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1639) took 1835 ms. Trace:
I20260709 12:24:25.971350 31393 rpcz_store.cc:276] 0709 12:24:24.107622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.107735 (+   113us) service_pool.cc:224] Handling call
0709 12:24:24.124285 (+ 16550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:24.124624 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:24.405734 (+281110us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.674775 (+269041us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:24.678048 (+  3273us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.678184 (+   136us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:24.678218 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.678284 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.942733 (+1264449us) raft_consensus.cc:1685] finished
0709 12:24:25.942754 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.942905 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":217035,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":155474,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":9869,"thread_start_us":356310,"threads_started":2,"wal-append.queue_time_us":473770}
I20260709 12:24:25.975492 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:25.976657 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:25.977336 31540 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:25.980921 32079 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:24:25.943502 31465 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.015s	sys 0.005s
I20260709 12:24:25.903215  1603 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:25.948279 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:25.947072  1450 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.987286 31465 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.015s	sys 0.005s
I20260709 12:24:25.949350  1412 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:25.935330 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:25.524911  1478 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:25.950515 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:26.000548 31461 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
W20260709 12:24:25.946885 31433 connection.cc:256] RPC call timeout handler was delayed by -1.1503254489998653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 12:24:26.001628 31433 connection.cc:256] RPC call timeout handler was delayed by -1.1204801750000115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33330000000000004s for a response
I20260709 12:24:25.929919  1315 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.952677 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:26.003809 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:26.004523 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:25.987272 32079 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:24:25.897253  1399 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:25.995296 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:25.949050 32050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.016s
I20260709 12:24:25.958654  1579 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:25.954169  1580 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.997080 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:25.997999 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.026293 31393 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:25.926402  1273 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.000833 31394 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:26.027895 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.028268 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:25.950598 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:25.949635 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:25.959982  1529 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.939088  1481 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.036893 31395 raft_consensus.cc:2393] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:26.037658  1481 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.040940 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.044287 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.044835 31389 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:26.045709 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.046371 31389 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:26.049197  1610 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:26.049942 31387 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:26.046984 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:26.051479  1383 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.328s	user 0.006s	sys 0.006s
I20260709 12:24:26.052067  1383 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.052667  1383 consensus_queue.cc:1243] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer 503bef451a2b424fa35e8e46b8c06f29 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:24:25.970539  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.012s	sys 0.008s
W20260709 12:24:26.053905  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.013s	sys 0.008s
I20260709 12:24:26.054167  1508 raft_consensus.cc:697] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:25.961090  1609 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:26.055012  1508 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.055864  1609 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.023300 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:26.023754 31433 leader_election.cc:336] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.546s (SENT)
W20260709 12:24:26.059604 31433 leader_election.cc:336] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.564s (SENT)
I20260709 12:24:26.062075 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 376) took 1814 ms. Trace:
I20260709 12:24:26.062806  1569 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.064175  1569 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:26.065786  1569 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:26.059187 31544 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.028592 31394 raft_consensus.cc:2393] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 3: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:26.071473  1624 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:26.072208  1624 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.072597 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:26.074117 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.074853  1624 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:26.029630 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.035341  1618 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.035406  1529 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:26.041448  1528 consensus_meta.cc:287] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.949s	user 0.008s	sys 0.014s
I20260709 12:24:26.004601 32081 raft_consensus.cc:2376] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8. Re-sending same reply.
I20260709 12:24:26.051625 31389 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.177871 32083 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:26.062477 31388 rpcz_store.cc:276] 0709 12:24:24.248018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.418370 (+170352us) service_pool.cc:224] Handling call
0709 12:24:24.418717 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.884534 (+1465817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.061804 (+177270us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001a1dd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:26.062010 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2638131072}
W20260709 12:24:26.079668  1612 log.cc:927] Time spent T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 12:24:26.081522  1580 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.082191 31544 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:26.066988  1569 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:24:26.082924 31467 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:26.084029  1273 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.085134  1541 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:26.086025 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.087971 31535 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:26.088614  1524 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:25.983299  1506 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.090307  1593 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:26.091420  1434 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:26.092111  1465 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.092717  1463 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.096622  1399 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:26.097615 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 274) took 2200 ms. Trace:
I20260709 12:24:26.008108  1450 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.003309  1613 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:26.021574 32050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.000s	sys 0.016s
I20260709 12:24:26.021317  1570 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.105772 32076 raft_consensus.cc:2368] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
I20260709 12:24:26.109247  1579 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.109856 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 373) took 2369 ms. Trace:
I20260709 12:24:25.960893  1592 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:26.113305  1490 consensus_meta.cc:287] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.930s	user 0.014s	sys 0.009s
I20260709 12:24:26.114038  1492 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:26.007406  1615 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.025265  1412 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.115386  1208 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.115942 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 285) took 3803 ms. Trace:
I20260709 12:24:26.227969 31470 rpcz_store.cc:276] 0709 12:24:22.312350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.063578 (+751228us) service_pool.cc:224] Handling call
0709 12:24:23.070400 (+  6822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.049819 (+1979419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.115631 (+1065812us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400019d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:26.115862 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4445987584}
I20260709 12:24:26.118927 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1690) took 1108 ms. Trace:
I20260709 12:24:26.119062 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:26.119638 31436 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:26.230479 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 115312us
I20260709 12:24:26.153195 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:26.154196 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 109140us
I20260709 12:24:26.231794  1434 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:26.232316  1434 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.232717  1434 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.232892 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:26.234133 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:26.169904 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.235154 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:26.235560 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.235728 31461 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
W20260709 12:24:26.170857 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 276761us
I20260709 12:24:26.236375 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:26.236610 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:26.237068 31359 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:26.237401 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:26.237696 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:26.237952 31462 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:26.238348  1524 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.238811 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:26.179797 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.182227 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:26.240353 31461 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:26.240628 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.240765 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:26.189523 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:26.241458 32084 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.241765 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.242373  1434 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.242832 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:26.140916  1489 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.789s	user 0.008s	sys 0.001s
W20260709 12:24:26.120517  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.036s	sys 0.052s
I20260709 12:24:26.198796 31394 raft_consensus.cc:2410] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:26.202976 31536 rpcz_store.cc:276] 0709 12:24:23.897147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.899827 (+  2680us) service_pool.cc:224] Handling call
0709 12:24:23.900214 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.900685 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:24.232628 (+331943us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.601044 (+368416us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:24.638933 (+ 37889us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.639137 (+   204us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:24.639175 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.639270 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:26.097404 (+1458134us) raft_consensus.cc:1685] finished
0709 12:24:26.097426 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.097557 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13197,"prepare.queue_time_us":432956,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":15631,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":35562,"thread_start_us":514551,"threads_started":2,"wal-append.queue_time_us":775237}
I20260709 12:24:26.264990 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:26.266062 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:26.103623 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:26.176949  1460 consensus_meta.cc:287] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.100s	user 0.012s	sys 0.000s
I20260709 12:24:26.207840 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:26.270641 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:26.209965 31389 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:26.199093  1301 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.271860 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.272833 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.273319 31389 raft_consensus.cc:2376] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6. Re-sending same reply.
I20260709 12:24:26.274009 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:26.180497  1481 consensus_queue.cc:1059] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:26.220646 31392 rpcz_store.cc:276] 0709 12:24:23.740745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.740841 (+    96us) service_pool.cc:224] Handling call
0709 12:24:23.741100 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.946940 (+2205840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.109559 (+162619us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54002e1dd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:26.109788 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4964579584}
I20260709 12:24:26.275271 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:26.225392 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1692) took 1212 ms. Trace:
I20260709 12:24:26.276007 31544 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:26.276813 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:26.237771  1593 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.239429  1610 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:25.988422  1603 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:25.999923  1095 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.246199 31462 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:26.246675 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.247725 32048 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:26.263856  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.036s	sys 0.052s
I20260709 12:24:26.249629  1625 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.251161 31470 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 7. Ops: [5.7-5.7]
W20260709 12:24:26.251680 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 347832us
I20260709 12:24:26.229094 31466 rpcz_store.cc:276] 0709 12:24:25.010487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.021626 (+ 11139us) service_pool.cc:224] Handling call
0709 12:24:25.058021 (+ 36395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:25.058287 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:25.058324 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:25.058914 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:24:25.888047 (+829133us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:25.888083 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.888140 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:26.118748 (+230608us) raft_consensus.cc:1685] finished
0709 12:24:26.118768 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.118876 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":741929,"threads_started":1,"wal-append.queue_time_us":1014641}
I20260709 12:24:26.255470 32084 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:26.311988 31434 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:26.257985 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 325742us
I20260709 12:24:26.314317 31434 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:26.205739  1624 consensus_queue.cc:1059] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:24:26.319511 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:26.320241 31470 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:26.323092 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:26.266373 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:26.268077 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.209236 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.275440 31392 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:26.188867  1528 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.276257 31465 rpcz_store.cc:276] 0709 12:24:25.013489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.013618 (+   129us) service_pool.cc:224] Handling call
0709 12:24:25.013971 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.014224 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:25.991632 (+977408us) log.cc:844] Serialized 14 byte log entry
0709 12:24:26.225003 (+233371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:26.225071 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:26.225132 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.225216 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.225332 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1011166,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":92,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":1206411,"threads_started":2}
I20260709 12:24:26.278540 31394 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:24:26.280179 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:26.284924 31544 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:26.227907  1628 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:26.315541 31434 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:26.307575 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 59923.8us
I20260709 12:24:26.343966 31394 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.2-6.2]
I20260709 12:24:26.344086 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:26.262406 32079 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:26.226959  1490 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.244546  1412 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.250388  1208 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.329447 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:26.270823  1463 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:26.345140 31359 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:26.346079 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.346570 31390 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.308754  1603 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.348767 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.297681 32075 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:26.230865  1492 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.318894  1267 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:26.218475  1613 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.320188  1618 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.371681 31392 raft_consensus.cc:1240] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:26.312464  1510 raft_consensus.cc:697] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:26.364540 32048 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:26.283983  1301 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:26.328656 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 266171us
W20260709 12:24:26.331444 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.131s	user 0.005s	sys 0.012s
W20260709 12:24:26.406949 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.006s	sys 0.013s
W20260709 12:24:26.407652 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 1.35686e+06us
I20260709 12:24:26.408519 31510 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:26.349558  1516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.002s	sys 0.016s
I20260709 12:24:26.343158  1609 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:26.410760  1516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.003s	sys 0.016s
I20260709 12:24:26.410953  1609 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:26.411806 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.392227 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:26.389850 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:26.297737  1399 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:24:26.413785 31388 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:24:26.395416 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 79955.5us
I20260709 12:24:26.415001 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:26.385633 31390 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:26.416954 31390 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:26.348001  1511 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.419256  1511 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.421736  1511 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.305644  1593 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.425144  1593 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.426313 31394 raft_consensus.cc:2410] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:26.230743  1615 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.428179 31389 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.358471  1460 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:26.442015 31389 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:26.405382 32048 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:26.450065 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 44779.1us
I20260709 12:24:26.406536 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:26.412473  1516 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.354558  1634 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:26.361517 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:26.361332  1611 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.476995  1611 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:26.477550  1611 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.361744  1434 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.474750 32080 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.389093  1626 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.328765  1625 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.371182  1463 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.447415  1460 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:26.475080  1267 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.496925  1590 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:26.474169  1634 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.447750  1383 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 12:24:26.645352 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 235494us
W20260709 12:24:26.611558 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.613150 32080 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:26.499668  1643 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.508587  1529 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:26.542685  1460 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.355041  1628 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.570083  1634 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.653352  1643 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:26.655169  1590 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:26.660351  1540 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.703977 31390 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:26.670735  1576 consensus_meta.cc:287] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.730s	user 0.004s	sys 0.009s
W20260709 12:24:26.707270 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.709069 31510 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:26.707899 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 257034us
I20260709 12:24:26.713439 31390 pending_rounds.cc:85] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 6
I20260709 12:24:26.714334 31390 pending_rounds.cc:107] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:26.714650 31390 raft_consensus.cc:2889] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:26.724319  1580 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.726163  1615 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.727191  1615 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:26.727402 31507 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.633s (SENT)
I20260709 12:24:26.727679  1615 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:26.728169  1615 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.730062  1592 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:26.708362  1629 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.762151  1492 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:26.763185  1613 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:26.769810  1649 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:24:26.769347  1590 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:26.785445 31544 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:26.787140 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 73219us
W20260709 12:24:26.770649  1638 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:24:26.771440  1609 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.771318 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:26.771600  1635 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 12:24:26.705876  1643 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.777186 31436 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:26.712875  1506 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:26.773502 32077 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.007s	sys 0.002s
I20260709 12:24:26.674763  1489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49886 (request call id 443) took 5146 ms. Trace:
W20260709 12:24:26.770530  1648 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:24:26.659255  1510 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.777904 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:26.772258  1208 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:26.791728  1651 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:24:26.721568  1576 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:26.787767  1641 log.cc:927] Time spent T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:24:26.782568  1528 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:26.782104 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:26.821754 31466 raft_consensus.cc:2393] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:26.997941 31391 raft_consensus.cc:2393] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:27.004660 31463 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:27.005236 31510 leader_election.cc:400] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3.
I20260709 12:24:27.005784 31510 leader_election.cc:403] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.006753 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:26.981000 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 381) took 1901 ms. Trace:
I20260709 12:24:26.982690 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 382) took 1902 ms. Trace:
I20260709 12:24:26.984834 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1687) took 1032 ms. Trace:
I20260709 12:24:26.986034 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:26.990281 31395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 370) took 3250 ms (client timeout 1606 ms). Trace:
I20260709 12:24:26.832253 31540 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:26.865417 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:27.026208 32075 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:26.822271 32077 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.009s	sys 0.008s
I20260709 12:24:26.860008 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:26.880256 32080 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:27.034262  1465 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.870198 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:26.864954 32082 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:26.882417 32083 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:26.889587  1301 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:27.048184 32076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 469) took 2234 ms (client timeout 1656 ms). Trace:
W20260709 12:24:27.048697 32076 rpcz_store.cc:269] 0709 12:24:24.813879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.929471 (+115592us) service_pool.cc:224] Handling call
0709 12:24:27.047736 (+2118265us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540040fe54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:27.047983 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331287808}
I20260709 12:24:27.051064  1506 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.051875  1506 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:26.864558  1315 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.003s
I20260709 12:24:27.053992  1315 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:26.802582  1412 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:26.878165  1450 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.886612  1460 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:27.058982 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.057186 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1572) took 3962 ms. Trace:
I20260709 12:24:27.059453 31541 rpcz_store.cc:276] 0709 12:24:23.094178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.097427 (+  3249us) service_pool.cc:224] Handling call
0709 12:24:24.183219 (+1085792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.884003 (+1700784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.223727 (+339724us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540039fb54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:27.056004 (+832277us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540039fb50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:27.056285 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4750098560}
I20260709 12:24:27.061038  1460 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:27.061553 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:26.836730  1463 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:26.992786 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1685) took 1040 ms. Trace:
W20260709 12:24:26.959331 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.012637 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:27.062790 31392 rpcz_store.cc:276] 0709 12:24:25.951788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.361737 (+409949us) service_pool.cc:224] Handling call
0709 12:24:26.362125 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.404010 (+ 41885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.992230 (+588220us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b5400231754. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:26.992595 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21386496}
I20260709 12:24:27.063736 31394 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:27.064219 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 295) took 1156 ms. Trace:
I20260709 12:24:27.064666 31467 rpcz_store.cc:276] 0709 12:24:25.907485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.907607 (+   122us) service_pool.cc:224] Handling call
0709 12:24:27.063775 (+1156168us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400271d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:27.064012 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279858432}
I20260709 12:24:27.013504  1095 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.816817  1489 rpcz_store.cc:276] 0709 12:24:21.528608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.528756 (+   148us) service_pool.cc:224] Handling call
0709 12:24:21.953186 (+424430us) ts_tablet_manager.cc:934] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
0709 12:24:23.050209 (+1097023us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:25.246085 (+2195876us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:25.246232 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:26.306042 (+1059810us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:26.370677 (+ 64635us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:26.536856 (+166179us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:26.540196 (+  3340us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":69004,"tablet-copy.queue_time_us":231587,"thread_start_us":367596,"threads_started":2}
I20260709 12:24:26.800696  1490 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:27.012656 32047 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:27.014710 31389 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:27.008911 31388 rpcz_store.cc:276] 0709 12:24:25.952333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.414515 (+462182us) service_pool.cc:224] Handling call
0709 12:24:26.414802 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.687448 (+272646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.687485 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.708181 (+ 20696us) log.cc:844] Serialized 26 byte log entry
0709 12:24:26.983898 (+275717us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:26.984031 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.984216 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:26.984315 (+    99us) raft_consensus.cc:1685] finished
0709 12:24:26.984340 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.984574 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19621,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":483037,"threads_started":2,"wal-append.queue_time_us":135099}
I20260709 12:24:27.008508 31386 rpcz_store.cc:276] 0709 12:24:25.079883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.080016 (+   133us) service_pool.cc:224] Handling call
0709 12:24:25.080288 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.952656 (+872368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:25.952687 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:25.952730 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:25.952768 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.980287 (+1027519us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b540028d054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:26.980396 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.980749 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005820672}
I20260709 12:24:27.019354 31510 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:26.873044  1516 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.885401  1541 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:27.034262 31535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1575) took 3938 ms (client timeout 1505 ms). Trace:
I20260709 12:24:27.124437  1489 tablet_copy_client.cc:806] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:26.875649  1561 raft_consensus.cc:3055] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:27.020841 31395 rpcz_store.cc:269] 0709 12:24:23.739990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.751589 (+ 11599us) service_pool.cc:224] Handling call
0709 12:24:26.989772 (+3238183us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b5400094cd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:26.990030 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5240801536}
I20260709 12:24:27.128845  1561 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:27.008761 31387 rpcz_store.cc:276] 0709 12:24:25.080181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.080865 (+   684us) service_pool.cc:224] Handling call
0709 12:24:25.471751 (+390886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.050317 (+578566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.982202 (+931885us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b540028c154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:26.982513 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329268480}
I20260709 12:24:27.130925  1671 consensus_queue.cc:1059] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:26.848896  1576 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.125370  1489 tablet_copy_client.cc:670] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:27.120379 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1596) took 3824 ms. Trace:
I20260709 12:24:27.132452  1273 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:27.133407  1273 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.132838 31537 rpcz_store.cc:276] 0709 12:24:23.283373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.808506 (+525133us) service_pool.cc:224] Handling call
0709 12:24:27.057902 (+3249396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.058647 (+   745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.058678 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:27.058729 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:27.058780 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.058885 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.102971 (+ 44086us) spinlock_profiling.cc:243] Waited 3.23 s on lock 0x7b540021e650. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:27.107158 (+  4187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3580,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":213,"spinlock_wait_cycles":7426843008}
W20260709 12:24:26.918763  1597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.000s	sys 0.004s
W20260709 12:24:27.135738  1597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.001s	sys 0.005s
I20260709 12:24:27.138330  1431 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:26.902247  1604 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 1.582s	user 0.012s	sys 0.000s
W20260709 12:24:27.139204 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 127065us
I20260709 12:24:26.886204  1603 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.140444 31542 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:27.140234  1463 consensus_queue.cc:1059] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:27.141758  1434 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:26.876971  1617 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.988s	user 0.005s	sys 0.008s
I20260709 12:24:27.142493  1603 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:27.142625  1434 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:26.837996  1625 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:26.901897  1615 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:26.855415  1628 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:26.902201  1634 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.176440 31544 raft_consensus.cc:1240] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.903517  1643 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.179252 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 281) took 1002 ms. Trace:
W20260709 12:24:26.834064  1654 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:24:27.091096 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.180956 32047 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:27.179764 31539 rpcz_store.cc:276] 0709 12:24:26.176639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.179799 (+  3160us) service_pool.cc:224] Handling call
0709 12:24:26.190510 (+ 10711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.427600 (+237090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.427645 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.428256 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 12:24:26.511975 (+ 83719us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:26.512025 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.118829 (+606804us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400208fd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:27.121909 (+  3080us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.150795 (+ 28886us) raft_consensus.cc:1685] finished
0709 12:24:27.150812 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.178996 (+ 28184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22799,"raft.queue_time_us":82786,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":115290,"spinlock_wait_cycles":544176384,"thread_start_us":83292,"threads_started":1,"wal-append.queue_time_us":338981}
I20260709 12:24:27.125136  1541 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.094909  1095 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:27.104990 32082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 495) took 2100 ms (client timeout 1877 ms). Trace:
I20260709 12:24:27.185822  1615 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:27.108366 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.000s	sys 0.011s
W20260709 12:24:27.186838 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.000s	sys 0.012s
I20260709 12:24:27.186461  1661 consensus_queue.cc:1059] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:27.188432 31361 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.189086  1492 raft_consensus.cc:3055] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:27.189587  1492 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:27.190263 31464 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:27.190440 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.108475  1315 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.111053 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1683) took 1161 ms. Trace:
I20260709 12:24:27.122808  1639 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.192965  1095 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.191754 31393 rpcz_store.cc:276] 0709 12:24:25.949120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.329164 (+380044us) service_pool.cc:224] Handling call
0709 12:24:26.353991 (+ 24827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.679191 (+325200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.679247 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.690317 (+ 11070us) log.cc:844] Serialized 26 byte log entry
0709 12:24:26.811819 (+121502us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:27.080961 (+269142us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.109324 (+ 28363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.110266 (+   942us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b5400404054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:27.110323 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.110438 (+   115us) raft_consensus.cc:1685] finished
0709 12:24:27.110567 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.110814 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15123,"prepare.queue_time_us":244495,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":14301,"raft.queue_time_us":58827,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":7614,"spinlock_wait_cycles":111714560,"thread_start_us":373059,"threads_started":3,"wal-append.queue_time_us":158818}
I20260709 12:24:27.179785  1570 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.107991  1506 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:27.123410 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 104456us
I20260709 12:24:27.195274  1561 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.197014  1561 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:27.197356 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.850984  1579 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:27.132179  1208 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.141815  1523 raft_consensus.cc:3055] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:27.197948  1603 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.198366  1523 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:27.185475 32082 rpcz_store.cc:269] 0709 12:24:25.004606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.005842 (+  1236us) service_pool.cc:224] Handling call
0709 12:24:27.104502 (+2098660us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400530cd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:27.104761 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4101645056}
I20260709 12:24:26.872041  1620 raft_consensus.cc:3055] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:27.199803  1570 raft_consensus.cc:697] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:27.200234  1620 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:27.201107 32077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 471) took 1084 ms. Trace:
I20260709 12:24:27.201362  1570 consensus_queue.cc:237] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:27.145694 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.204794 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.205750  1653 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:27.201592 32077 rpcz_store.cc:276] 0709 12:24:26.116361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.117821 (+  1460us) service_pool.cc:224] Handling call
0709 12:24:26.118176 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.118386 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:27.028179 (+909793us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.113707 (+ 85528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:27.122014 (+  8307us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:27.152606 (+ 30592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.200613 (+ 48007us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.200906 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":759735,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":44,"raft.queue_time_us":24541,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":9319,"spinlock_wait_cycles":44668288,"thread_start_us":963796,"threads_started":2,"wal-append.queue_time_us":95442}
W20260709 12:24:27.123555 31391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1653) took 2357 ms (client timeout 2205 ms). Trace:
W20260709 12:24:27.207623 31391 rpcz_store.cc:269] 0709 12:24:24.766301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.961187 (+194886us) service_pool.cc:224] Handling call
0709 12:24:27.113799 (+2152612us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400231c54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:27.123470 (+  9671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4661697792}
W20260709 12:24:27.124861 31535 rpcz_store.cc:269] 0709 12:24:23.095172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.097707 (+  2535us) service_pool.cc:224] Handling call
0709 12:24:27.033731 (+3936024us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b540021e654. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:27.033969 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6667215104}
I20260709 12:24:27.208485  1579 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:27.210875  1434 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.167681 31390 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:27.168227 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:27.186538  1407 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:27.213097  1407 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:27.213088  1625 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:27.213676  1407 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.214339  1625 raft_consensus.cc:3055] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:27.190964  1492 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.214748  1625 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:27.123404  1450 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:27.215780  1450 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.216004  1625 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:27.216450  1478 consensus_queue.cc:1175] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "503bef451a2b424fa35e8e46b8c06f29" responder_term: 5 status { last_received { term: 4 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:27.219192 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:27.220403 32082 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:27.221318  1683 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.097s	user 0.004s	sys 0.000s
I20260709 12:24:27.224445  1634 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.225108  1541 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.218214  1625 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.206596  1653 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.228127 31510 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:27.229339  1506 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.230567  1653 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:27.232659  1273 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.234418 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:27.201587 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.236138 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:27.236660  1643 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.236994 31538 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:27.197269  1628 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:26.859412  1611 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.237972  1653 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:27.238479  1653 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.778843  1629 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.202736  1540 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.199847  1523 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.139575  1576 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:24:27.238400 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:27.201521  1620 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.245306 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:27.247216  1620 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.249802  1611 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:27.215794  1492 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:27.265810 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 65172.6us
I20260709 12:24:27.242940  1653 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.271428 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1630) took 1350 ms. Trace:
I20260709 12:24:27.255865  1450 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:27.271878 31542 rpcz_store.cc:276] 0709 12:24:25.919708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.919919 (+   211us) service_pool.cc:224] Handling call
0709 12:24:25.920294 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.141011 (+1220717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.267851 (+126840us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540039ec54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:27.269861 (+  2010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804745088}
I20260709 12:24:27.278383 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 390) took 1099 ms. Trace:
I20260709 12:24:27.288918 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:27.295195 31538 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.298218  1523 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.284924 31390 rpcz_store.cc:276] 0709 12:24:26.179171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.013131 (+833960us) service_pool.cc:224] Handling call
0709 12:24:27.013665 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.212536 (+198871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.276683 (+ 64147us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002e22d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:27.278321 (+  1638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299347840}
W20260709 12:24:27.314052 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 502331us
I20260709 12:24:27.314644 31392 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:27.316339 31436 leader_election.cc:400] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
I20260709 12:24:27.316689 31436 leader_election.cc:403] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.316826 31391 raft_consensus.cc:1240] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:27.318226  1407 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.319343 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1546) took 1039 ms. Trace:
I20260709 12:24:27.320412  1629 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:27.326207 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:27.338590 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 923407us
I20260709 12:24:27.319356  1643 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.342041  1431 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.345448 31538 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:27.351868  1687 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:27.355532 31539 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.363334  1465 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3.
I20260709 12:24:27.372953  1399 consensus_queue.cc:1059] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:27.373953  1399 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:27.375532  1592 raft_consensus.cc:3055] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:27.375980  1592 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:27.376466 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:27.376572 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:27.377303 32082 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.388125 31537 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:27.389338 31434 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.390298  1634 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.391606 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:27.388116 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:27.392215 31391 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.392889 31544 raft_consensus.cc:2410] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:27.376852  1592 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.395776  1592 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.390969 31434 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:27.355535 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 948895us
I20260709 12:24:27.276062  1540 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.411170 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.382230  1407 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:27.319748 31461 rpcz_store.cc:276] 0709 12:24:26.234893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.241201 (+  6308us) service_pool.cc:224] Handling call
0709 12:24:26.241480 (+   279us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:26.241818 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.241851 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:26.242437 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 12:24:26.350020 (+107583us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:26.406531 (+ 56511us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.065386 (+658855us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b180018af60. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e149c0a 00007f6e97889219 00007f6e8e1d1a40 00007f6e8e1cc4e4 00007f6e8e1cc455 00007f6e912b4060 00007f6e912c6716 00007f6e912d7287 00007f6e912d7208
0709 12:24:27.149733 (+ 84347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.159856 (+ 10123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.244833 (+ 84977us) raft_consensus.cc:1685] finished
0709 12:24:27.261636 (+ 16803us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.274567 (+ 12931us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41218,"prepare.queue_time_us":91073,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":23298,"raft.queue_time_us":728096,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":14258,"spinlock_wait_cycles":3792256,"thread_start_us":128474,"threads_started":2,"wal-append.queue_time_us":521541}
I20260709 12:24:27.437294 31539 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:27.442097 31544 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:27.440580 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 49737.7us
I20260709 12:24:27.449085 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:27.450959 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.414971  1431 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:24:27.417342  1475 consensus_queue.cc:1059] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:24:27.450044 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:27.439210  1576 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:27.466689 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1648) took 1071 ms. Trace:
I20260709 12:24:27.490692 31537 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.499843  1643 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
W20260709 12:24:27.499722 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 210543us
I20260709 12:24:27.501180 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.502188  1523 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.504491  1690 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:27.505223  1690 raft_consensus.cc:697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:27.467149 31540 rpcz_store.cc:276] 0709 12:24:26.273071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.023022 (+749951us) service_pool.cc:224] Handling call
0709 12:24:27.023933 (+   911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.039320 (+ 15387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.039366 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.057044 (+ 17678us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.241270 (+184226us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:27.241369 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.241504 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.344239 (+102735us) raft_consensus.cc:1685] finished
0709 12:24:27.344259 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.344391 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25746,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":274,"thread_start_us":135277,"threads_started":1,"wal-append.queue_time_us":218927}
I20260709 12:24:27.512717  1668 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:27.513500  1668 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:27.522508 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 55949.3us
W20260709 12:24:27.524326 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 252106us
W20260709 12:24:27.528016 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.503006 31361 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.521742  1570 raft_consensus.cc:3055] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:27.545504 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:27.546171 31466 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:24:27.546825  1691 log.cc:927] Time spent T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:24:27.546218 31465 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.535109 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:27.554744 31434 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:27.561376 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.540637  1570 raft_consensus.cc:740] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:27.563311 31463 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.564973 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:27.572598 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 69823.1us
I20260709 12:24:27.506652  1690 consensus_queue.cc:237] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.575058  1620 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:27.588079 31466 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.596029 31361 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.584157  1629 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:27.589587  1620 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.602784  1620 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.629765  1523 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.631109 31433 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:27.632483 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 99410.7us
I20260709 12:24:27.633703 31391 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:27.637616 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:27.638556 31470 raft_consensus.cc:2368] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9.
I20260709 12:24:27.639597 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:27.640878 31541 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:27.642429 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:27.643344 31543 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:27.643870 31540 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:27.638996 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:27.644649 31538 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.645125 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:27.647410  1540 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.647621 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:27.648547 31544 raft_consensus.cc:2410] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:24:27.648689  1695 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:27.655107 31538 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
W20260709 12:24:27.656472 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 75228.2us
I20260709 12:24:27.658849 31361 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.660100  1671 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:27.661176  1611 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.661235  1671 raft_consensus.cc:3055] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:27.661665  1671 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:27.664211 32047 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:27.664803 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.670305 31465 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:27.670979 31538 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:27.671980 32082 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:27.672530 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:27.673416 31537 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
W20260709 12:24:27.675415  1697 log.cc:927] Time spent T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:24:27.676198 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:27.676738  1694 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:24:27.676903 31544 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:27.678596  1668 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:27.679005 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.679562 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.680224 31468 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:27.680814 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:27.681001 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.681632 31469 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.681679 31468 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:27.690371 31463 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:27.692135 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:27.693148 31507 leader_election.cc:336] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.737s (SENT)
I20260709 12:24:27.693681 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:27.693284 31462 raft_consensus.cc:2410] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:27.697409 31466 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:27.696556 31434 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.699560 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.700289 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.701879 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.710731 31391 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:24:27.711925 31392 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:27.711856 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:27.713840 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.687703  1540 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:27.689337  1576 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:27.720439 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 89468.1us
I20260709 12:24:27.717635 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:27.720206 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.631841  1629 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.657088  1653 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.695806  1634 raft_consensus.cc:2764] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:24:27.725967 32047 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:27.662810  1671 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.734198 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:27.734843 31465 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:27.737926 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.719995  1643 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.737762 31463 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:27.741569 31470 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:27.746591  1653 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.747325  1685 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.752233 31433 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.753350 31469 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:27.753547 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:27.754113  1273 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:27.744444 31507 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.800s (SENT)
I20260709 12:24:27.755359  1434 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.756418 31468 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:27.762171 31465 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:27.763382 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.726126  1478 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:27.754851 31433 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:27.720854  1668 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.785377  1671 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.790278  1590 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:27.790899  1590 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.791365  1590 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.737787  1540 raft_consensus.cc:697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:27.795740 31462 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:27.743150 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:27.798696 31359 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:27.803926 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 132218us
W20260709 12:24:27.802934 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 71819.2us
I20260709 12:24:27.722961  1570 consensus_queue.cc:260] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.812420 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:27.815965  1686 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:27.773278  1478 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:27.794800  1450 consensus_queue.cc:1059] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:24:27.828631  1450 raft_consensus.cc:3055] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:27.829003  1450 raft_consensus.cc:740] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:27.830021  1450 consensus_queue.cc:260] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.831382 32077 raft_consensus.cc:2393] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:27.831718  1643 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.834157  1685 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.825455 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.820600  1686 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:27.827422  1315 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:27.837946 31464 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:27.851907 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.853284 31436 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:27.838994  1686 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.838956  1315 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:27.860442 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.857542 31539 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:27.843369  1450 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.850881  1685 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:27.861581  1561 consensus_meta.cc:287] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 12:24:27.876173  1523 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.876768  1523 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:27.876015  1668 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:27.858155  1629 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:27.874504 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:27.878679 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 70648.2us
W20260709 12:24:27.880796 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 77001.1us
I20260709 12:24:27.868749  1315 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.870544  1478 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:27.881680  1634 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:27.903682 31359 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:27.909752 31510 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:27.874805  1540 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:27.911315  1625 consensus_meta.cc:287] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.002s
I20260709 12:24:27.898123  1653 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:24:27.933568 32048 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:27.932379 31542 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:27.909003  1634 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:27.914290  1506 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.919790  1523 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:27.937193 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 73346.5us
I20260709 12:24:27.930419 32077 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:27.939867 31433 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:27.946216  1620 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:27.961829 31510 leader_election.cc:400] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9.
I20260709 12:24:27.962205 31510 leader_election.cc:403] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.953521  1478 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:27.956565  1523 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:27.971935  1687 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.002367 31462 raft_consensus.cc:1240] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.982049 32048 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:28.003897  1661 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:28.004418  1661 raft_consensus.cc:697] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:28.005283  1592 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:28.005386  1661 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.005970  1399 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:28.008248 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:28.008508  1592 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.009084 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:28.009007  1592 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.009447 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:28.009992 32083 raft_consensus.cc:2410] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:28.010051 32081 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:27.973594  1561 consensus_queue.cc:1059] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:24:28.009024 32077 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:28.011189  1561 raft_consensus.cc:3055] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:28.011642  1561 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:27.979529  1668 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9.
I20260709 12:24:28.012626  1561 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.013952  1561 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.015664 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:28.019554 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:27.983845  1625 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:28.020711 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:28.014693 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:28.011189  1592 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:27.987411  1643 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:28.024537 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.026489 32076 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:28.027114 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:28.032500 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:28.033687 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.034590 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.034884 32077 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:27.992031 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.996632 31467 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:27.997088 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:27.997998 31470 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:27.998512 31463 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:27.998670  1465 consensus_queue.cc:1059] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.998524 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:27.999332  1579 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:27.999979  1629 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:28.019618 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:27.987813  1704 log.cc:927] Time spent T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:27.972532  1478 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:28.054265 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 97097.5us
I20260709 12:24:28.063544 31463 pending_rounds.cc:85] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 3
I20260709 12:24:28.075517 31538 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:28.083545 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:28.083565 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:28.081777 31463 pending_rounds.cc:107] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:24:28.085599 31463 raft_consensus.cc:2889] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:28.088004 32077 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:28.091885  1716 raft_consensus.cc:3055] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:28.092540  1716 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:28.093570  1716 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:28.096541 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 156831us
I20260709 12:24:28.082278  1478 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.103885 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:28.105082 31510 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:28.106156 31361 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:28.106415  1714 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:28.107076  1714 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.109335  1714 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:28.109808  1714 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:28.112154  1714 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.114065 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.114221  1717 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.115235 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.115001  1717 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.115513 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:28.116200 31463 raft_consensus.cc:2393] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:28.116374 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.117095 31464 raft_consensus.cc:2410] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:28.117172  1717 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:28.117741  1717 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:28.101944  1620 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:28.119056  1620 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:28.119427  1620 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.119752  1620 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.101159  1716 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.117182 31463 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:28.125747 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 128167us
I20260709 12:24:28.128429 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.118260 31464 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:24:28.118191  1717 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.131178 31464 pending_rounds.cc:85] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 4
I20260709 12:24:28.140635 31464 pending_rounds.cc:107] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:24:28.088145  1687 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.145256 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:28.142211 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.095589  1576 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.140935 31464 raft_consensus.cc:2889] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:28.096271  1523 raft_consensus.cc:697] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:28.114084  1714 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:28.146944 31466 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:28.147373 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:28.157264 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 253621us
W20260709 12:24:28.168311 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63306.5us
I20260709 12:24:28.132230 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:28.173352 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.175665 31359 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:28.149080  1465 raft_consensus.cc:3055] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:28.182986 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:28.184964 31359 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:28.087935  1634 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.186136  1465 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:28.196354  1465 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:28.267586 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 73104.8us
W20260709 12:24:28.258921 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 85532.9us
W20260709 12:24:28.258574 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 152493us
W20260709 12:24:28.268631 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.187004  1714 raft_consensus.cc:2764] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:28.202266  1579 raft_consensus.cc:3055] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:28.286657 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:28.288901  1713 consensus_queue.cc:1059] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:24:28.200428  1653 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:28.205005  1722 raft_consensus.cc:2764] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:28.297171 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:28.204792  1629 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:28.262540  1720 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:28.245704  1724 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:28.187366  1576 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.237411  1273 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.321930  1686 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.323909 31392 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:28.192296  1561 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:28.308377  1579 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:28.314963  1492 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.339494 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:28.357929 31391 raft_consensus.cc:2410] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:28.341457 32047 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:28.292052  1611 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:28.203912  1687 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.318449  1629 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:28.375443 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.366189 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:28.330509  1465 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:28.323588  1592 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:24:28.239326  1721 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:24:28.244024  1523 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:28.427623 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 125714us
W20260709 12:24:28.428085 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 62019.1us
I20260709 12:24:28.335502  1717 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:28.402330  1407 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:28.349638  1720 raft_consensus.cc:697] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:28.358523  1561 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.360743  1273 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.362679  1492 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.397540  1629 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.442303 31361 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:28.445765 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.435695  1729 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:28.439065  1407 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:28.361500  1724 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.458191  1723 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:28.458592  1699 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:24:28.471371 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 239048us
I20260709 12:24:28.459033  1399 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.449892  1653 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:28.452627  1717 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:28.471379  1407 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:28.497887  1273 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:28.498016  1720 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:28.501631  1315 consensus_meta.cc:287] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.001s
I20260709 12:24:28.502190  1315 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:28.507367 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 68518.5us
I20260709 12:24:28.484117  1729 raft_consensus.cc:697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:28.487820  1399 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.513830  1399 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:28.514513  1450 consensus_meta.cc:287] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.643s	user 0.002s	sys 0.007s
W20260709 12:24:28.520285 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.520725 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.522601 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:28.445678  1579 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.525936  1653 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.529368  1399 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:28.533291  1399 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.533646  1732 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:24:28.540593  1737 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:28.533653  1399 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:28.547703  1579 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:28.548169 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 224410us
I20260709 12:24:28.547616  1729 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.558084 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:28.558698  1724 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:28.558497  1723 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:28.568463 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:28.559161  1687 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:28.560477  1590 consensus_meta.cc:287] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.004s
W20260709 12:24:28.562419 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.570657 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.570884 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.571269  1730 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:28.578083 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.579201 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.579224 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:28.579979 31540 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:28.576260 31536 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:28.562455  1732 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:28.583624  1732 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.578637 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:28.593631 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 128643us
I20260709 12:24:28.593575 31543 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
W20260709 12:24:28.598011 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 71916.5us
W20260709 12:24:28.599064 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.598975 31541 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
W20260709 12:24:28.611204 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.612283 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 80933us
W20260709 12:24:28.612409 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 54414us
I20260709 12:24:28.619398 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.591823  1576 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:28.634088  1478 consensus_meta.cc:287] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.004s
I20260709 12:24:28.634506  1478 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.621659  1561 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:28.624406 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:28.635327  1733 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:28.636847  1732 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:28.655865 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.660143 31540 raft_consensus.cc:2368] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
W20260709 12:24:28.637204 31507 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.808s (SENT)
I20260709 12:24:28.637598  1315 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:28.637655  1620 consensus_meta.cc:287] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:24:28.608378  1492 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:28.641470 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.641681 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:28.585685  1590 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.648639 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.661636 31507 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:28.669059 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.669720 31538 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
W20260709 12:24:28.670565  1718 log.cc:927] Time spent T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.437s	user 0.002s	sys 0.000s
I20260709 12:24:28.670626 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:28.673187 31538 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.676134  1492 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.676741  1492 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.677372 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:28.677990 31390 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:28.678699 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:28.679260  1492 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:28.679864 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.683146  1590 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:28.684334  1506 raft_consensus.cc:3055] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:28.684762  1506 raft_consensus.cc:740] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:28.685503  1506 consensus_queue.cc:260] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.686758  1506 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:28.687691 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 46156.5us
W20260709 12:24:28.687835 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 50686.3us
I20260709 12:24:28.688794 31510 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:28.688814 31507 leader_election.cc:336] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.827s (SENT)
I20260709 12:24:28.689582 31507 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:28.622737 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 99219.2us
W20260709 12:24:28.699149 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 47267.9us
I20260709 12:24:28.703161 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:28.672060  1478 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:28.703759 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.715660 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:28.716596 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:28.719748 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:28.720331 31539 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.647907  1629 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.731482 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:28.697043  1716 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.767215 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:28.732275 31390 raft_consensus.cc:2376] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5. Re-sending same reply.
I20260709 12:24:28.701628  1730 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:28.697194  1732 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:28.775709 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:28.775781 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 60179.3us
I20260709 12:24:28.776170 31536 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:28.791203 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:28.672703  1620 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:28.674865  1399 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:28.773697 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 52792.7us
W20260709 12:24:29.437886 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.216100  1671 raft_consensus.cc:3055] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:29.439955  1671 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:28.916466 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.441035  1671 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.774313  1687 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.119585 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:29.065825 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.866025 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 290) took 1220 ms. Trace:
I20260709 12:24:29.443511 31542 rpcz_store.cc:276] 0709 12:24:27.638957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.639338 (+   381us) service_pool.cc:224] Handling call
0709 12:24:28.858779 (+1219441us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54003be054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:28.858899 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671793024}
W20260709 12:24:29.444082 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.867434  1629 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:29.444846 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:29.438390  1570 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.445786 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.446297 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.808949 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:29.450687 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:28.899544 31510 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:28.810099 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:29.451661 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 663632us
I20260709 12:24:28.989923 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:29.452195 31542 raft_consensus.cc:2410] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:24:29.446696  1506 consensus_meta.cc:287] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.760s	user 0.006s	sys 0.006s
I20260709 12:24:29.452948  1506 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:29.453099 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:29.453318 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:29.453469  1506 raft_consensus.cc:697] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:29.377183 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:28.798164  1717 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:29.454596 31537 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.215864 32083 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:29.454487  1506 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:28.952692 31538 raft_consensus.cc:2410] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:29.367981 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:29.446493 31387 raft_consensus.cc:2368] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7.
I20260709 12:24:29.456056 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:29.456202 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:29.456427 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:29.438987 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:29.457633 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.457829 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:29.112591  1690 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:29.458880 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:29.454082 31542 raft_consensus.cc:2410] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:29.046768 31539 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:29.459383  1629 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:29.116274 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:29.441992 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 753157us
I20260709 12:24:29.464437 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:29.445104 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:28.992786 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:29.441736 31389 raft_consensus.cc:2410] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:29.465898 31463 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:28.773798  1668 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:29.461148  1399 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:29.321899 31461 consensus_meta.cc:287] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.002s
W20260709 12:24:29.117718  1725 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.922s	user 0.003s	sys 0.006s
I20260709 12:24:29.252220  1450 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.451121 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:29.465371 31465 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:28.842482 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:29.486217 31469 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:29.486505 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:28.789337  1730 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.856995 31468 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:29.490022  1730 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.990895 31464 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:29.119204 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:29.218134  1579 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:29.448364  1620 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:29.498960 31542 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:29.459209  1690 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:29.467319  1687 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:29.473785 31359 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:28.988137 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:28.991806 31467 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:24:29.525585 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 51882.7us
I20260709 12:24:29.477202 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:29.233520  1407 consensus_meta.cc:287] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.000s
I20260709 12:24:29.479012 31461 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:29.477818 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:29.476763  1661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.004s	sys 0.011s
W20260709 12:24:29.482954 31507 leader_election.cc:336] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.828s (SENT)
I20260709 12:24:29.484107 31433 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:28.789179  1743 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:28.787623  1523 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:28.891353  1431 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.377329  1723 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.488339 31390 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.493331 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.494151 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:29.494972 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 233138us
I20260709 12:24:29.464051  1492 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.482344  1714 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.499347 31463 raft_consensus.cc:3055] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:29.470091 31537 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
W20260709 12:24:29.507444  1634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.017s	sys 0.016s
I20260709 12:24:29.496687  1450 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:29.531392  1661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.004s	sys 0.012s
I20260709 12:24:29.574175 31393 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:29.574949 31463 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:29.583518 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 100608us
W20260709 12:24:29.567809 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 115464us
I20260709 12:24:29.578352 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.557327  1653 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:29.584514 31394 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:29.580399 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.557529  1743 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:29.566708 32076 raft_consensus.cc:2410] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:24:29.514211  1579 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:29.587888 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:29.584514 31510 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:29.586402 31359 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:29.589066 31359 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:29.590173  1763 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:29.590785  1668 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:29.593271  1668 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:29.590785  1763 raft_consensus.cc:697] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:29.597070  1763 consensus_queue.cc:237] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:29.577109  1634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.018s	sys 0.016s
I20260709 12:24:29.604069 31543 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:29.644532 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1652) took 1012 ms. Trace:
I20260709 12:24:29.646057 31543 rpcz_store.cc:276] 0709 12:24:28.631762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.577638 (+945876us) service_pool.cc:224] Handling call
0709 12:24:29.602524 (+ 24886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.644259 (+ 41735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.644473 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.653662 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.654551 31389 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
W20260709 12:24:29.605587 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.880s (SENT) [suppressed 22 similar messages]
I20260709 12:24:29.644516 31463 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:29.557689  1407 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:29.662195 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.662813 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:29.671998 31394 raft_consensus.cc:2368] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7.
I20260709 12:24:29.574666  1620 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:29.585206  1653 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:29.677892 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.695331 31391 raft_consensus.cc:2393] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:29.567791  1431 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:29.588162  1743 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.604777  1717 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.582540  1492 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:29.644953  1735 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.701305 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:29.580219  1714 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:29.697966 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:29.722971 31391 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:29.707904 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:29.716264 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 235736us
I20260709 12:24:29.719588 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.731964 31433 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:29.732765 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 140831us
I20260709 12:24:29.582125  1523 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:29.581748  1723 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:29.697021  1653 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:29.734802 31392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.019s	sys 0.006s
W20260709 12:24:29.737813 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 132235us
W20260709 12:24:29.739964 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 97336.3us
W20260709 12:24:29.745329 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.755874 31466 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:29.767658 31392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.020s	sys 0.007s
I20260709 12:24:29.703384  1717 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:29.718863  1735 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:29.785873 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:29.785876 31395 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:29.788540 31389 raft_consensus.cc:2376] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7. Re-sending same reply.
I20260709 12:24:29.787098 31387 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:29.796073 31510 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:29.769553  1765 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:29.784044  1717 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.792675  1735 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.814109 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:29.813195 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:29.799044  1668 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.862432 31466 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
W20260709 12:24:29.875300 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 133436us
W20260709 12:24:29.893579 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 80483.8us
I20260709 12:24:29.906711 31389 raft_consensus.cc:2368] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 2. Current term is 3.
I20260709 12:24:29.815984  1762 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:29.911574 31507 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.005s (SENT)
I20260709 12:24:29.918079 31507 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:29.873907  1713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.011s	sys 0.032s
I20260709 12:24:29.846168  1690 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:29.862288  1540 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:29.969476 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:29.912519  1770 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:29.970253  1713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.011s	sys 0.032s
I20260709 12:24:29.991672 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1673) took 1425 ms. Trace:
W20260709 12:24:29.993887 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 80117.9us
I20260709 12:24:29.995186 32050 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:29.992219 31536 rpcz_store.cc:276] 0709 12:24:28.566602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.583641 (+ 17039us) service_pool.cc:224] Handling call
0709 12:24:28.583957 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:28.798191 (+214234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.991422 (+1193231us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540039e254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:29.991601 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441383296}
I20260709 12:24:29.998283 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:30.003381 31389 raft_consensus.cc:2376] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7. Re-sending same reply.
W20260709 12:24:29.983214  1749 log.cc:927] Time spent T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.424s	user 0.000s	sys 0.001s
I20260709 12:24:29.964583  1686 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:30.098664 31536 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:29.935643  1668 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:30.001281  1690 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.985571  1770 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:24:30.002518  1754 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
W20260709 12:24:30.015434  1752 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.432s	user 0.000s	sys 0.001s
I20260709 12:24:30.002137  1781 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.011740  1769 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:30.112310  1540 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:30.100438  1634 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 12:24:29.945490  1762 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:29.863619  1765 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.250769 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:30.782114 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:30.681984 31393 consensus_meta.cc:287] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.093s	user 0.011s	sys 0.000s
I20260709 12:24:30.783178 31393 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:30.251174 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:30.620317 31509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.007s	sys 0.018s
I20260709 12:24:30.585721 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1660) took 1943 ms. Trace:
I20260709 12:24:30.791438 31467 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:30.249107 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:30.676961 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1651) took 2049 ms. Trace:
I20260709 12:24:30.557790 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1679) took 1096 ms. Trace:
I20260709 12:24:30.793244 31464 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:30.793581 31536 rpcz_store.cc:276] 0709 12:24:29.461271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.011916 (+550645us) service_pool.cc:224] Handling call
0709 12:24:30.098416 (+ 86500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.099310 (+   894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.557710 (+458400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.802845  1792 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:30.793236 31542 rpcz_store.cc:276] 0709 12:24:28.631449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.501010 (+869561us) service_pool.cc:224] Handling call
0709 12:24:29.526907 (+ 25897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.527114 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.527139 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.567073 (+ 39934us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.937742 (+370669us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:29.937872 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.938130 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.676702 (+738572us) raft_consensus.cc:1685] finished
0709 12:24:30.676728 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.676889 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":290374,"threads_started":1,"wal-append.queue_time_us":1003482}
W20260709 12:24:30.770241  1743 consensus_meta.cc:287] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.015s	user 0.010s	sys 0.001s
W20260709 12:24:30.310315 31539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.000s	sys 0.012s
W20260709 12:24:30.809732 31539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.003s	sys 0.024s
I20260709 12:24:30.810544 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1675) took 1475 ms. Trace:
I20260709 12:24:30.185221  1777 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:30.748622  1653 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.963s	user 0.010s	sys 0.000s
I20260709 12:24:30.695663 32076 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:30.392067 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 524722us
W20260709 12:24:30.791570 31509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.008s	sys 0.018s
W20260709 12:24:30.782265 31508 connection.cc:256] RPC call timeout handler was delayed by -1.18447032999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:24:30.819731 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.255525  1714 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:30.781200  1431 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:30.804843 32077 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:30.634835 31390 consensus_meta.cc:287] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.056s	user 0.008s	sys 0.003s
I20260709 12:24:30.821144 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 319) took 1347 ms. Trace:
W20260709 12:24:30.391803 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 659881us
I20260709 12:24:30.808714 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1665) took 2033 ms. Trace:
I20260709 12:24:30.213657  1407 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:30.189005  1770 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:30.326794  1756 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.610s	user 0.001s	sys 0.000s
W20260709 12:24:30.761699  1713 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.003s	sys 0.011s
W20260709 12:24:30.379839  1773 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.397s	user 0.000s	sys 0.000s
W20260709 12:24:30.381119  1745 log.cc:927] Time spent T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 1.153s	user 0.005s	sys 0.000s
W20260709 12:24:30.839910  1713 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.003s	sys 0.012s
I20260709 12:24:30.810963 31539 rpcz_store.cc:276] 0709 12:24:29.334964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.653341 (+318377us) service_pool.cc:224] Handling call
0709 12:24:29.700323 (+ 46982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.700566 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:29.755197 (+ 54631us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.810198 (+1055001us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.810258 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.810309 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.810375 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.810491 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71508,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":50,"thread_start_us":1054588,"threads_started":1,"wal-append.queue_time_us":886487}
W20260709 12:24:30.392150 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 397001us
W20260709 12:24:30.310655 31543 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.012s
W20260709 12:24:30.332849  1759 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.418s	user 0.001s	sys 0.000s
W20260709 12:24:30.382265  1775 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
W20260709 12:24:30.558413  1754 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
W20260709 12:24:30.643317  1716 consensus_meta.cc:287] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.855s	user 0.007s	sys 0.006s
W20260709 12:24:30.640125  1730 consensus_meta.cc:287] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.150s	user 0.009s	sys 0.001s
W20260709 12:24:30.637329  1570 consensus_meta.cc:287] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.192s	user 0.007s	sys 0.003s
W20260709 12:24:30.392639 31391 consensus_meta.cc:287] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.018s
I20260709 12:24:30.859935 31391 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:30.860548 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1681) took 1167 ms. Trace:
W20260709 12:24:30.316599 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.358551  1764 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:30.236686  1767 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.248765  1782 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.695290  1791 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.854928  1407 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.640504  1796 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.783402  1540 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:30.365187  1724 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:30.644898  1668 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:30.713090 31434 connection.cc:256] RPC call timeout handler was delayed by -1.3169695070000671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 12:24:30.828897 31395 rpcz_store.cc:276] 0709 12:24:28.775271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.775380 (+   109us) service_pool.cc:224] Handling call
0709 12:24:30.808541 (+2033161us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54003f1e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:30.808659 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767885568}
W20260709 12:24:30.891397 31434 connection.cc:256] RPC call timeout handler was delayed by -1.3016695070000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 12:24:30.891855 31434 connection.cc:256] RPC call timeout handler was delayed by -1.2323695069999303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
W20260709 12:24:30.892220 31434 connection.cc:256] RPC call timeout handler was delayed by -1.2035695069998837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:24:30.695941  1771 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:30.900568  1771 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.238608  1579 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:30.833376 31390 raft_consensus.cc:2410] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:30.213945  1690 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.804672 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1714) took 1292 ms. Trace:
I20260709 12:24:30.907963 31393 rpcz_store.cc:276] 0709 12:24:29.491133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.587668 (+ 96535us) service_pool.cc:224] Handling call
0709 12:24:30.783734 (+1196066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.836150 32048 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:30.834908  1769 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:30.827096  1763 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:30.814254  1743 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:30.826900  1758 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:30.838718 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:30.915964 32081 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.816329  1792 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.839533  1797 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.839956 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:30.791615 31392 rpcz_store.cc:276] 0709 12:24:28.642567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.642709 (+   142us) service_pool.cc:224] Handling call
0709 12:24:28.647069 (+  4360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:28.662615 (+ 15546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.662658 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:28.669941 (+  7283us) log.cc:844] Serialized 52 byte log entry
0709 12:24:28.932682 (+262741us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b180028d4a0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:24:29.768326 (+835644us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:29.768375 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.768446 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.585360 (+816914us) raft_consensus.cc:1685] finished
0709 12:24:30.585387 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.585645 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4194,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":6542080,"thread_start_us":835303,"threads_started":1,"wal-append.queue_time_us":1694347}
I20260709 12:24:30.842769 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:30.924053 32083 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:30.924248 31536 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:24:30.847429 31543 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.000s	sys 0.027s
I20260709 12:24:30.822139  1777 raft_consensus.cc:697] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:30.236440  1781 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:30.860937 31391 rpcz_store.cc:276] 0709 12:24:29.693074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.697680 (+  4606us) service_pool.cc:224] Handling call
0709 12:24:30.860473 (+1162793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.837643  1714 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.822682  1653 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.342849  1786 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.870419 31433 leader_election.cc:400] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7.
I20260709 12:24:30.865875  1764 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:30.869632  1767 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.871615  1782 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.872346  1791 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.876578  1523 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:30.876984 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1650) took 2249 ms. Trace:
I20260709 12:24:30.878124  1629 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.878266  1765 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:30.879503  1687 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:30.882812 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1649) took 2256 ms. Trace:
I20260709 12:24:30.861217  1716 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.889691 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:30.890583 32079 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:30.899513  1724 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:30.960153  1714 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.019469  1777 consensus_queue.cc:237] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.000557  1761 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.943749  1758 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.021445  1761 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.023285  1758 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:30.959877  1764 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:30.989085  1629 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.028427 31539 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.028745  1791 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.029600  1771 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.030640  1782 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.031404 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 300) took 3014 ms. Trace:
I20260709 12:24:31.031932  1767 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.032760  1762 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.030622 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.034022 31392 raft_consensus.cc:2368] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8.
I20260709 12:24:31.034413 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1729) took 1186 ms. Trace:
I20260709 12:24:31.034686 31392 rpcz_store.cc:276] 0709 12:24:29.847919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.030359 (+1182440us) service_pool.cc:224] Handling call
0709 12:24:31.034344 (+  3985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.862857  1730 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.035537 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.036154 31392 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:31.036674 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 413) took 1151 ms. Trace:
I20260709 12:24:31.037060  1730 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:31.038349  1714 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:30.913275  1796 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.039868  1714 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.040374  1714 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.041560  1796 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.042225  1796 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.042327  1714 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.044610  1781 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:30.981791  1523 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:31.036962 31392 rpcz_store.cc:276] 0709 12:24:29.885289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.035282 (+1149993us) service_pool.cc:224] Handling call
0709 12:24:31.036601 (+  1319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.045799  1523 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.046250 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.046918 31539 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:31.047739 31536 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:31.047981  1523 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.049357  1629 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.046937 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1730) took 1181 ms. Trace:
W20260709 12:24:30.892652 31434 connection.cc:256] RPC call timeout handler was delayed by -1.172969507000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:24:30.907375 31390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1667) took 2032 ms (client timeout 1972 ms). Trace:
W20260709 12:24:30.915027 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 78957.5us
W20260709 12:24:30.916690 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.939363 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:30.902482  1540 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.940187  1763 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:30.943528 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:30.951129 31433 leader_election.cc:403] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:30.892163  1407 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.042740  1796 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.159469 31538 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:30.943333  1790 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:31.049376 31536 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:30.964376 31541 rpcz_store.cc:276] 0709 12:24:28.627067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.491615 (+864548us) service_pool.cc:224] Handling call
0709 12:24:29.491926 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.534446 (+ 42520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.534474 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.577186 (+ 42712us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.737118 (+159932us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:29.737168 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.737256 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.876716 (+1139460us) raft_consensus.cc:1685] finished
0709 12:24:30.876744 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.876913 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36891,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":125872,"threads_started":2,"wal-append.queue_time_us":263143}
I20260709 12:24:30.915728  1769 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.985138 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1677) took 1649 ms. Trace:
I20260709 12:24:30.987424 31540 rpcz_store.cc:276] 0709 12:24:28.626820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.486787 (+859967us) service_pool.cc:224] Handling call
0709 12:24:29.487114 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.559760 (+ 72646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.567497 (+  7737us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.580415 (+ 12918us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.738630 (+158215us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:29.738680 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.738772 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.882611 (+1143839us) raft_consensus.cc:1685] finished
0709 12:24:30.882628 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.882750 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39336,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":148228,"threads_started":2,"wal-append.queue_time_us":206288}
I20260709 12:24:31.021834 32081 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:30.916488 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.162910 31391 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:30.978276 31464 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:31.150177 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:31.165876 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:31.168831 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 301739us
W20260709 12:24:31.162601 31390 rpcz_store.cc:269] 0709 12:24:28.875157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.898914 (+ 23757us) service_pool.cc:224] Handling call
0709 12:24:30.907287 (+2008373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.050072 31392 rpcz_store.cc:276] 0709 12:24:29.865943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.046011 (+1180068us) service_pool.cc:224] Handling call
0709 12:24:31.046886 (+   875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.165438 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 410) took 1358 ms. Trace:
I20260709 12:24:31.172715 31433 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:31.172441 31391 rpcz_store.cc:276] 0709 12:24:29.807027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.943286 (+1136259us) service_pool.cc:224] Handling call
0709 12:24:31.165382 (+222096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.170572 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:31.163306 31434 connection.cc:256] RPC call timeout handler was delayed by -1.0478695070000867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 12:24:31.170578 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 351625us
I20260709 12:24:31.174480 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:31.175493 31391 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.174983 31434 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.174338 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1738) took 1090 ms. Trace:
I20260709 12:24:31.166494 32048 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:31.176615 31390 rpcz_store.cc:276] 0709 12:24:30.088782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.170347 (+1081565us) service_pool.cc:224] Handling call
0709 12:24:31.174278 (+  3931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.959340  1786 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:30.946686  1797 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:31.031764 31535 rpcz_store.cc:276] 0709 12:24:28.017024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.018211 (+  1187us) service_pool.cc:224] Handling call
0709 12:24:28.018548 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:28.591751 (+573203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.591784 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:28.607709 (+ 15925us) log.cc:844] Serialized 26 byte log entry
0709 12:24:28.697522 (+ 89813us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:28.697565 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.930121 (+232556us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54003ff054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:28.930213 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.913422 (+983209us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:30.924356 (+1010934us) raft_consensus.cc:1685] finished
0709 12:24:30.924387 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.031342 (+106955us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3298,"spinlock_wait_cycles":1446934400,"thread_start_us":79376,"threads_started":1,"wal-append.queue_time_us":344532}
I20260709 12:24:31.165110 31543 rpcz_store.cc:276] 0709 12:24:29.335670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.696098 (+360428us) service_pool.cc:224] Handling call
0709 12:24:29.716814 (+ 20716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.717074 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:30.938145 (+1221071us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.984368 (+ 46223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.984741 (+   373us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.984811 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.984910 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.985068 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37917,"prepare.queue_time_us":109374,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":6336,"raft.queue_time_us":2851,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":1201228,"threads_started":2}
I20260709 12:24:31.207492 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:31.248112 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1727) took 1367 ms. Trace:
I20260709 12:24:31.289885 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.292711 31395 rpcz_store.cc:276] 0709 12:24:29.812795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.908187 (+1095392us) service_pool.cc:224] Handling call
0709 12:24:31.180213 (+272026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.293205 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1736) took 1313 ms. Trace:
I20260709 12:24:31.293246 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:31.293670 31390 rpcz_store.cc:276] 0709 12:24:29.980813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.178616 (+1197803us) service_pool.cc:224] Handling call
0709 12:24:31.293151 (+114535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.290858 31463 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.280598 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1724) took 1061 ms. Trace:
I20260709 12:24:31.272837 32047 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:31.219833 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 44905.1us
I20260709 12:24:31.269927 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1730) took 1024 ms. Trace:
I20260709 12:24:31.295545 31434 leader_election.cc:400] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
I20260709 12:24:31.294582 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.296365 31390 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:31.296999 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 414) took 1382 ms. Trace:
I20260709 12:24:31.297324 31390 rpcz_store.cc:276] 0709 12:24:29.914212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.294358 (+1380146us) service_pool.cc:224] Handling call
0709 12:24:31.296951 (+  2593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.298159 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:31.298636 31390 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.297097 32047 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:31.149233  1713 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.295390 31469 rpcz_store.cc:276] 0709 12:24:30.245243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.245371 (+   128us) service_pool.cc:224] Handling call
0709 12:24:30.249273 (+  3902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.249591 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.249615 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.807321 (+557706us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.142366 (+335045us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:31.149040 (+  6674us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.149237 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.149325 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.269680 (+120355us) raft_consensus.cc:1685] finished
0709 12:24:31.269702 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.269866 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54758,"prepare.queue_time_us":7197,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":377487,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":179,"thread_start_us":260635,"threads_started":1,"wal-append.queue_time_us":448736}
I20260709 12:24:31.307062 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1727) took 1063 ms. Trace:
I20260709 12:24:31.307127 32047 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:31.308315 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 141934us
I20260709 12:24:31.309640 31391 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:31.049955  1792 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.294883 31470 rpcz_store.cc:276] 0709 12:24:30.219635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.219821 (+   186us) service_pool.cc:224] Handling call
0709 12:24:30.249076 (+ 29255us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:30.249512 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.249539 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:30.885941 (+636402us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b2c00000a78. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc5372 00007f6e912f7a01 00007f6e912bc43a 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2
0709 12:24:30.886378 (+   437us) log.cc:844] Serialized 52 byte log entry
0709 12:24:31.063251 (+176873us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:31.063304 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.063403 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.209500 (+146097us) raft_consensus.cc:1685] finished
0709 12:24:31.209519 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.280540 (+ 71021us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54710,"raft.queue_time_us":374853,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":1226963968,"thread_start_us":176456,"threads_started":1,"wal-append.queue_time_us":293162}
I20260709 12:24:31.310268 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 415) took 1373 ms. Trace:
I20260709 12:24:31.323166 31391 rpcz_store.cc:276] 0709 12:24:29.936835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.174025 (+1237190us) service_pool.cc:224] Handling call
0709 12:24:31.310208 (+136183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:31.213137  1717 consensus_meta.cc:287] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.333s	user 0.010s	sys 0.002s
I20260709 12:24:31.171345  1523 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.310585  1803 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.237460  1653 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.322490  1737 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.324293  1716 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.327121  1797 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:31.324457  1629 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.322347  1570 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:31.322347  1399 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:31.310614  1805 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:31.227471  1769 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:31.327129 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:31.332361 31507 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.553s (SENT)
I20260709 12:24:31.332787 31390 raft_consensus.cc:2410] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:31.307535 31465 rpcz_store.cc:276] 0709 12:24:30.243914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.244055 (+   141us) service_pool.cc:224] Handling call
0709 12:24:30.392133 (+148078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.817442 (+425309us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:30.826425 (+  8983us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.942506 (+116081us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.943558 (+  1052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.943625 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:30.943685 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.246944 (+303259us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b18002f6c20. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e19d2a6 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419
0709 12:24:31.306853 (+ 59909us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54002c5e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:31.306912 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.307015 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10051,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":2712,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5905,"spinlock_wait_cycles":1092620544,"thread_start_us":96530,"threads_started":1,"wal-append.queue_time_us":476917}
I20260709 12:24:31.219566  1434 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.265558  1724 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.333611 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:31.167853  1790 raft_consensus.cc:697] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:31.360311  1790 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.362665  1761 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.335275 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:31.209992  1714 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.325941 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.276669  1796 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.179144  1781 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.417625 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 108734us
I20260709 12:24:31.231341  1782 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:31.337594 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 44431.8us
I20260709 12:24:31.419894 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:31.211822  1763 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.239912  1743 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.239035  1690 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.322511  1762 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:31.338555 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1642) took 2713 ms. Trace:
I20260709 12:24:31.340914 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:31.342635 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.424978 31470 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:31.334129  1758 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.346858 31433 connection.cc:256] RPC call timeout handler was delayed by -1.4455999080000765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 12:24:31.425777 31433 connection.cc:256] RPC call timeout handler was delayed by -1.2898999080002795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 12:24:31.426476 31433 connection.cc:256] RPC call timeout handler was delayed by -1.189999908000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
I20260709 12:24:31.332825  1407 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.279815  1770 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.349975 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1718) took 1857 ms. Trace:
I20260709 12:24:31.350201 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 417) took 1341 ms. Trace:
W20260709 12:24:31.341454  1735 consensus_meta.cc:287] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.398s	user 0.011s	sys 0.000s
I20260709 12:24:31.433840 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:31.351747 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.353052 31463 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:31.336436  1717 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.340224  1737 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:31.356967 31507 leader_election.cc:336] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.178s (SENT)
W20260709 12:24:31.448740 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 113564us
I20260709 12:24:31.390336 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.420486  1714 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.348796  1399 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.346603  1629 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.354274  1805 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.346592  1764 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.338261  1792 consensus_queue.cc:1059] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:24:31.345636  1716 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:31.407371 31387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1671) took 2490 ms (client timeout 1861 ms). Trace:
I20260709 12:24:31.342221  1523 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:31.522210 31387 rpcz_store.cc:269] 0709 12:24:28.917009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.457369 (+540360us) service_pool.cc:224] Handling call
0709 12:24:31.407164 (+1949795us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400406854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:31.407298 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756275968}
I20260709 12:24:31.523469 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.523960 31387 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:31.524264  1523 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.524783 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.525123 32047 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:31.394064  1799 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:31.393383 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 59827.9us
I20260709 12:24:31.526381  1799 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.323542  1713 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.391431  1786 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:31.392083 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.505096  1771 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.333446 31359 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:31.451107 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.423779 31544 rpcz_store.cc:276] 0709 12:24:28.624977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.458097 (+833120us) service_pool.cc:224] Handling call
0709 12:24:29.458348 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.605812 (+147464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.605844 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.703119 (+ 97275us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.976116 (+272997us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:30.001044 (+ 24928us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.002827 (+  1783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.002935 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.328742 (+1325807us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b180035d640. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:31.331595 (+  2853us) raft_consensus.cc:1685] finished
0709 12:24:31.338373 (+  6778us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.338501 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1482,"prepare.queue_time_us":33936,"prepare.run_wall_time_us":45,"raft.queue_time_us":176903,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":130804,"spinlock_wait_cycles":1169593472,"thread_start_us":336716,"threads_started":2,"wal-append.queue_time_us":365886}
W20260709 12:24:31.502314 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 145398us
I20260709 12:24:31.484318 31393 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:31.478412 31391 raft_consensus.cc:2393] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:31.487128 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:31.532332 31507 leader_election.cc:336] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.245s (SENT)
I20260709 12:24:31.423561  1762 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.499887 31392 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:31.516597  1743 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.433723 31390 rpcz_store.cc:276] 0709 12:24:30.008680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.297954 (+1289274us) service_pool.cc:224] Handling call
0709 12:24:31.350152 (+ 52198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.433645 31395 rpcz_store.cc:276] 0709 12:24:29.492559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.306348 (+1813789us) service_pool.cc:224] Handling call
0709 12:24:31.349890 (+ 43542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.419824  1781 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.520471 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:31.520504 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 92413.5us
I20260709 12:24:31.526762 31434 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.480232  1717 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.503262  1570 raft_consensus.cc:697] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:31.411543 31467 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:24:31.508774  1399 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:31.486239  1737 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.432196  1815 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:31.580754 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 55726.7us
W20260709 12:24:31.535024 31392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1724) took 1780 ms (client timeout 2127 ms). Trace:
I20260709 12:24:31.548053  1786 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:31.534626 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 201225us
W20260709 12:24:31.538313 31507 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.483s (SENT)
I20260709 12:24:31.541045 31361 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.548983  1777 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.543000 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 412) took 1695 ms. Trace:
I20260709 12:24:31.586870 31391 rpcz_store.cc:276] 0709 12:24:29.847251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.390001 (+1542750us) service_pool.cc:224] Handling call
0709 12:24:31.542923 (+152922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.528344 31464 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:31.534608  1771 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.547264 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:31.591192 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 44024.3us
I20260709 12:24:31.592168 31434 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.526789  1799 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.478612  1407 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:24:31.534632  1489 tablet_copy_client.cc:538] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:31.552048 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.483835  1816 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:24:31.578325 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:31.542624  1762 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:31.606524 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1725) took 1386 ms. Trace:
W20260709 12:24:31.581413 31392 rpcz_store.cc:269] 0709 12:24:29.754528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.185486 (+1430958us) service_pool.cc:224] Handling call
0709 12:24:31.534951 (+349465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.535341 31542 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:31.584013 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.433677  1758 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.587940  1717 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.537196  1790 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:24:31.585508 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.586400 31507 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:31.483340  1735 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.628369 31394 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:31.629801  1735 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.587970 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.545755  1523 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:31.630730 31391 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:31.631446  1763 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.632093 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:31.632611 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 94349.9us
I20260709 12:24:31.634662  1763 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.634491  1799 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.635144  1763 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:31.636940  1799 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.637789 31389 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:31.638458  1763 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:31.640630  1781 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.642506  1450 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.643973 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:31.633142 31391 raft_consensus.cc:2393] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:31.646276 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.648056 31540 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:31.648315 32079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 493) took 3567 ms (client timeout 2075 ms). Trace:
W20260709 12:24:31.648677 32079 rpcz_store.cc:269] 0709 12:24:28.080799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.083266 (+  2467us) service_pool.cc:224] Handling call
0709 12:24:31.648148 (+3564882us) spinlock_profiling.cc:243] Waited 2.78 s on lock 0x7b540052bf54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:31.648250 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6392777344}
I20260709 12:24:31.649303  1758 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.649423 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.650223 31391 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 3.
I20260709 12:24:31.651021 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.651762 31391 raft_consensus.cc:2410] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:31.652652 31391 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:31.653210 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1675) took 2347 ms. Trace:
I20260709 12:24:31.604501  1782 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.653507 31391 rpcz_store.cc:276] 0709 12:24:29.305737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.652242 (+2346505us) service_pool.cc:224] Handling call
0709 12:24:31.652502 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.652983 (+   481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.653148 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.654814 31391 raft_consensus.cc:1240] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:31.656450 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.657104 31464 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:31.659641  1713 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:31.545532  1724 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:24:31.618330 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:31.660681 31467 raft_consensus.cc:2376] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9. Re-sending same reply.
I20260709 12:24:31.600782  1767 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:31.600112 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 114632us
I20260709 12:24:31.661545 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:31.662341 31466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 316) took 2387 ms (client timeout 1768 ms). Trace:
W20260709 12:24:31.662739 31466 rpcz_store.cc:269] 0709 12:24:29.274615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.452854 (+178239us) service_pool.cc:224] Handling call
0709 12:24:31.662152 (+2209298us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001c8ed4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:31.662232 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694473984}
W20260709 12:24:31.602627 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.663622 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.663977 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.664278 31469 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:31.665172 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.662708 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:31.665750 31469 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:31.666855 31467 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:31.505260 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 317) took 2165 ms. Trace:
W20260709 12:24:31.668660 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 84724.4us
I20260709 12:24:31.668838 31463 rpcz_store.cc:276] 0709 12:24:29.339585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.474910 (+135325us) service_pool.cc:224] Handling call
0709 12:24:29.493083 (+ 18173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.210625 (+1717542us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b58008702d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912180aa 00007f6e9129a447 00007f6e912b2fe7 00007f6e912b47de 00007f6e912beb49 00007f6e912bf416 00007f6e912bbd8f 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4
0709 12:24:31.504921 (+294296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.505198 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3525337344}
I20260709 12:24:31.669704 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.670173 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:31.670465 31540 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:31.670634 31361 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.672178 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.672930 31539 raft_consensus.cc:2410] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:31.673986  1492 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:31.674343 31507 leader_election.cc:336] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.656s (SENT)
I20260709 12:24:31.674743 31507 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:31.675602 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.676887 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:30.829195 31462 rpcz_store.cc:276] 0709 12:24:29.469420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.475763 (+  6343us) service_pool.cc:224] Handling call
0709 12:24:29.492813 (+ 17050us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.717340 (+224527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.717385 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.754256 (+ 36871us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.165590 (+411334us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:30.816198 (+650608us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.816465 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.816537 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.816574 (+    37us) raft_consensus.cc:1685] finished
0709 12:24:30.816584 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.816704 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23000,"prepare.queue_time_us":173640,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":302732,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":52503,"thread_start_us":1048136,"threads_started":3,"wal-append.queue_time_us":863141}
I20260709 12:24:31.677953 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:31.678571 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:31.585031  1821 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.680205 32050 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:31.681341  1817 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:31.681529  1713 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.682082  1817 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:31.682538  1817 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.682921  1817 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.683244 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.683683  1764 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.684067 31539 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:31.684161 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.684979 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.685564  1796 raft_consensus.cc:3055] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:31.551640  1540 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.612119 31465 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:31.589246  1786 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:31.682093  1713 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.615674 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:31.663646 31433 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.731s (SENT)
I20260709 12:24:31.687602 31392 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:31.687806 31433 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.616779  1716 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.616878  1629 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:31.659896 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.665302 31466 raft_consensus.cc:3055] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:31.667567 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.668172 31467 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:31.697530  1782 consensus_queue.cc:1059] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:31.697870 31392 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:31.698455 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1677) took 2366 ms. Trace:
I20260709 12:24:31.698511  1713 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:31.668233 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.698868 31392 rpcz_store.cc:276] 0709 12:24:29.331836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.697436 (+2365600us) service_pool.cc:224] Handling call
0709 12:24:31.697714 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.698246 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.698404 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.699435  1782 raft_consensus.cc:3055] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:31.699842  1782 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:31.700155 31392 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:31.700335 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:31.700793 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.680270  1821 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.688748 31387 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:24:31.605862 31434 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:31.688097 31393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1737) took 1682 ms (client timeout 1656 ms). Trace:
I20260709 12:24:31.679036 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.657881 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.690199 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.701398 31535 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:31.606956 31461 rpcz_store.cc:276] 0709 12:24:30.220094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.220228 (+   134us) service_pool.cc:224] Handling call
0709 12:24:30.392749 (+172521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.580790 (+188041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.580835 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.408292 (+827457us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b2c00000a78. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc5372 00007f6e912f7a01 00007f6e912bc43a 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2
0709 12:24:31.408709 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.600503 (+191794us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:31.600555 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.603118 (+  2563us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.603461 (+   343us) raft_consensus.cc:1685] finished
0709 12:24:31.603477 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.606463 (+  2986us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":298162,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":52074,"spinlock_wait_cycles":465441152,"thread_start_us":191391,"threads_started":1,"wal-append.queue_time_us":191760}
I20260709 12:24:31.702590 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:31.707135 31464 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:31.695966 31466 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:31.709090 31536 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 10: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:31.709673 31393 rpcz_store.cc:269] 0709 12:24:30.007474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.916243 (+908769us) service_pool.cc:224] Handling call
0709 12:24:31.687911 (+771668us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540028bc54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:31.688033 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733788032}
I20260709 12:24:31.711594 31393 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:24:31.712359 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1709) took 2240 ms. Trace:
I20260709 12:24:31.712774 31393 rpcz_store.cc:276] 0709 12:24:29.471824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.710795 (+2238971us) service_pool.cc:224] Handling call
0709 12:24:31.711207 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:31.712059 (+   852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.712294 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.714361 31393 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:31.700058 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.638665 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.716405 31389 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:31.596979 32047 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:31.717950 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 121029us
I20260709 12:24:31.700796 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1678) took 2368 ms. Trace:
I20260709 12:24:31.675064  1492 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:31.733250 31541 raft_consensus.cc:2393] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:31.733749 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 59435.3us
I20260709 12:24:31.606900  1690 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:31.735507 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1676) took 2369 ms. Trace:
I20260709 12:24:31.740854 31391 rpcz_store.cc:276] 0709 12:24:29.322819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.654320 (+2331501us) service_pool.cc:224] Handling call
0709 12:24:31.654645 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.655127 (+   482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.691701 (+ 36574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.702143 31433 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:31.737290 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.743489 31536 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:31.609221  1714 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:31.745750 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.751070 31536 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:31.729875 31392 rpcz_store.cc:276] 0709 12:24:29.332190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.699729 (+2367539us) service_pool.cc:224] Handling call
0709 12:24:31.700000 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.700586 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.700753 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.751125 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:31.794312 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 188465us
I20260709 12:24:31.795996 31434 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.752805 32048 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:31.797626 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 44857.6us
I20260709 12:24:31.752656 31539 raft_consensus.cc:2410] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:31.755957 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.685958  1796 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:31.793473 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.799940 31535 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
W20260709 12:24:31.798936 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 108844us
I20260709 12:24:31.805701 31541 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:31.757437 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:31.776777 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1669) took 2831 ms. Trace:
I20260709 12:24:31.807969 31536 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:31.755353 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:31.694969  1764 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.739502  1790 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:31.715026 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1712) took 2224 ms. Trace:
I20260709 12:24:31.795512 31466 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:31.822005 31466 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:31.823210 31393 rpcz_store.cc:276] 0709 12:24:29.490606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.713623 (+2223017us) service_pool.cc:224] Handling call
0709 12:24:31.713968 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.714759 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.714966 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.825248 31393 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:31.826115 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1680) took 2148 ms. Trace:
I20260709 12:24:31.733665  1777 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:31.745379  1799 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:31.817786 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:31.826613 31393 rpcz_store.cc:276] 0709 12:24:29.677799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.824443 (+2146644us) service_pool.cc:224] Handling call
0709 12:24:31.824849 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.825814 (+   965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.826045 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.686941  1786 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.829636 31392 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:31.834601 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1679) took 2161 ms. Trace:
I20260709 12:24:31.735590  1821 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.817728  1816 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:31.700585  1782 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.839814 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:31.753304  1450 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:31.749825  1788 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:31.841826 31389 raft_consensus.cc:2410] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:31.835203 31392 rpcz_store.cc:276] 0709 12:24:29.672971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.801182 (+2128211us) service_pool.cc:224] Handling call
0709 12:24:31.829279 (+ 28097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.834357 (+  5078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.834550 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.806792 31388 rpcz_store.cc:276] 0709 12:24:28.916394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.916641 (+   247us) service_pool.cc:224] Handling call
0709 12:24:28.916972 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:28.928939 (+ 11967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.928970 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.485110 (+556140us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.603587 (+118477us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:29.664043 (+ 60456us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.873089 (+1209046us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b1800417520. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf522 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:31.653745 (+780656us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b1800417520. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cc455 00007f6e912b4060 00007f6e912c6716 00007f6e912d7287 00007f6e912d7208
0709 12:24:31.747233 (+ 93488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.747367 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.747429 (+    62us) raft_consensus.cc:1685] finished
0709 12:24:31.747451 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.747607 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60201,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2976,"raft.queue_time_us":50577,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":14992,"spinlock_wait_cycles":28451456,"thread_start_us":206822,"threads_started":2,"wal-append.queue_time_us":280068}
I20260709 12:24:31.797377  1620 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.877713 31393 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:31.752537  1492 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:31.804363  1792 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:31.870865 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:31.819990  1540 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:31.892678 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 149777us
I20260709 12:24:31.888985 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1725) took 2090 ms. Trace:
I20260709 12:24:31.752373  1781 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:24:31.894430 31393 rpcz_store.cc:276] 0709 12:24:29.787782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.877058 (+2089276us) service_pool.cc:224] Handling call
0709 12:24:31.877407 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.878094 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.878314 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:31.897929 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 58198.8us
I20260709 12:24:31.898938 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.903007 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.904049 31393 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:31.904170 31466 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:31.839172  1816 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:31.891884  1809 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:31.937569 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:31.938290 31463 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.913144 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1582) took 1024 ms. Trace:
I20260709 12:24:31.939592 31466 rpcz_store.cc:276] 0709 12:24:30.881148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.664881 (+783733us) service_pool.cc:224] Handling call
0709 12:24:31.665154 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.905513 (+240359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.905754 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.877177  1743 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.750293  1570 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:31.933614 31388 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:31.912760 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 411) took 2094 ms. Trace:
I20260709 12:24:31.956786 31393 rpcz_store.cc:276] 0709 12:24:29.818116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.895485 (+2077369us) service_pool.cc:224] Handling call
0709 12:24:31.895779 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.904573 (+  8794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.912668 (+  8095us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:31.934182 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.876732  1788 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.942852 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:31.916438 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 409) took 2121 ms. Trace:
I20260709 12:24:31.917572 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:31.909366  1714 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.909548  1777 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:31.914170  1827 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:31.960140 31392 rpcz_store.cc:276] 0709 12:24:29.794698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.884397 (+2089699us) service_pool.cc:224] Handling call
0709 12:24:31.915903 (+ 31506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.916075 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.916101 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.916139 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:31.916171 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.916237 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.916362 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.932725  1782 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.966149 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1726) took 2158 ms. Trace:
I20260709 12:24:31.966632 31388 rpcz_store.cc:276] 0709 12:24:29.797811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.884334 (+2086523us) service_pool.cc:224] Handling call
0709 12:24:31.916870 (+ 32536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.956181 (+ 39311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.956440 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.918855  1816 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.942468  1791 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:31.873026  1690 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 12:24:31.974728 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1639) took 3350 ms (client timeout 3125 ms). Trace:
I20260709 12:24:31.968590 31389 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:31.975150 31463 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:31.976836 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1680) took 2514 ms. Trace:
I20260709 12:24:31.980566 31537 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:31.975157 31538 rpcz_store.cc:269] 0709 12:24:28.624183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.455845 (+831662us) service_pool.cc:224] Handling call
0709 12:24:31.974533 (+2518688us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54000d2d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:31.974658 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3667298176}
I20260709 12:24:31.977315 31542 rpcz_store.cc:276] 0709 12:24:29.461942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.812583 (+1350641us) service_pool.cc:224] Handling call
0709 12:24:30.820970 (+  8387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.610172 (+789202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.976553 (+366381us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540021f054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:31.976766 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638641920}
W20260709 12:24:31.984547 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 188641us
I20260709 12:24:31.984846 31392 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:31.985253 31434 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.985702 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1733) took 2049 ms. Trace:
I20260709 12:24:31.986120 31392 rpcz_store.cc:276] 0709 12:24:29.936473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.966644 (+2030171us) service_pool.cc:224] Handling call
0709 12:24:31.984538 (+ 17894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.985381 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.985632 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.963289  1788 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.988547 31388 raft_consensus.cc:1240] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:31.989130 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1734) took 2040 ms. Trace:
I20260709 12:24:31.989373 31388 rpcz_store.cc:276] 0709 12:24:29.949437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.967646 (+2018209us) service_pool.cc:224] Handling call
0709 12:24:31.983849 (+ 16203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.988968 (+  5119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.989091 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.970165  1815 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:31.991983 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 160587us
I20260709 12:24:31.991997 31361 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.969184  1827 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.995446 31361 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:31.955309  1792 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:31.999097 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:32.004078 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:32.004792 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:32.005322 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1735) took 2038 ms. Trace:
I20260709 12:24:32.001945 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 416) took 2049 ms. Trace:
I20260709 12:24:32.005693 32048 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:31.966341  1822 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:24:32.005956 31392 rpcz_store.cc:276] 0709 12:24:29.952680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.987075 (+2034395us) service_pool.cc:224] Handling call
0709 12:24:32.001211 (+ 14136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.001500 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.001543 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.001600 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:32.001654 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.001729 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.001863 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.025904 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.005707 31388 rpcz_store.cc:276] 0709 12:24:29.967400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.990095 (+2022695us) service_pool.cc:224] Handling call
0709 12:24:32.004712 (+ 14617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.004945 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.004980 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.005030 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:32.005084 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.005169 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.005273 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.935863  1796 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:32.040040  1826 log.cc:927] Time spent T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:24:32.040113  1796 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.046290  1737 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.049675 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.050801 31388 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:32.061967 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.000649  1743 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:32.000722  1523 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:32.049942  1767 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7.
I20260709 12:24:32.083752 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 418) took 1703 ms. Trace:
I20260709 12:24:32.007736  1717 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:32.088070 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 102890us
I20260709 12:24:31.997576  1827 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.008417  1831 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:32.012060  1803 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:32.086316 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 81554.4us
I20260709 12:24:32.086665 31392 rpcz_store.cc:276] 0709 12:24:30.380317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.059782 (+1679465us) service_pool.cc:224] Handling call
0709 12:24:32.083081 (+ 23299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.083321 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.083358 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.083413 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:32.083478 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.083550 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.083680 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.036731  1399 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.093673 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:32.095034 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:32.102773 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 168112us
W20260709 12:24:32.102898 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 97266.2us
I20260709 12:24:32.104066 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:32.089627  1717 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.038215  1492 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.102135  1815 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.091620  1833 raft_consensus.cc:2764] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:32.093490  1737 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:32.148010 32080 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:32.114035  1717 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.102303  1792 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:32.115749  1818 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:32.127000  1671 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.104228  1743 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:24:32.168718 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 61477.4us
W20260709 12:24:32.169975 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 75124.5us
I20260709 12:24:32.171010 31434 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:32.172312 32050 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:32.150144  1831 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:32.149983  1792 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.147586  1822 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:24:32.178392 32050 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:32.181495 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.181566 31544 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:32.183521 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 82819.7us
W20260709 12:24:32.191551 31361 consensus_peers.cc:597] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:32.176168  1792 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.165603  1737 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:24:32.186102  1825 log.cc:927] Time spent T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:24:32.189390  1833 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:32.201426  1836 log.cc:927] Time spent T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:32.203538  1830 raft_consensus.cc:3055] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:32.204207  1762 consensus_meta.cc:287] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 12:24:32.204571  1831 consensus_queue.cc:1059] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:24:32.189826  1828 log.cc:927] Time spent T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:24:32.186530  1818 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:32.185976  1690 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:32.261927  1716 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:32.269577  1716 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.271721  1716 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:32.272562  1833 raft_consensus.cc:697] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:32.206720  1841 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:32.273434  1841 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.273644  1833 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.267644  1762 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.275640  1841 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:32.275148 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 67285.8us
I20260709 12:24:32.261211 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:32.260437 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 52248.6us
I20260709 12:24:32.278345 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:32.280665  1831 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:32.283850  1788 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.284185  1791 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:32.284288 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1732) took 2371 ms. Trace:
I20260709 12:24:32.284731 31393 rpcz_store.cc:276] 0709 12:24:29.913310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.957986 (+2044676us) service_pool.cc:224] Handling call
0709 12:24:31.958405 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.958675 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.958726 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.960568 (+  1842us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.091576 (+131008us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:32.116966 (+ 25390us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.118072 (+  1106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.118144 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.284084 (+165940us) raft_consensus.cc:1685] finished
0709 12:24:32.284105 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.284235 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":805,"prepare.queue_time_us":94971,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":970,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":18198,"thread_start_us":116949,"threads_started":2,"wal-append.queue_time_us":217110}
I20260709 12:24:32.286718 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.287262 31393 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.266269  1830 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:32.318349  1764 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.318619 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.318907  1764 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.297576 31393 raft_consensus.cc:2410] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:32.320315 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.321017  1764 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:32.321305 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.284726  1791 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:32.322476 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.324090  1821 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.323053 31393 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:32.325532 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.325839  1770 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:32.326227 31393 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:32.326300  1821 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:32.327095 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.327951 31393 raft_consensus.cc:2410] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:32.328686 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.329165 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1731) took 2430 ms. Trace:
I20260709 12:24:32.329677 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.329867  1791 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.330236 31393 raft_consensus.cc:2376] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7. Re-sending same reply.
I20260709 12:24:32.330709 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.331432  1723 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:32.331832 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:32.332082  1791 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:32.297962  1792 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.303551 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.332893 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.333724 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.334182 31540 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:32.334781 31544 raft_consensus.cc:2410] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:32.304523 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.298261  1724 raft_consensus.cc:3055] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:32.337184  1724 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:32.338006  1724 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.339205  1724 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.307498 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.355662 31538 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:32.357158  1822 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:32.307592 31433 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:24:32.359407 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 51896us
I20260709 12:24:32.362058 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:32.362766  1757 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:32.363293  1757 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.363724  1757 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.327970 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1653) took 3695 ms. Trace:
I20260709 12:24:32.364151  1770 consensus_queue.cc:1059] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:32.364377 31537 rpcz_store.cc:276] 0709 12:24:28.632087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.577142 (+945055us) service_pool.cc:224] Handling call
0709 12:24:31.974667 (+2397525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.980936 (+  6269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.327775 (+346839us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b54000d2d50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:32.327909 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5512696704}
I20260709 12:24:32.364766  1835 consensus_queue.cc:1059] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:32.343909 31394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1711) took 2853 ms (client timeout 2005 ms). Trace:
I20260709 12:24:32.365890  1788 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:32.365711 31394 rpcz_store.cc:269] 0709 12:24:29.490274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.697204 (+206930us) service_pool.cc:224] Handling call
0709 12:24:32.343651 (+2646447us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540027ef54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:32.343821 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4361093376}
I20260709 12:24:32.367486 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.368155 31394 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.345662 31543 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:32.371316  1805 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:32.329542 31389 rpcz_store.cc:276] 0709 12:24:29.899218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.907878 (+2008660us) service_pool.cc:224] Handling call
0709 12:24:31.938914 (+ 31036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.984011 (+ 45097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.328945 (+344934us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b54002e18d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:32.329112 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67524480}
I20260709 12:24:32.314738  1762 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:32.372439 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.373082 31389 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:32.374114 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.345983 31395 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:32.315361  1716 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.347626  1764 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:32.306367 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.260232  1839 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:24:32.376611  1764 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.376159  1716 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.351110  1489 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:24:32.378831  1764 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:32.350374 31510 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:32.319382 31539 raft_consensus.cc:2393] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:32.365732  1767 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:32.379912  1767 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:32.380263  1399 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:32.380661  1770 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:32.380792  1767 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.381520  1812 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:32.382068  1812 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:32.382177  1767 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.382608  1841 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:32.383003  1812 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.379504 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 408) took 3111 ms. Trace:
I20260709 12:24:32.384342 31390 rpcz_store.cc:276] 0709 12:24:29.267990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.546066 (+2278076us) service_pool.cc:224] Handling call
0709 12:24:31.546381 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.551307 (+  4926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.552579 (+  1272us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.563600 (+ 11021us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.840629 (+277029us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.840668 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.840728 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.379303 (+538575us) raft_consensus.cc:1685] finished
0709 12:24:32.379332 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.379447 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1075,"raft.queue_time_us":265,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":22552,"thread_start_us":235863,"threads_started":1,"wal-append.queue_time_us":352382}
I20260709 12:24:32.386140 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.386938 31390 raft_consensus.cc:2410] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:32.387759  1778 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.387920 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1673) took 3253 ms. Trace:
I20260709 12:24:32.388348 31387 rpcz_store.cc:276] 0709 12:24:29.153731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.525742 (+2372011us) service_pool.cc:224] Handling call
0709 12:24:31.688525 (+162783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.716756 (+ 28231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.387749 (+670993us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540028bc50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:32.387867 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373620992}
I20260709 12:24:32.345513 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.389986 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.390702 31392 raft_consensus.cc:2393] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:32.388363  1778 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.375082 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.389494 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.393678 31387 raft_consensus.cc:2410] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:32.396075 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.399613 31388 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:32.331048 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.407919 31393 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.417045 32047 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:32.354717  1817 consensus_meta.cc:287] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.005s
I20260709 12:24:32.365980  1835 raft_consensus.cc:3055] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:32.427718  1835 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:32.427884  1778 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:32.428593  1835 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.429119 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.429733  1835 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.429766 31389 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:32.430794 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.427735 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.432446 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.432842  1686 raft_consensus.cc:3055] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:32.433225 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:32.434026 32079 raft_consensus.cc:2368] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:32.434931 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:32.435487 31539 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.436304  1717 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.438292 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:32.439532  1717 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:32.287848  1816 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.442466  1816 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:32.443212 32080 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 10: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:32.443495 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.444034 31387 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.444144  1827 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:32.433277  1686 raft_consensus.cc:740] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:32.433035 31392 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:32.447676 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1720) took 2915 ms. Trace:
I20260709 12:24:32.448894 31394 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:32.449910 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:32.450965 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.455428 31390 raft_consensus.cc:2393] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:32.456784 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:32.458329 31539 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:32.458416 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:32.378868  1716 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:32.445788  1815 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:32.792531 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 282972us
I20260709 12:24:32.448155 31391 rpcz_store.cc:276] 0709 12:24:29.532017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.741597 (+2209580us) service_pool.cc:224] Handling call
0709 12:24:31.741892 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.819033 (+ 77141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.819084 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.834358 (+ 15274us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.050470 (+216112us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:32.094235 (+ 43765us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.100090 (+  5855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.100170 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.447441 (+347271us) raft_consensus.cc:1685] finished
0709 12:24:32.447467 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.447610 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18781,"prepare.queue_time_us":124658,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":17613,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":21114,"thread_start_us":173506,"threads_started":2,"wal-append.queue_time_us":213640}
I20260709 12:24:32.792222 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:32.566411 32050 leader_election.cc:336] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.576s (SENT)
I20260709 12:24:32.459921 31389 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:32.800907 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 234529us
I20260709 12:24:32.798060 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:32.702603 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 105416us
I20260709 12:24:32.550755 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:32.781014 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.468669 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.804293 31388 raft_consensus.cc:2368] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4.
I20260709 12:24:32.419224  1540 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:32.468374 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:32.508154 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.541062 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:32.792127 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 334353us
I20260709 12:24:32.544085 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1674) took 3300 ms. Trace:
I20260709 12:24:32.507506 31470 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:32.540227 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:32.758507  1671 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.000s
I20260709 12:24:32.811923 31434 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:32.811712 31395 rpcz_store.cc:276] 0709 12:24:29.244452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.547378 (+2302926us) service_pool.cc:224] Handling call
0709 12:24:32.345752 (+798374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.375872 (+ 30120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.543848 (+167976us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b540027ef50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:32.544012 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759828864}
W20260709 12:24:32.812654 31470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 327) took 1383 ms (client timeout 1576 ms). Trace:
I20260709 12:24:32.652875 31387 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:32.576232 31393 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:32.702414 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:32.802084 31390 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:32.419173  1799 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:32.792297 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:32.802877 32048 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:32.799944 31359 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:32.853767 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 53908.7us
I20260709 12:24:32.595978 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:32.854143 32047 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:32.812095 32083 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:32.811712 31394 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:32.425266  1837 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:32.813211 31470 rpcz_store.cc:269] 0709 12:24:31.429046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.432021 (+  2975us) service_pool.cc:224] Handling call
0709 12:24:32.361868 (+929847us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:32.812600 (+450732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481920}
I20260709 12:24:32.858130 31359 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:32.820024 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:32.456154  1762 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:32.822470 31386 raft_consensus.cc:2410] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:32.468483  1690 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.590922  1827 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:32.512506  1800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.010s	sys 0.036s
I20260709 12:24:32.873977 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:32.827814 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:32.454641  1791 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:32.829703  1848 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.202s
I20260709 12:24:32.829977 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:32.926623 31467 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.830116 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.830940 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.831436 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.833997 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:32.820315 32075 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEARNER]: Advancing to term 7
I20260709 12:24:32.875752  1714 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.835525 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:32.836798  1788 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:32.837821 31462 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:32.829712 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:32.840155 31434 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:32.573081  1713 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:32.841861 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:33.011709 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 171612us
I20260709 12:24:33.012071 31395 raft_consensus.cc:2410] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:32.446278  1817 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:32.874689 31393 raft_consensus.cc:1240] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:32.844831 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:32.916864 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.012776 31434 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:32.863726  1770 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:32.829216  1771 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:32.869257  1799 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:32.883596 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:32.921427 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:33.028792 31544 raft_consensus.cc:2410] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:32.921563 31390 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:32.868762  1717 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:32.526567  1830 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:33.035105 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:32.880679  1800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.016s	sys 0.041s
I20260709 12:24:32.871543  1671 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:32.928663 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.012s
I20260709 12:24:32.928750 31389 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:33.039860 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.918403  1791 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.007169 31465 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.822813  1540 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:33.011852 31469 raft_consensus.cc:2410] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:32.625836  1792 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:33.012755 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1690) took 1383 ms. Trace:
W20260709 12:24:32.881235 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 78453us
I20260709 12:24:33.013317 31466 raft_consensus.cc:2410] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:32.572423  1686 consensus_queue.cc:260] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.017014 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:32.924624  1570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.016s	sys 0.034s
I20260709 12:24:33.177731 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:33.019306 31434 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:32.921155  1822 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:33.018224  1782 consensus_queue.cc:1059] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.142s
I20260709 12:24:32.882963  1762 raft_consensus.cc:697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:32.874359  1450 consensus_queue.cc:1059] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.135s
I20260709 12:24:32.916234  1761 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:32.960561 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:32.916347  1620 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 12:24:32.871747  1837 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:33.123744 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:33.124266 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:33.023434  1840 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:33.172744 31393 rpcz_store.cc:276] 0709 12:24:31.629338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.851559 (+1222221us) service_pool.cc:224] Handling call
0709 12:24:32.874531 (+ 22972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.012527 (+137996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.012702 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:33.042423 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.000s	sys 0.013s
I20260709 12:24:33.198326 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:33.198623 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:33.031941  1717 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:33.055208 31386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1670) took 4138 ms (client timeout 1688 ms). Trace:
W20260709 12:24:33.248515 31386 rpcz_store.cc:269] 0709 12:24:28.916705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.916833 (+   128us) service_pool.cc:224] Handling call
0709 12:24:33.045713 (+4128880us) spinlock_profiling.cc:243] Waited 3.29 s on lock 0x7b540028d554. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:33.055137 (+  9424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7563349376}
I20260709 12:24:33.042426  1838 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.192s
I20260709 12:24:33.254487 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:33.030337 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:33.215703 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:33.018411  1788 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.039942  1771 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:32.880836  1690 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.054890  1671 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:33.229256 32077 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.229552 31469 raft_consensus.cc:2410] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:33.021957  1713 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:33.199635  1570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.017s	sys 0.034s
I20260709 12:24:33.236331 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:33.236804 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:33.204619  1506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.008s	sys 0.021s
W20260709 12:24:33.202853  1812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.009s	sys 0.018s
I20260709 12:24:33.230934 31391 raft_consensus.cc:2376] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6. Re-sending same reply.
W20260709 12:24:33.238438 31537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.027s	sys 0.027s
W20260709 12:24:33.292068 31537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.027s	sys 0.028s
I20260709 12:24:33.242354 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:33.246294 31389 raft_consensus.cc:2393] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:33.246712 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 853614us
W20260709 12:24:33.045289  1757 consensus_meta.cc:287] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.003s
I20260709 12:24:33.038856  1857 consensus_queue.cc:1059] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.208s
I20260709 12:24:33.252218 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:33.295490 31394 raft_consensus.cc:2410] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:33.252485 31536 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:33.253266 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:33.253847 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:32.930341  1777 consensus_queue.cc:1059] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.301s
I20260709 12:24:33.257982 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:33.271731 31540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.017s	sys 0.035s
W20260709 12:24:33.303215 31540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.017s	sys 0.035s
I20260709 12:24:33.278585  1840 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.267313 31465 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:33.158067  1800 consensus_queue.cc:1059] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:24:33.277627 31393 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:33.291611  1506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.008s	sys 0.022s
I20260709 12:24:33.231220  1822 raft_consensus.cc:697] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:33.289915 32079 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.255712  1717 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.291772 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:33.303577  1771 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:33.239585 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:33.297123 32082 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:33.304716 31391 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.264515 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:33.270949  1761 raft_consensus.cc:697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:33.272007  1863 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:33.313180 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.305132  1757 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.316429  1857 raft_consensus.cc:3055] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:33.317376 31394 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:33.294905  1812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.010s	sys 0.019s
I20260709 12:24:33.287626  1671 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.018523  1714 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.359025 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:33.360589 31535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.008s	sys 0.008s
I20260709 12:24:33.360915 31392 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:33.363983 32077 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:33.253412  1786 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:33.358984  1716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.012s	sys 0.058s
I20260709 12:24:33.372180 32084 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:33.381422 31392 pending_rounds.cc:85] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 6
I20260709 12:24:33.381798 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:33.397429 31392 pending_rounds.cc:107] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:33.397749 31465 raft_consensus.cc:2393] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:33.383208 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:33.397826 31392 raft_consensus.cc:2889] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:33.318164 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:33.397084  1716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.012s	sys 0.059s
I20260709 12:24:33.402587  1761 consensus_queue.cc:237] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:33.403867 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:33.404994 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:33.405187  1859 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 12:24:33.405972  1786 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.406440 31467 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:33.408370  1786 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:33.410082 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:33.410883 32080 raft_consensus.cc:2393] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:33.411867  1713 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:33.412441  1713 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:33.413642 32075 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:33.415819  1866 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:33.415988  1540 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:33.416253  1690 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:33.416384  1866 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.417030  1690 raft_consensus.cc:3055] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:33.417541  1690 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:33.418530  1866 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:33.369191  1771 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:33.419656  1771 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.419874  1791 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:33.420564  1791 raft_consensus.cc:3055] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:33.420949  1791 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:33.421891  1791 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:33.423722  1852 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:24:33.425992  1757 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:33.426949  1799 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:33.416682  1874 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.455595 32048 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:33.456538 32050 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:33.320210  1840 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.384421  1863 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:33.429280  1862 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:24:33.384342 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:33.436129 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:33.462909 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:33.463624 31467 raft_consensus.cc:2393] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 4: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:33.381736 31535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.008s	sys 0.008s
W20260709 12:24:33.444239 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 467756us
I20260709 12:24:33.414996  1788 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:33.377485  1857 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:33.468492 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:33.418473  1690 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.444314  1791 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.468919 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:33.471292 31507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.005s	sys 0.013s
I20260709 12:24:33.473764 31433 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:33.484746 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:33.368005  1822 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:33.488488 31466 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:33.490968 31394 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:24:33.501760 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:33.489193 31392 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:33.504437 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:33.510347 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:33.466557  1540 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:33.496083 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:33.511484 31467 raft_consensus.cc:2410] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:33.512996 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:33.518057 31466 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:33.518891 31433 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:33.513887 32079 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:33.514469 31392 raft_consensus.cc:2393] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:33.468084  1849 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:33.500268 31394 pending_rounds.cc:85] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 7
I20260709 12:24:33.549495 31394 pending_rounds.cc:107] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:24:33.549842 31394 raft_consensus.cc:2889] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:33.491356 31507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.005s	sys 0.014s
I20260709 12:24:33.381314  1762 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:33.550921 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 677651us
I20260709 12:24:33.551527 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:33.552498 31391 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:33.555050 31433 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:33.490044  1620 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.561859 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:33.505380  1833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.005s	sys 0.016s
I20260709 12:24:33.505151  1788 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:33.568557 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:33.624003 31436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.016s	sys 0.016s
W20260709 12:24:33.626026 31436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.017s	sys 0.017s
W20260709 12:24:33.629184 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 586649us
I20260709 12:24:33.632694 31436 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:33.550558  1770 consensus_meta.cc:287] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:24:33.520656  1777 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:33.461830  1874 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:33.469514  1671 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:33.564674  1833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.005s	sys 0.016s
I20260709 12:24:33.643767 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:33.516496  1799 consensus_queue.cc:1059] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 12:24:33.646155 31466 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:24:33.829888 31389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.020s	sys 0.030s
W20260709 12:24:33.839709 31389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.020s	sys 0.030s
I20260709 12:24:33.840385 31467 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
W20260709 12:24:33.744293 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.034s	sys 0.056s
W20260709 12:24:33.838838 31537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.018s	sys 0.029s
I20260709 12:24:33.548646  1690 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:33.841267 31537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.018s	sys 0.030s
W20260709 12:24:33.841518 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.034s	sys 0.069s
I20260709 12:24:33.842202 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1672) took 1385 ms. Trace:
I20260709 12:24:33.842692 31537 rpcz_store.cc:276] 0709 12:24:32.457101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.458031 (+   930us) service_pool.cc:224] Handling call
0709 12:24:32.526937 (+ 68906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.527201 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:32.589767 (+ 62566us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.841747 (+1251980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.841820 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.841899 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.841988 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.842136 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50432,"prepare.queue_time_us":69082,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":24180,"raft.queue_time_us":126620,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"spinlock_wait_cycles":61771648,"thread_start_us":1241514,"threads_started":2,"wal-append.queue_time_us":837795}
I20260709 12:24:33.848773 31361 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:33.862151 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 345) took 1017 ms. Trace:
I20260709 12:24:33.862758 31466 rpcz_store.cc:276] 0709 12:24:32.844451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.861122 (+1016671us) service_pool.cc:224] Handling call
0709 12:24:33.861496 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.861710 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.861759 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.861812 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:33.861865 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.861935 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.862083 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.872351 32076 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:33.568651  1837 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:33.877892 31393 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:33.707042  1786 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.899861 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 347) took 1013 ms. Trace:
I20260709 12:24:33.713527  1788 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:33.644958  1849 raft_consensus.cc:697] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:33.711530  1821 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:33.646377  1770 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:33.569360  1620 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.568424  1724 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.307s
W20260709 12:24:33.898037 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.014s	sys 0.049s
I20260709 12:24:33.900450 31466 rpcz_store.cc:276] 0709 12:24:32.870709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.883128 (+1012419us) service_pool.cc:224] Handling call
0709 12:24:33.883495 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.883694 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.883739 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.883794 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:33.883863 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.883934 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.884068 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:33.899021  1767 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.516s	user 0.016s	sys 0.000s
I20260709 12:24:33.829659  1880 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:24:33.567989  1857 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.876364  1866 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:24:33.879132  1799 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
W20260709 12:24:33.922005 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.015s	sys 0.049s
W20260709 12:24:34.052338 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.090234 31466 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:34.085433 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 433) took 1045 ms. Trace:
W20260709 12:24:33.991851 32047 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.019s	sys 0.050s
I20260709 12:24:34.087209 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:34.089080 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 795444us
I20260709 12:24:33.876694  1873 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
I20260709 12:24:34.186156 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1729) took 3941 ms. Trace:
W20260709 12:24:33.922096 31540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.002s	sys 0.066s
W20260709 12:24:34.188241 32047 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.024s	sys 0.066s
I20260709 12:24:33.936444 31467 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:34.093654 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1600) took 1210 ms. Trace:
I20260709 12:24:34.193724 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 346) took 1338 ms. Trace:
I20260709 12:24:34.200101 31467 rpcz_store.cc:276] 0709 12:24:32.855529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.882714 (+1027185us) service_pool.cc:224] Handling call
0709 12:24:33.936187 (+ 53473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.193496 (+257309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.193673 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:34.031246 31434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.004s	sys 0.017s
W20260709 12:24:34.190568 31540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.009s	sys 0.073s
W20260709 12:24:34.194656 31436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.044s
W20260709 12:24:34.191294 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 723580us
W20260709 12:24:34.204716 31436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.045s
I20260709 12:24:34.205046 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1668) took 1887 ms. Trace:
I20260709 12:24:34.018277 31391 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.194080 31466 rpcz_store.cc:276] 0709 12:24:32.883079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.921869 (+1038790us) service_pool.cc:224] Handling call
0709 12:24:34.090015 (+168146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.091055 (+  1040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.093585 (+  2530us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:34.066622  1870 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:24:34.091172 31393 rpcz_store.cc:276] 0709 12:24:33.039659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.319217 (+279558us) service_pool.cc:224] Handling call
0709 12:24:33.373394 (+ 54177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.878387 (+504993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.085110 (+206723us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b540033d1d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:34.085357 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159658240}
I20260709 12:24:34.077508 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1597) took 1214 ms. Trace:
I20260709 12:24:34.211758 31469 rpcz_store.cc:276] 0709 12:24:32.863553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.177420 (+313867us) service_pool.cc:224] Handling call
0709 12:24:34.077258 (+899838us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b5400018e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:34.077434 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74124544}
I20260709 12:24:34.190589 31388 raft_consensus.cc:2410] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:34.214787 31470 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
W20260709 12:24:34.025550 31359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.014s
W20260709 12:24:34.205289 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 572661us
W20260709 12:24:34.206707 31538 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.005s	sys 0.011s
W20260709 12:24:34.217161 31538 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.005s	sys 0.011s
W20260709 12:24:33.964401 31508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.009s	sys 0.046s
W20260709 12:24:34.217927 31508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.010s	sys 0.047s
W20260709 12:24:34.207095 31507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.009s	sys 0.009s
W20260709 12:24:34.222429 31507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.009s	sys 0.009s
W20260709 12:24:34.222890 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 669810us
I20260709 12:24:34.223767 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:34.224629 31359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.012s	sys 0.014s
W20260709 12:24:34.207696 31434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.007s	sys 0.019s
I20260709 12:24:34.188762 31468 rpcz_store.cc:276] 0709 12:24:30.244809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.244947 (+   138us) service_pool.cc:224] Handling call
0709 12:24:30.249599 (+  4652us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:30.250084 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.250131 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:32.352307 (+2102176us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b2c00000a78. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc5372 00007f6e912f7a01 00007f6e912bc43a 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2
0709 12:24:32.353037 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 12:24:32.636412 (+283375us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:32.636484 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.636591 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.185011 (+1548420us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b24002ae888. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0559c4 00007f6e8e053acb 00007f6e8e20edc9 00007f6e8e20ea55 00007f6e8e20dfb0 00007f6e90e84488 00007f6e90e84be8 00007f6e90e5c398 00007f6e90e5776a 00007f6e90e56bb6
0709 12:24:34.185912 (+   901us) raft_consensus.cc:1685] finished
0709 12:24:34.185936 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.186077 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2555,"raft.queue_time_us":431841,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10107,"spinlock_wait_cycles":1285707520,"thread_start_us":282903,"threads_started":1,"wal-append.queue_time_us":679437}
I20260709 12:24:33.906750  1837 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:34.184653  1881 log.cc:927] Time spent T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
W20260709 12:24:34.185320  1883 log.cc:927] Time spent T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
W20260709 12:24:34.186218  1717 consensus_meta.cc:287] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.807s	user 0.011s	sys 0.008s
W20260709 12:24:34.067284  1872 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:24:34.267764 31541 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:24:34.000490 31395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.021s	sys 0.047s
W20260709 12:24:34.270336 31395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.025s	sys 0.050s
I20260709 12:24:34.059626  1671 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:33.975618  1770 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:34.226249 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 1.20695e+06us
I20260709 12:24:34.076092  1815 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:34.067839  1865 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
W20260709 12:24:34.183836  1871 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
W20260709 12:24:33.988240  1864 log.cc:927] Time spent T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
W20260709 12:24:34.227893 31388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1695) took 1345 ms (client timeout 1688 ms). Trace:
I20260709 12:24:33.913754  1786 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:34.207355 31433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.012s	sys 0.004s
W20260709 12:24:34.307219 31433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.012s	sys 0.004s
W20260709 12:24:34.307591 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 752563us
I20260709 12:24:34.300081  1686 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.313166 32079 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:33.906850  1792 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.021s	sys 0.032s
W20260709 12:24:33.906760  1800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.017s	sys 0.034s
I20260709 12:24:33.934631  1788 raft_consensus.cc:697] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:34.315886  1788 consensus_queue.cc:237] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:34.205400 31540 rpcz_store.cc:276] 0709 12:24:32.317546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.335026 (+ 17480us) service_pool.cc:224] Handling call
0709 12:24:32.346367 (+ 11341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.346673 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:32.636920 (+290247us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.204711 (+1567791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.204774 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:34.204825 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.204888 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.204999 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23387,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":151318,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4732,"thread_start_us":1857136,"threads_started":3,"wal-append.queue_time_us":866591}
I20260709 12:24:34.319777 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:34.321019 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:34.321520 31540 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.065212  1737 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.323685  1737 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:34.325968  1737 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:34.262125  1620 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:34.263480 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 343) took 1440 ms. Trace:
I20260709 12:24:34.046381  1863 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:34.275957 31469 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:34.108455  1840 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:34.194080  1434 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.328013 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1602) took 1404 ms. Trace:
I20260709 12:24:34.327095 31463 rpcz_store.cc:276] 0709 12:24:32.823026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.823761 (+   735us) service_pool.cc:224] Handling call
0709 12:24:32.834693 (+ 10932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.835030 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:32.835379 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.257978 (+422599us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.280000 (+ 22022us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.280177 (+   177us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:33.280224 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.280308 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.263193 (+982885us) raft_consensus.cc:1685] finished
0709 12:24:34.263220 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.263405 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":158879,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":177,"spinlock_wait_cycles":2944,"thread_start_us":422226,"threads_started":1,"wal-append.queue_time_us":740845}
I20260709 12:24:34.328474 31469 rpcz_store.cc:276] 0709 12:24:32.923256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.275262 (+1352006us) service_pool.cc:224] Handling call
0709 12:24:34.275671 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.327645 (+ 51974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.327943 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.329279 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:34.252897  1837 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.331933  1837 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.332069 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:34.262655  1899 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:34.297375 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 448703us
I20260709 12:24:34.332985 31392 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:34.333128  1899 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:33.906589  1875 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:34.335515  1875 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:34.337816  1875 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:34.185721  1878 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:34.338449  1878 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:34.299511 31388 rpcz_store.cc:269] 0709 12:24:32.882853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.086824 (+1203971us) service_pool.cc:224] Handling call
0709 12:24:34.227828 (+141004us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.228034 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:34.301766 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 78107.8us
I20260709 12:24:34.342957 31507 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:34.345383  1878 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:34.303494 31434 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:34.260262  1570 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.002s	sys 0.010s
I20260709 12:24:34.313308 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:34.346817  1899 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:33.926944  1761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.011s
I20260709 12:24:34.314618 32084 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:34.333441 31361 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:34.298285 31391 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:34.331059 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1608) took 1313 ms. Trace:
W20260709 12:24:34.352969  1761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.009s	sys 0.019s
I20260709 12:24:34.354460 31463 rpcz_store.cc:276] 0709 12:24:33.017340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.330313 (+1312973us) service_pool.cc:224] Handling call
0709 12:24:34.330580 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.330760 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.330783 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.330826 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:34.330862 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.330915 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.331010 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:34.370841  1800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.017s	sys 0.042s
W20260709 12:24:34.371061  1792 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.028s	sys 0.033s
I20260709 12:24:33.918252  1821 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:34.401777 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 88207.6us
I20260709 12:24:34.402096 31542 raft_consensus.cc:3055] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:34.402559 31542 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:34.402904 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1694) took 1520 ms. Trace:
I20260709 12:24:34.403457 31389 rpcz_store.cc:276] 0709 12:24:32.882585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.293636 (+411051us) service_pool.cc:224] Handling call
0709 12:24:33.312783 (+ 19147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.313022 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:33.840275 (+527253us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.402129 (+561854us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.402348 (+   219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.402453 (+   105us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:34.402531 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.402614 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.402828 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":744324,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":91606,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":34635,"thread_start_us":1085764,"threads_started":3}
W20260709 12:24:34.406024 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 72664.6us
W20260709 12:24:34.406765 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 103366us
I20260709 12:24:34.406991 31361 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:34.407459 31434 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:34.408125 31361 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:34.414749 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:34.415845 31541 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:34.299180  1857 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.295287  1671 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.428916 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 428) took 2044 ms. Trace:
I20260709 12:24:34.438733 31387 rpcz_store.cc:276] 0709 12:24:32.384727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.870354 (+485627us) service_pool.cc:224] Handling call
0709 12:24:32.919479 (+ 49125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.004471 (+ 84992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.004503 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.020159 (+ 15656us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.469503 (+449344us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:33.469545 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.469609 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.428701 (+959092us) raft_consensus.cc:1685] finished
0709 12:24:34.428721 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.428856 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83963,"raft.queue_time_us":84445,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11406,"thread_start_us":414029,"threads_started":1,"wal-append.queue_time_us":791078}
I20260709 12:24:34.417483 31542 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:34.435292 31434 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:34.441057 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:34.436033  1899 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.441162 31542 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.427346  1800 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:34.042788  1882 consensus_queue.cc:1059] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.388s
I20260709 12:24:34.059813  1877 consensus_queue.cc:1059] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.371s
I20260709 12:24:34.280365  1717 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:34.405431  1620 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:34.429096  1872 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:24:34.438300  1835 consensus_meta.cc:287] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 2.008s	user 0.011s	sys 0.004s
I20260709 12:24:34.295447  1770 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:34.407613  1874 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:34.508363 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 71739.2us
I20260709 12:24:34.057070  1849 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:34.769469 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:34.770176 31387 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:34.422161  1761 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:34.510881 31433 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:34.295532  1815 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:34.553321 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 142752us
I20260709 12:24:34.457159  1799 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.598680 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:34.422760  1737 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:24:34.600982 31386 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:34.603789 31540 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
W20260709 12:24:34.608536 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 143478us
I20260709 12:24:34.610030 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 430) took 1799 ms. Trace:
I20260709 12:24:34.805608 31539 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:34.514361  1890 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:34.523340  1899 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:34.625922 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.622618  1893 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.229s
I20260709 12:24:34.629657  1895 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.458571  1671 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:34.612948  1724 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.665792  1894 consensus_queue.cc:1059] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.207s
I20260709 12:24:34.460422  1800 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:34.672919  1897 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:34.673243  1854 log.cc:927] Time spent T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 1.790s	user 0.006s	sys 0.000s
W20260709 12:24:34.678174 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 224121us
W20260709 12:24:34.647429  1771 consensus_meta.cc:287] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.211s	user 0.010s	sys 0.000s
W20260709 12:24:34.651371  1791 consensus_meta.cc:287] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.163s	user 0.006s	sys 0.006s
I20260709 12:24:34.515214  1620 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:34.422281  1863 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:34.400919  1777 consensus_queue.cc:1059] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:24:34.772179 31510 leader_election.cc:400] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:34.725337  1450 raft_consensus.cc:3055] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:33.460469 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:34.781874 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.782131 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:34.789958 31361 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:34.795604 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 284915us
I20260709 12:24:34.673801  1837 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:34.805553 31395 rpcz_store.cc:276] 0709 12:24:32.810165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.252654 (+442489us) service_pool.cc:224] Handling call
0709 12:24:33.252957 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.253141 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:34.283863 (+1030722us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.609584 (+325721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.609650 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:34.609716 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.609805 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.609955 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26270,"prepare.queue_time_us":804025,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"thread_start_us":1303338,"threads_started":3,"wal-append.queue_time_us":454707}
I20260709 12:24:35.009024 31510 leader_election.cc:403] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:34.983706 31392 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:35.010574 31359 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:35.009613  1450 raft_consensus.cc:740] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:34.890170 31292 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:35.011935  1450 consensus_queue.cc:260] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.012545 31292 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 5 to 6, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 6 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:35.010496 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.014392 31292 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 4 to 5, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:34.903844  1792 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.015916  1771 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.015813 31292 catalog_manager.cc:5697] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 3 to 4, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 4 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:34.905133 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 323) took 2725 ms. Trace:
I20260709 12:24:34.933851  1786 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:35.018077 31535 rpcz_store.cc:276] 0709 12:24:32.179845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.180445 (+   600us) service_pool.cc:224] Handling call
0709 12:24:32.189523 (+  9078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.193361 (+  3838us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:32.473820 (+280459us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.464207 (+990387us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.469909 (+  5702us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.470058 (+   149us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:33.470104 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.470277 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.904859 (+1434582us) raft_consensus.cc:1685] finished
0709 12:24:34.904887 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.905057 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10730,"prepare.queue_time_us":176479,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":328222,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":32508,"thread_start_us":1095459,"threads_started":2,"wal-append.queue_time_us":1032226}
I20260709 12:24:35.009526 31434 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:35.018462 31292 catalog_manager.cc:5697] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 5, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 5 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.022022 31292 catalog_manager.cc:5697] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.024519 31292 catalog_manager.cc:5697] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 3, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:35.039073 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 267036us
W20260709 12:24:34.824146  1686 consensus_meta.cc:287] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.511s	user 0.001s	sys 0.010s
I20260709 12:24:35.060027 31510 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:35.060886 31507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.009s	sys 0.007s
I20260709 12:24:35.027616 31433 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:34.818853  1874 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:34.997262  1909 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:24:35.061261 31507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.009s	sys 0.007s
I20260709 12:24:35.082089 31465 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:24:35.082756 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 739806us
I20260709 12:24:35.083536 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:35.085280 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 57749.7us
I20260709 12:24:34.811914  1904 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.984581  1821 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:35.092489 31510 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:35.077346  1788 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.080227  1835 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.830160  1899 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.062280  1932 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:34.782585  1761 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:34.836360  1890 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.122053 31507 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:35.132614 31507 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:35.133849 31507 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:35.099510  1799 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:35.095659  1863 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:35.106913  1866 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:35.080389  1792 consensus_queue.cc:1059] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:24:35.100876  1873 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.130671 31292 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:35.134462 31291 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38064 (request call id 249) took 18557 ms (client timeout 15000 ms). Trace:
I20260709 12:24:35.147913 31507 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:35.149539  1903 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.483s	user 0.001s	sys 0.000s
W20260709 12:24:35.150753  1910 log.cc:927] Time spent T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
W20260709 12:24:35.147485 31291 rpcz_store.cc:269] 0709 12:24:16.532658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.533085 (+   427us) service_pool.cc:224] Handling call
0709 12:24:35.081773 (+18548688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:26.539720 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:26.819770 (+280050us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:26.824716 (+  4946us) write_op.cc:435] Acquired schema lock
0709 12:24:26.826909 (+  2193us) tablet.cc:662] Decoding operations
0709 12:24:26.846925 (+ 20016us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:26.847005 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:26.847035 (+    30us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:24:26.849374 (+  2339us) tablet.cc:701] Row locks acquired
0709 12:24:26.849420 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:24:26.849605 (+   185us) write_op.cc:270] Start()
0709 12:24:26.849747 (+   142us) write_op.cc:276] Timestamp: P: 1783599866849542 usec, L: 0
0709 12:24:26.849763 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:24:26.895010 (+ 45247us) log.cc:844] Serialized 11092 byte log entry
0709 12:24:26.924366 (+ 29356us) op_driver.cc:464] REPLICATION: finished
0709 12:24:27.320319 (+395953us) write_op.cc:301] APPLY: starting
0709 12:24:27.320467 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:27.321378 (+   911us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:27.321571 (+   193us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:27.556584 (+235013us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:27.639651 (+ 83067us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 12:24:27.639698 (+    47us) write_op.cc:312] APPLY: finished
0709 12:24:27.640314 (+   616us) log.cc:844] Serialized 188 byte log entry
0709 12:24:27.640514 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:27.641148 (+   634us) write_op.cc:454] Released schema lock
0709 12:24:27.641225 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:27.641696 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:27.641722 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":108250,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":386384,"apply.run_cpu_time_us":10473,"apply.run_wall_time_us":321395,"num_ops":28,"prepare.queue_time_us":517414,"prepare.run_cpu_time_us":12957,"prepare.run_wall_time_us":411037,"raft.queue_time_us":4907,"raft.run_cpu_time_us":30946,"raft.run_wall_time_us":368999,"replication_time_us":74448,"spinlock_wait_cycles":46336,"thread_start_us":640752,"threads_started":4,"wal-append.queue_time_us":21030,"wal-append.run_cpu_time_us":8927,"wal-append.run_wall_time_us":1729742}]]}
W20260709 12:24:35.136862 31542 consensus_meta.cc:287] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.694s	user 0.005s	sys 0.005s
I20260709 12:24:35.134411  1799 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:35.126358 31510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.551s (SENT) [suppressed 25 similar messages]
I20260709 12:24:35.096084  1926 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5.
I20260709 12:24:35.123760  1835 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:34.844599  1895 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.144321 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1706) took 2223 ms. Trace:
I20260709 12:24:35.168615 31538 rpcz_store.cc:276] 0709 12:24:32.920990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.922476 (+  1486us) service_pool.cc:224] Handling call
0709 12:24:33.013887 (+ 91411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.497011 (+483124us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:34.217656 (+720645us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.746134 (+528478us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.764612 (+ 18478us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.764865 (+   253us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:34.764916 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.765006 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.144091 (+379085us) raft_consensus.cc:1685] finished
0709 12:24:35.144111 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.144250 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78869,"prepare.queue_time_us":1241439,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":836970,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":47009,"thread_start_us":1546184,"threads_started":4,"wal-append.queue_time_us":339557}
I20260709 12:24:35.108402  1506 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.062073  1897 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.151959  1714 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:35.152647  1890 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:35.152771  1761 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:35.135133  1791 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:35.154232  1912 log.cc:927] Time spent T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.469s	user 0.000s	sys 0.001s
I20260709 12:24:35.154536  1888 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.155483  1770 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:35.155239  1931 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:24:35.155938  1896 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:35.156798  1936 consensus_queue.cc:1059] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:35.157521  1930 raft_consensus.cc:3055] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:35.096320  1686 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:35.118811  1717 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:35.174367 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 163871us
I20260709 12:24:35.263567 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:35.264679 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:35.193413 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:35.195775 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:35.197182 31292 catalog_manager.cc:5697] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 4 to 5, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 5 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.181209  1506 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.130987  1877 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:24:35.167203  1799 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.158564  1815 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:35.217607 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 333) took 3324 ms. Trace:
I20260709 12:24:35.180128  1827 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.221946  1890 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:35.220475  1934 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.224818 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:35.225270  1620 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:35.226251  1671 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:35.143172  1863 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:35.221257 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 62028.7us
I20260709 12:24:35.196035  1866 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:35.184752 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 394868us
W20260709 12:24:35.309660 31466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.017s	sys 0.015s
W20260709 12:24:35.634140 31466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.017s	sys 0.015s
I20260709 12:24:35.634256 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:35.311561 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 44331.3us
I20260709 12:24:35.219858  1926 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.265313 31392 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:35.322057  1882 raft_consensus.cc:3055] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:35.322543 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 336) took 1013 ms. Trace:
I20260709 12:24:35.639385 31542 rpcz_store.cc:276] 0709 12:24:34.309627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.310340 (+   713us) service_pool.cc:224] Handling call
0709 12:24:34.310599 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.322123 (+1011524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.322155 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:35.322203 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:35.322242 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.322326 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.322478 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53192,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":13857,"thread_start_us":154749,"threads_started":1}
I20260709 12:24:35.321520 31292 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 3 to 4, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 4 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:35.351308 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.532485 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.533653 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 407302us
I20260709 12:24:35.535756 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:35.642594 31393 raft_consensus.cc:2393] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:35.537367 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:35.643103 31535 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:35.531904 31461 rpcz_store.cc:276] 0709 12:24:31.893738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.893945 (+   207us) service_pool.cc:224] Handling call
0709 12:24:31.907144 (+ 13199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.907572 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.907614 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.908135 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.310398 (+402263us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:32.363662 (+ 53264us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.363896 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.363966 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.289927 (+1925961us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:35.196735 (+906808us) raft_consensus.cc:1685] finished
0709 12:24:35.217393 (+ 20658us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.217546 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52944,"prepare.queue_time_us":54617,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":100406,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":191,"spinlock_wait_cycles":3949312,"thread_start_us":356177,"threads_started":1,"wal-append.queue_time_us":754003}
I20260709 12:24:35.616798 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:35.618326 31395 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:35.259109  1930 raft_consensus.cc:740] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:35.620927 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:35.646549 31538 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.260419  1770 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.215245  1791 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:35.636654  1928 log.cc:927] Time spent T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.541s	user 0.001s	sys 0.000s
I20260709 12:24:35.321580  1506 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.527576 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:35.658689 31387 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:35.636996  1925 raft_consensus.cc:3055] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:35.312209  1686 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.698204 31292 catalog_manager.cc:5697] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 2, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.653088 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.637312  1866 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.684504  1767 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.687531  1788 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.688216  1900 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:35.639133  1882 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:35.227423  1896 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:35.689333 31470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1591) took 2842 ms (client timeout 1740 ms). Trace:
I20260709 12:24:35.691891 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1605) took 2767 ms. Trace:
W20260709 12:24:35.729975 31470 rpcz_store.cc:269] 0709 12:24:32.846515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.883303 (+ 36788us) service_pool.cc:224] Handling call
0709 12:24:35.689149 (+2805846us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000fa5d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:35.689253 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675649920}
I20260709 12:24:35.730098 31468 rpcz_store.cc:276] 0709 12:24:32.924703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.691101 (+2766398us) service_pool.cc:224] Handling call
0709 12:24:35.691435 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.691599 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.691622 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:35.691662 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:35.691700 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.691751 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.691840 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:35.699710 32076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 512) took 3268 ms. Trace:
I20260709 12:24:35.731876 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.732025 32076 rpcz_store.cc:276] 0709 12:24:32.431184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.436480 (+  5296us) service_pool.cc:224] Handling call
0709 12:24:32.436793 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.872873 (+1436080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.699420 (+1826547us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540054f954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:35.699614 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3300880128}
I20260709 12:24:35.700994 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:35.734108 31464 raft_consensus.cc:2410] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:24:35.660086  1927 log.cc:927] Time spent T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.587s	user 0.001s	sys 0.000s
I20260709 12:24:35.719413 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.737035 31461 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:35.715850  1866 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.739787  1917 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:35.740348  1917 raft_consensus.cc:697] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:35.741242  1917 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.691865  1835 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:35.743369  1945 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.424s	user 0.001s	sys 0.001s
I20260709 12:24:35.743785  1791 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:35.744799  1929 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:24:35.655550  1849 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.737991 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.746592 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1717) took 1429 ms. Trace:
I20260709 12:24:35.752213 31541 rpcz_store.cc:276] 0709 12:24:34.317147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.425897 (+108750us) service_pool.cc:224] Handling call
0709 12:24:34.426219 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.745882 (+319663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.745931 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.759447 (+ 13516us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.183737 (+424290us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:35.183777 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.183840 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.746394 (+562554us) raft_consensus.cc:1685] finished
0709 12:24:35.746415 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.746537 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354321,"raft.queue_time_us":496141,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":31650,"thread_start_us":367256,"threads_started":1,"wal-append.queue_time_us":446066}
I20260709 12:24:35.747128 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1603) took 2823 ms. Trace:
I20260709 12:24:35.657456  1838 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.754359 31467 rpcz_store.cc:276] 0709 12:24:32.923600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.278925 (+1355325us) service_pool.cc:224] Handling call
0709 12:24:34.308287 (+ 29362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.406608 (+ 98321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.406638 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.407060 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.903828 (+496768us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:34.903867 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.903946 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.746931 (+842985us) raft_consensus.cc:1685] finished
0709 12:24:35.746948 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.747075 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97501,"raft.queue_time_us":97802,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":13392,"thread_start_us":378013,"threads_started":1,"wal-append.queue_time_us":740149}
W20260709 12:24:35.750247 31464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1595) took 2902 ms (client timeout 2809 ms). Trace:
I20260709 12:24:35.757004 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.759188 31461 raft_consensus.cc:2393] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:35.759912 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 124698us
I20260709 12:24:35.668066  1925 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:35.763064 31292 catalog_manager.cc:5697] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:24:35.756572 31464 rpcz_store.cc:269] 0709 12:24:32.847564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.430807 (+583243us) service_pool.cc:224] Handling call
0709 12:24:35.700792 (+2269985us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:35.750152 (+ 49360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11561344}
I20260709 12:24:35.776600 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.777622 31461 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:35.746389  1857 consensus_meta.cc:287] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.307s	user 0.010s	sys 0.002s
I20260709 12:24:35.779834 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.655725  1770 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.789242 31470 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
W20260709 12:24:35.790325 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 156143us
I20260709 12:24:35.792025 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.786373 31538 raft_consensus.cc:2410] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:35.794788 31361 connection.cc:256] RPC call timeout handler was delayed by -1.8652633450001304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 12:24:35.796978 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:35.798499 32075 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:35.803650 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.804251 31461 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
W20260709 12:24:35.804795 31544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.036s	sys 0.080s
W20260709 12:24:35.805472 31544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.036s	sys 0.080s
I20260709 12:24:35.766645  1835 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.735304  1767 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.808290 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:35.808851 31361 connection.cc:256] RPC call timeout handler was delayed by -1.6924633450003057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:24:35.817173 31361 connection.cc:256] RPC call timeout handler was delayed by -1.6852633450002941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 12:24:35.807538 31292 catalog_manager.cc:5697] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 3, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.812088 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.728506  1788 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.819787 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:35.817631 31361 connection.cc:256] RPC call timeout handler was delayed by -1.6510633450002388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 12:24:35.804839  1717 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:35.728394  1900 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.825057 32084 raft_consensus.cc:2410] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:35.766404  1849 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:35.822371 31361 connection.cc:256] RPC call timeout handler was delayed by -1.6051633450001646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 12:24:35.826692 31461 raft_consensus.cc:2393] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:35.806704  1827 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:35.834085 31507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.001s	sys 0.023s
W20260709 12:24:35.837080 31507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.001s	sys 0.023s
W20260709 12:24:35.837320 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.837927 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 690017us
W20260709 12:24:35.838181 31361 connection.cc:256] RPC call timeout handler was delayed by -1.5376633450000554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 12:24:35.838758 31361 connection.cc:256] RPC call timeout handler was delayed by -1.5133633450000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 12:24:35.839179 31361 connection.cc:256] RPC call timeout handler was delayed by -1.5007633449999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:24:35.840005 31361 connection.cc:256] RPC call timeout handler was delayed by -1.4152633450003123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:24:35.840349 31361 connection.cc:256] RPC call timeout handler was delayed by -1.4026633450002919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 12:24:35.840706 31361 connection.cc:256] RPC call timeout handler was delayed by -1.3450633450001988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 12:24:35.841122 31361 connection.cc:256] RPC call timeout handler was delayed by -1.3427801220000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 12:24:35.838878 31507 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:35.841485 31361 connection.cc:256] RPC call timeout handler was delayed by -1.2811633450000954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:24:35.846243 31361 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:35.833165  1873 consensus_meta.cc:287] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.000s
I20260709 12:24:35.822058 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.777858  1838 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.857208 31464 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:35.847851 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:35.851253 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.856478 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.859726 31468 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:35.842706 31507 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:35.861362 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:35.862780 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.813877  1938 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:24:35.817610  1835 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.856328  1792 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.864853 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:35.849021  1923 log.cc:927] Time spent T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.539s	user 0.000s	sys 0.001s
I20260709 12:24:35.836889  1717 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:35.840077  1952 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.843472  1895 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:35.867280 31464 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:35.805279 31541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:35.876039 31541 raft_consensus.cc:606] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:35.876379 31541 raft_consensus.cc:614] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:35.869313 31507 leader_election.cc:400] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 3 election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4.
I20260709 12:24:35.860869  1873 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:35.872933 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:35.849541  1919 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:35.880350  1937 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.488s	user 0.000s	sys 0.000s
I20260709 12:24:35.880602  1918 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.865947  1764 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:35.845669  1827 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.803524  1882 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.887969  1933 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.888783 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.889578 31464 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:35.889925 31507 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:35.892424 31541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:35.892989 31541 raft_consensus.cc:606] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:35.893297 31541 raft_consensus.cc:614] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:35.893544  1939 log.cc:927] Time spent T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 12:24:35.893874  1892 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:24:35.897115 31465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1604) took 2973 ms (client timeout 2118 ms). Trace:
I20260709 12:24:35.898459  1905 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:35.901322 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1712) took 1682 ms. Trace:
I20260709 12:24:35.928879 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1601) took 3006 ms. Trace:
I20260709 12:24:35.888468  1671 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.902531 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 337) took 1592 ms. Trace:
I20260709 12:24:35.882720  1919 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:35.919847 31465 rpcz_store.cc:269] 0709 12:24:32.923872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.404711 (+480839us) service_pool.cc:224] Handling call
0709 12:24:35.896934 (+2492223us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540012ff54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:35.897043 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3855490304}
I20260709 12:24:35.921483 31507 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:35.922688 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:35.923494 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.930881 31543 rpcz_store.cc:276] 0709 12:24:34.310000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.340369 (+ 30369us) service_pool.cc:224] Handling call
0709 12:24:34.340696 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.416763 (+ 76067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.416809 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.417253 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.513249 (+ 95996us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:34.513299 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.513392 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.902277 (+1388885us) raft_consensus.cc:1685] finished
0709 12:24:35.902303 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.902461 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171303,"raft.queue_time_us":431815,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4256,"thread_start_us":45286,"threads_started":1,"wal-append.queue_time_us":748792}
I20260709 12:24:35.932243 31464 raft_consensus.cc:2410] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:35.911696  1686 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:35.929379 31466 rpcz_store.cc:276] 0709 12:24:32.922899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.227688 (+1304789us) service_pool.cc:224] Handling call
0709 12:24:34.300631 (+ 72943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.432460 (+131829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.432487 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.432900 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.634767 (+1201867us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:35.644844 (+ 10077us) log.cc:844] Serialized 14 byte log entry
0709 12:24:35.928560 (+283716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.928648 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.928690 (+    42us) raft_consensus.cc:1685] finished
0709 12:24:35.928705 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.928824 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44757,"prepare.queue_time_us":10242,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"raft.queue_time_us":166938,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5274,"thread_start_us":1395018,"threads_started":2,"wal-append.queue_time_us":1224379}
W20260709 12:24:35.942256  1690 consensus_meta.cc:287] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 2.081s	user 0.013s	sys 0.000s
I20260709 12:24:35.943310 31463 raft_consensus.cc:2410] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:35.928572 31544 rpcz_store.cc:276] 0709 12:24:34.219311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.219462 (+   151us) service_pool.cc:224] Handling call
0709 12:24:34.228363 (+  8901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.299937 (+ 71574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.300007 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.405348 (+105341us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.157697 (+752349us) spinlock_profiling.cc:243] Waited 1e+03 us on lock 0x7b180035eb40. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:24:35.806760 (+649063us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:35.806812 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.806904 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.900973 (+ 94069us) raft_consensus.cc:1685] finished
0709 12:24:35.901001 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.901253 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":327527,"raft.queue_time_us":210291,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":7563,"spinlock_wait_cycles":2299136,"thread_start_us":648044,"threads_started":1,"wal-append.queue_time_us":1425059}
I20260709 12:24:35.881156  1918 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.947306 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:35.944954 31507 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:35.947407 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.948134 31465 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:35.948937 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.949131 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:35.949519 31465 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:35.918982  1873 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:35.941664 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.950891 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:35.951756 31393 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:35.951171 31466 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:35.955111 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.956049 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1740) took 1062 ms. Trace:
I20260709 12:24:35.956547 31465 rpcz_store.cc:276] 0709 12:24:34.893360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.954925 (+1061565us) service_pool.cc:224] Handling call
0709 12:24:35.955980 (+  1055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:35.930802  1840 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.928289  1838 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:35.958840 31361 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:35.959400 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.961885 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.965332 31466 raft_consensus.cc:2410] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:35.965430 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:35.965901 31510 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:35.966171 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:35.946084  1946 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:35.943434  1905 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.883584  1952 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.934749  1919 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.972386 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:35.967707 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:35.974256 31361 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:35.945470  1778 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.954227  1873 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.953836  1863 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:35.970506 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:35.959472  1890 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.973006 31544 raft_consensus.cc:606] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:35.988015 31544 raft_consensus.cc:614] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:35.988441  1961 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.962996  1938 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:35.969072  1770 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:35.946686  1896 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:35.957839 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:35.984911  1873 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.976655 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:35.965081 31464 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:35.989104  1961 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.994215  1931 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.994346  1956 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:24:35.983752  1764 raft_consensus.cc:697] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:35.954372  1717 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:35.995043  1827 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:35.967667  1788 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:35.976869  1917 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.995291  1920 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.972461  1946 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:35.969343  1671 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.969218  1933 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.987380  1799 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:35.998148 31461 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:36.000248 31465 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:36.001219 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:36.001513 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 52706.5us
I20260709 12:24:35.976406  1815 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.989131  1914 raft_consensus.cc:3055] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:35.997761  1900 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:36.013882 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:36.003872  1905 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:36.027902  1938 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:36.029521  1905 raft_consensus.cc:697] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:36.029592  1938 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.030177  1938 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.013929 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1735) took 1556 ms. Trace:
I20260709 12:24:35.984664  1778 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.025723 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:36.026505 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1732) took 1745 ms. Trace:
I20260709 12:24:36.027853 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:36.028276 31544 raft_consensus.cc:606] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:36.031498 31464 rpcz_store.cc:276] 0709 12:24:34.457397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.002542 (+1545145us) service_pool.cc:224] Handling call
0709 12:24:36.013431 (+ 10889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.013604 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.013630 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.013667 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:36.013704 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.013756 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.013871 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.041293 31467 raft_consensus.cc:2368] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6.
I20260709 12:24:36.013051  1835 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:36.044430  1918 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.044998  1815 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:36.046123  1757 raft_consensus.cc:3055] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:36.046548  1757 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:36.047434  1757 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.048573  1965 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:36.049139  1965 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.050218  1506 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.035989 31507 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:36.053719 31544 raft_consensus.cc:614] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:36.032568 31465 rpcz_store.cc:276] 0709 12:24:34.281058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.999442 (+1718384us) service_pool.cc:224] Handling call
0709 12:24:35.999732 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.026236 (+ 26504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.026451 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.055215 31465 raft_consensus.cc:1240] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:36.030606  1905 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:36.057673  1764 consensus_queue.cc:237] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:36.060375 32077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 519) took 3496 ms (client timeout 1863 ms). Trace:
W20260709 12:24:36.060783 32077 rpcz_store.cc:269] 0709 12:24:32.563973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.564098 (+   125us) service_pool.cc:224] Handling call
0709 12:24:36.060204 (+3496106us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54006aed54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:36.060304 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860960640}
I20260709 12:24:36.053263 31361 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:36.025853  1946 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.067911 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1739) took 1238 ms. Trace:
I20260709 12:24:36.068293 31465 rpcz_store.cc:276] 0709 12:24:34.829433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.054775 (+1225342us) service_pool.cc:224] Handling call
0709 12:24:36.055064 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.056200 (+  1136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.067860 (+ 11660us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:36.068837 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.071014 31361 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:36.072080  1964 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:36.070318 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1741) took 1146 ms. Trace:
I20260709 12:24:36.072533  1964 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.072923  1964 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.072808 31465 rpcz_store.cc:276] 0709 12:24:34.934483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.069589 (+1135106us) service_pool.cc:224] Handling call
0709 12:24:36.069856 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.070027 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.070051 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.070092 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:36.070124 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.070172 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.070267 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.067634  1815 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:36.078292 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1713) took 1316 ms. Trace:
I20260709 12:24:36.077032 31465 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:36.078617 31388 rpcz_store.cc:276] 0709 12:24:34.762216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.763012 (+   796us) service_pool.cc:224] Handling call
0709 12:24:34.763337 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.012953 (+249616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.012986 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.013451 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.084493 (+ 71042us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:36.065160 (+980667us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180044f620. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e90e644bc 00007f6e8e1b248b 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cc455 00007f6e94cb43c7 00007f6e912c69a7 00007f6e912d60bf
0709 12:24:36.065286 (+   126us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.065538 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.065606 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.070089 (+  4483us) raft_consensus.cc:1685] finished
0709 12:24:36.078124 (+  8035us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.078250 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24234,"prepare.queue_time_us":237798,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":374595,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11670,"spinlock_wait_cycles":26515840,"thread_start_us":401477,"threads_started":3,"wal-append.queue_time_us":144353}
I20260709 12:24:36.081558 31465 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:36.051294  1896 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:36.031998  1914 raft_consensus.cc:740] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:36.085178 31464 raft_consensus.cc:1240] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:36.080919  1815 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:36.086506  1901 raft_consensus.cc:3055] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:36.087131 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:36.089962 32047 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:36.090623 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:36.090940 31465 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:36.032922  1952 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.093501 31544 raft_consensus.cc:606] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:36.081790  1917 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:36.097966 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1736) took 1634 ms. Trace:
I20260709 12:24:36.096088 31544 raft_consensus.cc:614] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:36.098538 31464 rpcz_store.cc:276] 0709 12:24:34.463304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.056081 (+1592777us) service_pool.cc:224] Handling call
0709 12:24:36.085005 (+ 28924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.097400 (+ 12395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.097892 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.095666  1540 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:24:36.100719  1761 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:36.101096  1761 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.101471  1761 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.071360  1890 consensus_queue.cc:1059] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:24:36.069924  1866 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.096195 31465 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:36.105881  1911 log.cc:927] Time spent T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 1.257s	user 0.002s	sys 0.001s
I20260709 12:24:36.099522  1901 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:36.102777 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:36.117836  1489 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:36.117558  1815 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.118841  1489 tablet_bootstrap.cc:492] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:24:36.118767 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1731) took 1859 ms. Trace:
I20260709 12:24:36.119613  1922 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:24:36.119254 31466 rpcz_store.cc:276] 0709 12:24:34.261248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.985763 (+1724515us) service_pool.cc:224] Handling call
0709 12:24:35.986153 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:35.986554 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.986573 (+    19us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:35.998336 (+ 11763us) log.cc:844] Serialized 52 byte log entry
0709 12:24:36.026565 (+ 28229us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:36.026602 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.027391 (+   789us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.118545 (+ 91154us) raft_consensus.cc:1685] finished
0709 12:24:36.118570 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.118708 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1983,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":7802,"threads_started":1,"wal-append.queue_time_us":74538}
I20260709 12:24:36.121134  1922 raft_consensus.cc:3055] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:36.121515  1922 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:36.114498 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:36.069396  1920 consensus_queue.cc:1059] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:24:36.122311  1922 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.132848  1965 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:36.095723  1961 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:36.149011  1974 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:36.157133 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:36.152070 32047 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:36.189942 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:36.152422  1489 ts_tablet_manager.cc:1403] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 3.794s	user 0.111s	sys 0.197s
I20260709 12:24:36.190227 32076 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:24:36.196345 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:36.191176  1961 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.203050  1817 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.203374  1961 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.203781  1866 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:36.205348  1961 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.207419  1799 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.191874  1922 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.197834  1790 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:36.220413  1506 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:36.221406  1790 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.225859 31466 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:36.223698  1790 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.230465 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.231595 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.232491 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.233021 31461 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:36.233687 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.234200 31461 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:36.235397 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.236183 31466 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:36.237197 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.238474 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:36.239923 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.240677 31466 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:36.230007 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.281457 31465 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:36.282510 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.283299 31465 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:36.284404 31436 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:36.207631  1914 consensus_queue.cc:260] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.315943 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1756) took 1126 ms. Trace:
I20260709 12:24:36.314640  1434 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:36.324258  1790 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.324857 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1704) took 3405 ms. Trace:
I20260709 12:24:36.325446 31386 rpcz_store.cc:276] 0709 12:24:32.919515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.304893 (+385378us) service_pool.cc:224] Handling call
0709 12:24:33.365321 (+ 60428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.804641 (+1439320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.324564 (+1519923us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54003f2d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:36.324788 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840924928}
I20260709 12:24:36.328385  1917 raft_consensus.cc:3055] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:36.328836  1917 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:36.328933  1873 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.329882  1917 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.319145 31464 rpcz_store.cc:276] 0709 12:24:35.189666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.103141 (+913475us) service_pool.cc:224] Handling call
0709 12:24:36.129317 (+ 26176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.129569 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:36.145810 (+ 16241us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.302818 (+157008us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.305908 (+  3090us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.305955 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:36.315614 (+  9659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.315716 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.315868 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2856,"prepare.queue_time_us":18717,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":3497,"raft.queue_time_us":3787,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":107,"spinlock_wait_cycles":8379264,"thread_start_us":155396,"threads_started":1}
I20260709 12:24:36.338086  1790 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.348985 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:36.333079  1926 consensus_meta.cc:287] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.673s	user 0.000s	sys 0.010s
I20260709 12:24:36.308653  1901 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:36.536592 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.349792 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.371667 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.581089 31542 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:36.464669 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.342489  1930 consensus_queue.cc:260] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.366691 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.413110 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.583580 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.371937 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:36.370119 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.589006 31543 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:36.577241 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:36.579327 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:36.579821 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.590575 31465 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:36.406803 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 324287us
I20260709 12:24:36.590795 31466 raft_consensus.cc:2393] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:36.371658 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.594383 31541 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:36.594416 31391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1709) took 3109 ms (client timeout 2117 ms). Trace:
W20260709 12:24:36.595082 31391 rpcz_store.cc:269] 0709 12:24:33.484929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.561556 (+ 76627us) service_pool.cc:224] Handling call
0709 12:24:36.594213 (+3032657us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54000951d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:36.594337 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047640448}
I20260709 12:24:36.586192 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.596501 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:36.597391 31542 raft_consensus.cc:2410] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:36.602772 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.603056 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.603586 31543 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:36.604398 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.583434 31537 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:36.618430 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.619107 31466 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:36.620002 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.621646 31465 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:36.622750 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:36.623579 31465 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:36.623934 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.624766 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.623903 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:36.625659 31465 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:36.626680 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:36.630612 31461 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:36.620605 31466 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
I20260709 12:24:36.634382 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:36.634992 31389 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.642462 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:36.643678 31391 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:36.583986  1905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.014s	sys 0.023s
I20260709 12:24:36.581727  1917 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.648757 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:36.567312  1920 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.621254  1926 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.651942 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:36.651333  1905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.015s	sys 0.023s
I20260709 12:24:36.652215 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:36.652529 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:36.653059 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:36.681934 31391 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:36.654376  1933 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.655524 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.685683 31540 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:36.369745  1764 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.686533 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:36.593739  1717 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.549191  1873 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:36.371693  1791 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:36.599092  1800 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.680362 32079 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:36.694912 31536 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:36.628400  1885 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.684827 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:36.687795  1933 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.690117  1931 consensus_queue.cc:1059] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:36.650808  1901 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:36.692704 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.617760  1957 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.687175 31394 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:36.711216  1957 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.633419  1896 consensus_queue.cc:1059] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:24:36.699908 31391 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:36.714465  1926 raft_consensus.cc:1064] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:24:36.641060  1890 consensus_queue.cc:1059] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:24:36.668785  1849 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.716192 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:36.714743  1957 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:36.649123  1863 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:24:36.761466 31389 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:36.695405  1965 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.636271  1489 raft_consensus.cc:359] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:36.740546  1919 consensus_meta.cc:287] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
I20260709 12:24:36.780629 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.785868 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.678793  1920 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.694864  1764 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.706104  1791 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.706991  1885 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:36.836411 31470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1746) took 1737 ms (client timeout 1615 ms). Trace:
I20260709 12:24:36.814438 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:36.849174 31470 rpcz_store.cc:269] 0709 12:24:35.098821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.731539 (+632718us) service_pool.cc:224] Handling call
0709 12:24:36.836226 (+1104687us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54000faad4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:36.836346 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129894656}
I20260709 12:24:36.837812 31390 raft_consensus.cc:1240] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:36.816866  1938 consensus_meta.cc:287] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.786s	user 0.000s	sys 0.013s
I20260709 12:24:36.862502 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:36.772071  1489 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:24:36.699281  1717 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:36.822633  1761 consensus_meta.cc:287] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.003s
W20260709 12:24:36.861052  1922 consensus_meta.cc:287] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.001s
I20260709 12:24:36.832207  1888 raft_consensus.cc:3055] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:36.877640  1964 consensus_meta.cc:287] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.003s
W20260709 12:24:36.878684  1946 consensus_meta.cc:287] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.006s
I20260709 12:24:36.804795  1919 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.879627  1489 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:36.814067  1896 raft_consensus.cc:3055] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:36.840584  1897 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:36.883632 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:36.886894 31541 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:36.887051 31390 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:36.807919  1933 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:36.892715 32047 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:36.902246 31390 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:24:36.901254 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 269716us
I20260709 12:24:36.859831  1938 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.884290  1888 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:36.912987 31359 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:36.914381 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:36.914849 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.889287  1896 raft_consensus.cc:740] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:36.921671 31542 raft_consensus.cc:2410] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:36.931409 31542 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:36.933120 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.933804 31361 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:36.918483  1849 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:36.882833  1761 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.935848 31541 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:36.939649 31389 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:36.942811 31510 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:36.955390  1849 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:36.957046  1849 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.893369  1946 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:36.889599  1964 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:36.932816  1671 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:36.932545  1977 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:36.989084 32084 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:36.991741 31544 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:36.993251 31390 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:36.961970 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:36.951777  1714 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:37.000653 31538 raft_consensus.cc:2368] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8.
I20260709 12:24:36.935382  1890 consensus_queue.cc:1059] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:24:36.980952  1671 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.046519 31390 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:37.040067  1399 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:37.041874  1764 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:37.044935  1489 ts_tablet_manager.cc:1434] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.846s	user 0.019s	sys 0.011s
I20260709 12:24:37.046464  1964 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:37.067380 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.080052 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.196390 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.002980  1714 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:37.000205  1977 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:37.087515  1671 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.141515  1716 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.278607 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:37.283432 31434 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.010s	sys 0.012s
W20260709 12:24:37.283887 31434 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.010s	sys 0.012s
W20260709 12:24:37.284188 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 696432us
I20260709 12:24:37.222836  1990 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:37.143831  1489 ts_tablet_manager.cc:1467] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Tablet startup took 894ms
I20260709 12:24:37.009470  1888 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:37.143260  1896 consensus_queue.cc:260] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:37.536506 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 250329us
W20260709 12:24:37.468312 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.007s	sys 0.029s
W20260709 12:24:37.581089 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.008s	sys 0.034s
W20260709 12:24:37.440658 31394 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.003s	sys 0.020s
W20260709 12:24:37.582134 31394 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.005s	sys 0.022s
W20260709 12:24:37.582204 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 641250us
W20260709 12:24:37.543125 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 581226us
W20260709 12:24:37.584865 31461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.000s	sys 0.035s
W20260709 12:24:37.585801 31461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.000s	sys 0.035s
I20260709 12:24:37.575325 31434 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:37.586232 31507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.001s	sys 0.021s
W20260709 12:24:37.588150 31507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.001s	sys 0.021s
I20260709 12:24:37.243779  1714 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.288425 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1770) took 1060 ms. Trace:
W20260709 12:24:37.591322 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.584518 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:37.355849  1917 consensus_meta.cc:287] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.000s
I20260709 12:24:37.286549  1919 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:37.288084  1799 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:37.373667  1920 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:37.288120  1791 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:37.355142  1885 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:37.641845  1905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.006s	sys 0.004s
I20260709 12:24:37.224215  1988 consensus_queue.cc:1059] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.385s
I20260709 12:24:37.631214  1830 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:37.642316  1905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.006s	sys 0.004s
I20260709 12:24:37.589530  1812 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:24:37.635291  1717 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:37.646142  1985 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:37.637698  1713 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.638332  1981 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:24:37.642329  1885 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:37.595091 31465 rpcz_store.cc:276] 0709 12:24:36.228301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.627515 (+399214us) service_pool.cc:224] Handling call
0709 12:24:36.627800 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.627960 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:36.649307 (+ 21347us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.000014 (+350707us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.001934 (+  1920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.001989 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:37.002059 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.288214 (+286155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.288357 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52142,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3006,"raft.queue_time_us":2792,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":27772,"spinlock_wait_cycles":11434880,"thread_start_us":347529,"threads_started":1}
W20260709 12:24:37.654949 31392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.028s	sys 0.040s
W20260709 12:24:37.692708 31392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.029s	sys 0.040s
I20260709 12:24:37.693760 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 449) took 1107 ms. Trace:
I20260709 12:24:37.614032  1761 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:37.617311  1893 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:37.637056  1986 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.306s	user 0.001s	sys 0.001s
I20260709 12:24:37.639894  1938 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:37.694228 31392 rpcz_store.cc:276] 0709 12:24:36.586725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.586852 (+   127us) service_pool.cc:224] Handling call
0709 12:24:36.587181 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.587419 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:36.981436 (+394017us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.693285 (+711849us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.693356 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:37.693428 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.693519 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.693686 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6756,"prepare.queue_time_us":881404,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"thread_start_us":1037801,"threads_started":2}
I20260709 12:24:37.623624  1799 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:37.728777  1875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.009s	sys 0.005s
I20260709 12:24:37.708174  1885 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:37.707828  1946 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:37.740753 31509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.001s	sys 0.046s
W20260709 12:24:37.741191 31509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.001s	sys 0.046s
I20260709 12:24:37.736361  1757 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:37.747035 31508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.016s
W20260709 12:24:37.748553 31508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.016s
I20260709 12:24:37.681643  1713 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:37.742908  1885 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.746271  1919 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.745355  2001 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.750258  1922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.003s	sys 0.013s
I20260709 12:24:37.754832  1977 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:37.773269  1922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.003s	sys 0.014s
I20260709 12:24:37.787676  1713 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:37.788801  1998 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:24:37.772918  1919 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:37.793710  1919 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:37.794998  1874 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.795674  1874 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:37.804479  1791 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.805019  1965 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.036s	user 0.012s	sys 0.000s
I20260709 12:24:37.805140  1791 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:37.805857  1965 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:37.776031  2001 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:37.809615  2001 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:37.813714  1716 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:37.820753  1885 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:37.823630  1885 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:37.857718 31359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.008s	sys 0.025s
W20260709 12:24:37.858667 31359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.010s	sys 0.026s
I20260709 12:24:37.860111 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1774) took 1263 ms. Trace:
W20260709 12:24:37.860419 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 275587us
I20260709 12:24:37.860852 31391 rpcz_store.cc:276] 0709 12:24:36.596596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.714895 (+118299us) service_pool.cc:224] Handling call
0709 12:24:36.715188 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.716017 (+   829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.716045 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.716477 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.891118 (+174641us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:36.891174 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.891288 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.859047 (+967759us) raft_consensus.cc:1685] finished
0709 12:24:37.859126 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.859740 (+   614us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":322,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":174262,"threads_started":1,"wal-append.queue_time_us":612767}
I20260709 12:24:37.863137 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 445) took 1360 ms. Trace:
I20260709 12:24:37.865406 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1773) took 1268 ms. Trace:
I20260709 12:24:37.865892 31394 rpcz_store.cc:276] 0709 12:24:36.596355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.712640 (+116285us) service_pool.cc:224] Handling call
0709 12:24:36.712923 (+   283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:36.713281 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.713310 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:36.713819 (+   509us) log.cc:844] Serialized 52 byte log entry
0709 12:24:36.893505 (+179686us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:37.582528 (+689023us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.583187 (+   659us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.864566 (+281379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.864760 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.864882 (+   122us) raft_consensus.cc:1685] finished
0709 12:24:37.864896 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.865175 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5918,"prepare.queue_time_us":748871,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":103254,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":250,"spinlock_wait_cycles":224768,"thread_start_us":1131623,"threads_started":3,"wal-append.queue_time_us":286590}
I20260709 12:24:37.872196 31361 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:37.863826 31388 rpcz_store.cc:276] 0709 12:24:36.502624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.502801 (+   177us) service_pool.cc:224] Handling call
0709 12:24:36.503294 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.503824 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:36.503871 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.504478 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.900989 (+396511us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:36.901031 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.901101 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.862505 (+961404us) raft_consensus.cc:1685] finished
0709 12:24:37.862558 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.862894 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40433,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":4279,"thread_start_us":355842,"threads_started":1,"wal-append.queue_time_us":596629}
W20260709 12:24:37.889045 31467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1753) took 2700 ms (client timeout 1755 ms). Trace:
W20260709 12:24:37.889678 31467 rpcz_store.cc:269] 0709 12:24:35.188594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.756308 (+567714us) service_pool.cc:224] Handling call
0709 12:24:37.888414 (+2132106us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400415354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:37.888708 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599338752}
I20260709 12:24:37.875464 31361 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:37.883796 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1775) took 1286 ms. Trace:
W20260709 12:24:37.893760 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.898277 31468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1737) took 3426 ms (client timeout 2409 ms). Trace:
W20260709 12:24:37.898910 31468 rpcz_store.cc:269] 0709 12:24:34.472060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.731743 (+1259683us) service_pool.cc:224] Handling call
0709 12:24:37.897577 (+2165834us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400272c54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:37.898016 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234456320}
I20260709 12:24:37.902670 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:37.891930 31389 rpcz_store.cc:276] 0709 12:24:36.596832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.762516 (+165684us) service_pool.cc:224] Handling call
0709 12:24:36.762998 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.940086 (+177088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.883172 (+943086us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540037bc54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:37.883639 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405668736}
I20260709 12:24:37.905200 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:37.906891 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:37.912746 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 348) took 4908 ms. Trace:
W20260709 12:24:37.586750  1489 ts_tablet_manager.cc:1469] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Trace:
0709 12:24:21.528608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.528756 (+   148us) service_pool.cc:224] Handling call
0709 12:24:21.953186 (+424430us) ts_tablet_manager.cc:934] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
0709 12:24:23.050209 (+1097023us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:25.246085 (+2195876us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:25.246232 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:26.306042 (+1059810us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:26.370677 (+ 64635us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:26.536856 (+166179us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:26.540196 (+  3340us) inbound_call.cc:177] Queueing success response
0709 12:24:32.350610 (+5810414us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:24:36.198547 (+3847937us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:24:36.218776 (+ 20229us) tablet_replica.cc:261] Starting instrumentation
0709 12:24:36.219422 (+   646us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":69004,"mutex_wait_us":1725,"raft.queue_time_us":16223,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":13569,"tablet-copy.queue_time_us":231587,"tablet-download-pool.queue_time_us":19601,"tablet-download-pool.run_cpu_time_us":2080,"tablet-download-pool.run_wall_time_us":4368855,"thread_start_us":367596,"threads_started":2}
W20260709 12:24:37.885174 31387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 442) took 2021 ms (client timeout 1699 ms). Trace:
W20260709 12:24:37.890822 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 306262us
W20260709 12:24:37.918128 31387 rpcz_store.cc:269] 0709 12:24:35.863679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.884756 (+2021077us) service_pool.cc:211] Skipping call since client already timed out
0709 12:24:37.884958 (+   202us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:24:37.919158 31510 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:37.921590 32047 leader_election.cc:336] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.699s (SENT)
I20260709 12:24:37.922266 32047 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:37.923331 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:37.924624 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:37.925666 31387 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.919659 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 345) took 1053 ms. Trace:
I20260709 12:24:37.936673  1757 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.913240 31469 rpcz_store.cc:276] 0709 12:24:33.003829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.329505 (+1325676us) service_pool.cc:224] Handling call
0709 12:24:34.329878 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.805984 (+476106us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:35.088427 (+282443us) log.cc:844] Serialized 14 byte log entry
0709 12:24:35.135475 (+ 47048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:35.135526 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:35.135582 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.912190 (+2776608us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400271d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:37.912277 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.912504 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":351439,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":18124,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":1094328704,"thread_start_us":306183,"threads_started":2,"wal-append.queue_time_us":133344,"wal-append.run_cpu_time_us":2640,"wal-append.run_wall_time_us":1724865}
I20260709 12:24:37.937671  1757 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:37.928617 31544 rpcz_store.cc:276] 0709 12:24:36.866233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.866408 (+   175us) service_pool.cc:224] Handling call
0709 12:24:36.885606 (+ 19198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.993010 (+107404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.918927 (+925917us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001455d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:37.919425 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243320064}
I20260709 12:24:37.947353  1987 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:37.948001  2015 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.948593  2010 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:37.948360  1987 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:37.949184  2010 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:37.949007  2015 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:37.949826  2010 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.936674  1716 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:37.951761  2019 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:37.952558  1716 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:37.955090 31536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1724) took 2684 ms (client timeout 1625 ms). Trace:
W20260709 12:24:37.955648 31536 rpcz_store.cc:269] 0709 12:24:35.270250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.319435 (+ 49185us) service_pool.cc:224] Handling call
0709 12:24:37.954595 (+2635160us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400361854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:37.954840 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2416174464}
I20260709 12:24:37.956485 31462 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:37.958863 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1686) took 1357 ms. Trace:
I20260709 12:24:37.959527  1757 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:37.939581  1905 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.960315 32084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 508) took 1331 ms. Trace:
W20260709 12:24:37.961196 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 385869us
W20260709 12:24:37.962457 31463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1734) took 3561 ms (client timeout 2009 ms). Trace:
I20260709 12:24:37.951550  1830 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:37.976473  1830 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:37.946894  1893 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.965301  1988 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.963791 32084 rpcz_store.cc:276] 0709 12:24:36.628546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.629123 (+   577us) service_pool.cc:224] Handling call
0709 12:24:37.959796 (+1330673us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000dff54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:37.960069 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690945920}
I20260709 12:24:37.965914  1989 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.966284  2002 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.967932  1716 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:37.970237  2015 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:37.974038 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:37.967003  2005 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.961228 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:37.964051 31463 rpcz_store.cc:269] 0709 12:24:34.401385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.439797 (+ 38412us) service_pool.cc:224] Handling call
0709 12:24:37.961976 (+3522179us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540036c254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:37.962250 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3452690176}
I20260709 12:24:37.980615  1893 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.016224 31394 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:37.962643  1938 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:38.017735  2005 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.035980  1830 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.036134  1849 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:38.037863 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 174331us
I20260709 12:24:37.970225  2014 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:38.041242 31536 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:38.046164 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:38.047575 31536 raft_consensus.cc:2410] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:24:38.047763 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 126337us
I20260709 12:24:38.050562 31434 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:38.051244  1399 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:38.052476 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:38.053611 31434 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:38.054033  1830 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.054544  1830 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:38.055032  1830 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.055361  1988 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.059717  2015 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.060288  2015 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:38.060787  2015 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:38.061332 31433 connection.cc:256] RPC call timeout handler was delayed by -1.3455388909997055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:24:38.061834 31433 connection.cc:256] RPC call timeout handler was delayed by -1.0179388909996305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:24:38.036942  1989 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.076463  1987 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:38.087798 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 147309us
W20260709 12:24:38.091246 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.092331  1399 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.093051  1399 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.087582  1407 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:38.041445  2002 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.105657 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:38.106738  1407 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.115465 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:38.116484  2031 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.963248 31535 rpcz_store.cc:276] 0709 12:24:36.601952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.602125 (+   173us) service_pool.cc:224] Handling call
0709 12:24:36.605074 (+  2949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.869213 (+264139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.869253 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.879862 (+ 10609us) log.cc:844] Serialized 26 byte log entry
0709 12:24:37.221521 (+341659us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:37.326754 (+105233us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.328163 (+  1409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.958002 (+629839us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54000d2d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:37.958094 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.958183 (+    89us) raft_consensus.cc:1685] finished
0709 12:24:37.958338 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.958618 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":248924,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":309078,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":8975,"spinlock_wait_cycles":606628224,"thread_start_us":341252,"threads_started":1,"wal-append.queue_time_us":854227}
I20260709 12:24:38.118221 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:38.144467 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 45433.6us
I20260709 12:24:38.145066 31387 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:38.074777  1905 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:38.147140 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 110560us
I20260709 12:24:38.148411  1905 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:38.151403 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 276280us
I20260709 12:24:38.153671  1989 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.153890 31361 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:38.156296  2014 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.117404  2031 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.100564  1849 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.168457  1922 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:24:38.175350  1922 consensus_queue.cc:1243] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer 503bef451a2b424fa35e8e46b8c06f29 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:38.134757  2005 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.187008 31510 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:38.188165 31467 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:24:38.175859  1901 consensus_queue.cc:1175] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "842fbe33f4144fa69f1fd428652b6998" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:38.194239 31468 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:38.196530 31536 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.200804  2031 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:38.201787 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.202050  1893 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.202600  1893 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:38.172458  2015 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:38.209064  1714 consensus_meta.cc:287] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.011s
I20260709 12:24:38.209295 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:38.209576  1714 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.214051  1987 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.214351  2002 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.214516  1987 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:38.215010  1987 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.215651 32047 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:38.216475 31463 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:38.212067 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 58377.7us
I20260709 12:24:38.176254  1925 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.230144  1399 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:38.232151  1922 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:38.232733  1922 raft_consensus.cc:697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:38.237107 31392 pending_rounds.cc:85] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 5
I20260709 12:24:38.237453 31392 pending_rounds.cc:107] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:38.237782 31392 raft_consensus.cc:2889] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:38.219146  2015 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.203308  1893 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.246866  1830 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.250463 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:38.215025  1849 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.253260  1849 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.255018  1893 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:38.244580  2034 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
W20260709 12:24:38.255713 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 83944.9us
I20260709 12:24:38.256582 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:38.256968  2035 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.241329 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:38.257632  2035 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:38.292017 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 191683us
W20260709 12:24:38.293848 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 115415us
I20260709 12:24:38.298717 31467 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:38.293037 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:38.284857  1714 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.315428 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:38.325277 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 447) took 1770 ms. Trace:
I20260709 12:24:38.325448  1830 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.325790 31393 rpcz_store.cc:276] 0709 12:24:36.503299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.503420 (+   121us) service_pool.cc:224] Handling call
0709 12:24:37.869458 (+1366038us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:37.869902 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.870663 (+   761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.870715 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:37.890423 (+ 19708us) log.cc:844] Serialized 26 byte log entry
0709 12:24:38.013757 (+123334us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:38.013796 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.013933 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.258052 (+244119us) raft_consensus.cc:1685] finished
0709 12:24:38.258072 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.273174 (+ 15102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91506,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":239,"spinlock_wait_cycles":9284480,"thread_start_us":68958,"threads_started":1,"wal-append.queue_time_us":80015}
I20260709 12:24:38.267957  1922 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:38.354249 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 60933.5us
I20260709 12:24:38.293536  2010 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.362238  1936 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.355216 31510 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:38.364893  1936 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:38.373201  1936 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.378052 31434 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:38.384677 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 135650us
W20260709 12:24:38.386833 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 128645us
I20260709 12:24:38.386548  2022 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.396497 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-d762e82a994f48968e08b715c9df4a7a received from {username='slave'} at 127.0.0.1:48410
I20260709 12:24:38.386209 31510 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:38.384389  1994 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.757s	user 0.003s	sys 0.000s
W20260709 12:24:38.390461  1983 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:38.366700  1714 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:38.399327 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-d762e82a994f48968e08b715c9df4a7a on tablet d762e82a994f48968e08b715c9df4a7a with peer 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:38.384793  1671 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.035s	user 0.011s	sys 0.008s
I20260709 12:24:38.383082  1925 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.386936  2035 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.402915 31433 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:38.414093 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:38.414018 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:38.408876  1830 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.428944 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:38.420625  2035 raft_consensus.cc:2764] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:38.432278 31361 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:38.434104 31468 raft_consensus.cc:1240] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.443544  1964 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:38.448633 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 49161.7us
I20260709 12:24:38.448828 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 340) took 1645 ms. Trace:
I20260709 12:24:38.450312 31433 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:38.450742  1778 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.449476 31540 rpcz_store.cc:276] 0709 12:24:36.803513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.803798 (+   285us) service_pool.cc:224] Handling call
0709 12:24:36.814840 (+ 11042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.815191 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.815222 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.815781 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.973365 (+157584us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:36.973420 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.973507 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.345586 (+1372079us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:38.448154 (+102568us) raft_consensus.cc:1685] finished
0709 12:24:38.448194 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.448618 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16227,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":49451904,"thread_start_us":157170,"threads_started":1,"wal-append.queue_time_us":713885}
I20260709 12:24:38.451390  1952 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:38.459467  1893 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:38.459995  1893 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:38.460409  1893 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.460671  1771 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:38.461369 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.462985 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 111649us
I20260709 12:24:38.424952  2019 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:38.464236  2019 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.433336 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 334) took 4182 ms. Trace:
I20260709 12:24:38.475458  1778 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.475955  1778 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.476325  1778 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.478415  1837 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.481391  1988 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.483505 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:38.484146 31464 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:38.487428 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 58056.4us
I20260709 12:24:38.488261 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:38.489291 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:38.490209 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:38.494995 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 72818.8us
W20260709 12:24:38.495734  1960 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 2.509s	user 0.009s	sys 0.010s
W20260709 12:24:38.498515  1926 raft_consensus.cc:1068] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Unable to promote non-voter 8d38acb9ce494ceb917c8441666104c4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:38.417567  1671 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.468691 31539 rpcz_store.cc:276] 0709 12:24:34.222142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.401247 (+179105us) service_pool.cc:224] Handling call
0709 12:24:34.805380 (+404133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.807397 (+  2017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.368972 (+3561575us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54002085d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:38.404958 (+ 35986us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928568064}
I20260709 12:24:38.470954  1886 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:38.516671  1724 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.518173  1671 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.520095  1936 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.524878 31463 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:38.521320 31461 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:38.522361  1981 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:38.442986  2045 consensus_queue.cc:1059] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:24:38.520684  1778 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.550678  1988 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:38.550748  1866 raft_consensus.cc:3055] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:38.555584  1988 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.555862  1926 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:38.466777  2019 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:38.556702 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 121947us
I20260709 12:24:38.525650  1724 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.661859 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:38.679356 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 190188us
I20260709 12:24:38.660187  1866 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:38.661163  1926 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:38.678992  1917 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:38.662065  1778 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.615098  1964 raft_consensus.cc:697] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:38.649794  1901 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.581670  1863 raft_consensus.cc:3055] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:38.662662  2010 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:38.643492  1934 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.688800  1934 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.689397 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:38.691109  1934 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.691979 31389 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.692288 31395 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:38.692481  1866 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:38.693502 31394 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:38.686249  1926 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.694629 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:38.695371 31390 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.696213  1987 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.696671  1866 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.691116 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:38.699276 31387 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.703338  1930 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:38.707370 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.548380  1886 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.708835 31510 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:38.662569  1988 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.664403  1724 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:38.687879  1995 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 1.056s	user 0.001s	sys 0.002s
I20260709 12:24:38.646375  1830 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:24:38.594807  1913 consensus_queue.cc:1059] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:24:38.721820 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:38.706796  1926 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.740229 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:38.686244  1917 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:38.713027  1934 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.709336  1863 raft_consensus.cc:740] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:38.744791  1886 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:38.755388 31395 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.756757  1926 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.765839  1863 consensus_queue.cc:260] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.789538  1901 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.790457  1863 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.791879  1901 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:38.792423 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:38.759493  1917 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.793079 31388 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.773752 31539 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:38.774730 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:38.775832  1851 raft_consensus.cc:3055] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:38.777462  1987 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:38.777134  1893 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:38.781411 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.781945  1714 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:38.789754 31540 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.771412 31390 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:38.796365  1407 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.798869 31394 raft_consensus.cc:2410] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:38.778362  2022 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:38.801306 31393 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:38.803287 31464 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:38.745348  1936 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.806154 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:38.811085 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 135266us
I20260709 12:24:38.815003 31388 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:38.795080  1851 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:38.816390  2035 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.816938 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:38.815254 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:38.819207 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:38.850605 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:38.893581  2047 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:24:38.894188 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.894769 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.898561  2052 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:38.901770 31539 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:38.897545  2022 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:24:38.902271 31395 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:38.903128  1893 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.914696 31387 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
W20260709 12:24:38.918888 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.878274  1936 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.921180  1724 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.922641  1791 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.940863 32048 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:38.851577  1964 consensus_queue.cc:237] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:38.924026  1917 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.928006  1874 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:38.896610  2035 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:38.938642 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.939083 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:38.939982 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.942538 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 92036us
I20260709 12:24:38.943773 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:38.945374 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:38.951824 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:38.952536  1899 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:38.946139  1399 consensus_queue.cc:1059] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:24:38.968564 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:38.953161  1737 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:24:38.954815  1914 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.975456 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:38.976652 31536 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:38.976733 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:38.977494 31541 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:24:38.977871 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:38.978363 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:38.978644 31536 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:38.979741 31388 raft_consensus.cc:1240] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:38.982671 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 53280us
I20260709 12:24:38.985702 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:38.987149 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:38.987838 32084 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:38.989794  1917 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:38.993979  1925 consensus_meta.cc:287] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 12:24:38.948304  1407 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:38.994366 32077 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:38.999497  1816 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.000011  1816 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:38.948449  1902 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:24:39.004225  1786 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.005116  1764 raft_consensus.cc:3055] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.004832  1786 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:39.005569  1764 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:39.007206  1786 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:39.008337  1816 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:39.011030  1888 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.008528  2035 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:39.016773 31541 raft_consensus.cc:2410] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:39.016975 31436 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:39.023921 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:39.024922 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:38.998500  1407 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.029734 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:39.025658 31539 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:39.006719  1764 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:39.032887 31386 raft_consensus.cc:2410] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:24:39.033730 31536 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:39.035358 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:39.036147 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.037788  1764 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.043350 31394 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:39.037829 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.044363 31395 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:39.047415 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:39.031481  1407 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.033449  1899 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:39.055222 31387 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:39.031335  1737 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:24:39.058805 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.059500 31395 raft_consensus.cc:2368] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
I20260709 12:24:39.058362 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:39.062752 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.067802 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:39.051649  1899 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.070556 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:39.052611  1922 raft_consensus.cc:3055] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:39.073506 31536 raft_consensus.cc:2410] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:39.076457 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:39.078205 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.078644 31395 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:39.080036  1792 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.080636 31463 raft_consensus.cc:2410] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:39.080610  1792 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:39.074710  1899 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:39.076647  1399 consensus_queue.cc:1059] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 12:24:39.086277  2040 log.cc:927] Time spent T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.678s	user 0.000s	sys 0.002s
I20260709 12:24:39.087213 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:39.087920 31461 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.092602 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:39.110301 31389 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:39.111336 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.115777 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:39.116473 31540 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:39.116087 32047 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:39.074926  1922 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:24:39.140831  1815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.749s	user 0.017s	sys 0.030s
W20260709 12:24:39.141335  1815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.842s	user 0.018s	sys 0.030s
I20260709 12:24:39.075727  1988 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:39.142923 31465 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:24:39.439018 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.891541 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:39.157419 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:39.161978 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:39.871447 31467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.005s
I20260709 12:24:39.242823 31387 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
W20260709 12:24:39.893972 31467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.006s	sys 0.006s
W20260709 12:24:39.193167 31386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 444) took 2691 ms (client timeout 1762 ms). Trace:
I20260709 12:24:39.895538 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.896301 31390 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:39.897172 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1734) took 2932 ms. Trace:
I20260709 12:24:39.319562 31466 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:39.172300 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:39.893638 31540 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.729s	user 0.006s	sys 0.002s
I20260709 12:24:39.195603 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:39.900568 31389 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:39.900372 31540 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:39.901175 31468 raft_consensus.cc:2410] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:39.272292 31461 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:39.891549 31463 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:39.890985 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 760548us
I20260709 12:24:39.905712 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:39.191643 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:39.895048 31386 rpcz_store.cc:269] 0709 12:24:36.502268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.502407 (+   139us) service_pool.cc:224] Handling call
0709 12:24:39.192833 (+2690426us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54002e22d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:39.193051 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5585539200}
W20260709 12:24:39.229543 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 120859us
I20260709 12:24:39.893075 31539 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:39.919545 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:39.899253 31537 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:24:39.867427  1899 consensus_meta.cc:287] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.000s
I20260709 12:24:39.143429  1737 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:39.862339  1764 consensus_meta.cc:287] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.001s
I20260709 12:24:39.936592 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:39.937348 31535 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:39.938098 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:39.938715 31535 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
W20260709 12:24:39.939563  2057 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.414s	user 0.000s	sys 0.001s
W20260709 12:24:39.711473  1914 consensus_meta.cc:287] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.717s	user 0.005s	sys 0.005s
I20260709 12:24:39.947608 31392 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 4. Current term is 6. Ops: []
I20260709 12:24:39.947742 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:39.947624 31462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1592) took 7086 ms (client timeout 1778 ms). Trace:
I20260709 12:24:39.948582 31387 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:24:39.948526 31462 rpcz_store.cc:269] 0709 12:24:32.846760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.043379 (+196619us) service_pool.cc:224] Handling call
0709 12:24:39.913026 (+6869647us) spinlock_profiling.cc:243] Waited 4.63 s on lock 0x7b540029a9d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:39.932924 (+ 19898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10648009472}
I20260709 12:24:39.929243 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:39.887518  1888 consensus_meta.cc:287] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.876s	user 0.005s	sys 0.007s
I20260709 12:24:39.930773 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.924721 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:39.927078 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 356) took 1067 ms. Trace:
I20260709 12:24:39.146309  1724 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:39.933507  1899 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:39.935580 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1678) took 3586 ms (client timeout 1712 ms). Trace:
I20260709 12:24:39.957940 31395 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:39.944829 31541 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:39.954874 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.961427 31389 raft_consensus.cc:2410] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:39.945469 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.963977 31390 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:39.897912 31542 rpcz_store.cc:276] 0709 12:24:36.964553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.964708 (+   155us) service_pool.cc:224] Handling call
0709 12:24:36.965042 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.904538 (+939496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.904599 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.904663 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:37.904713 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.896586 (+1991873us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b54002b4654. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:39.896662 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.896911 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43391,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":306,"spinlock_wait_cycles":2158542592}
I20260709 12:24:39.952059 31540 raft_consensus.cc:2410] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:39.951552 31537 rpcz_store.cc:276] 0709 12:24:38.860112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.860240 (+   128us) service_pool.cc:224] Handling call
0709 12:24:39.898540 (+1038300us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:39.898819 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.921651 (+ 22832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.927010 (+  5359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2997632}
I20260709 12:24:39.945719 31391 raft_consensus.cc:2410] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:39.957579 31538 rpcz_store.cc:269] 0709 12:24:36.348568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.348692 (+   124us) service_pool.cc:224] Handling call
0709 12:24:39.912831 (+3564139us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54003feb54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:39.935399 (+ 22568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962072832}
I20260709 12:24:39.978987 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:39.957168  2020 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.987453  2020 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:39.966465  2007 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.989723  2007 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:39.991428 31543 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:39.993126  1902 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:39.993844  1407 consensus_meta.cc:287] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.939s	user 0.006s	sys 0.005s
W20260709 12:24:39.949004  1930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.004s	sys 0.021s
W20260709 12:24:39.994865  1930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.004s	sys 0.021s
I20260709 12:24:39.994391  1407 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:40.018203 31470 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:40.031664 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:40.032542 31386 raft_consensus.cc:2393] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:40.035142 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.040614 31395 raft_consensus.cc:2410] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:40.018801 31470 pending_rounds.cc:85] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 3
I20260709 12:24:40.083909 31470 pending_rounds.cc:107] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:40.084338 31470 raft_consensus.cc:2889] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:39.375135  1851 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:40.086226 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.086835 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1750) took 1019 ms. Trace:
I20260709 12:24:40.089095 31541 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:40.088979 31535 rpcz_store.cc:276] 0709 12:24:39.067860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.950038 (+882178us) service_pool.cc:224] Handling call
0709 12:24:39.980028 (+ 29990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.031959 (+ 51931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.032040 (+    81us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.081668 (+ 49628us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:40.086484 (+  4816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.086578 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.086732 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.096107  1767 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:40.117229 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 137556us
I20260709 12:24:40.120291 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:40.115962  1930 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:40.141420 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.140434 31389 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.142194 31386 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:40.145223 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.145813 31395 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 4.
I20260709 12:24:40.146569 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.142206 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.147133 31395 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:40.150746 31465 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:40.142840 32047 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:40.152276 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1782) took 1075 ms. Trace:
I20260709 12:24:40.152582 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1780) took 1080 ms. Trace:
I20260709 12:24:40.152549 31542 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:24:40.154084 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.142576 31540 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:40.143702  1767 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.155224 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.153234 31465 rpcz_store.cc:276] 0709 12:24:39.071128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.071318 (+   190us) service_pool.cc:224] Handling call
0709 12:24:40.151129 (+1079811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.155891 31386 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
W20260709 12:24:40.163427 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.152688 31467 rpcz_store.cc:276] 0709 12:24:39.077019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.077141 (+   122us) service_pool.cc:224] Handling call
0709 12:24:39.082087 (+  4946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.082361 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:39.187154 (+104793us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.143568 (+956414us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.151909 (+  8341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.151960 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.152007 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.152082 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.152193 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57805,"prepare.queue_time_us":1058253,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":94,"raft.queue_time_us":221695,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":23526,"thread_start_us":877780,"threads_started":3,"wal-append.queue_time_us":772827}
I20260709 12:24:40.168007 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.168622 31390 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:40.169386 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:40.170702 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:40.213934 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.216305  1899 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:40.218313  2063 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:40.218927  2063 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:40.159518  1767 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:40.222997 31387 raft_consensus.cc:2376] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8. Re-sending same reply.
I20260709 12:24:40.171416 31391 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
W20260709 12:24:40.159904  2060 log.cc:927] Time spent T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.074s	user 0.004s	sys 0.003s
I20260709 12:24:40.253217 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:40.326249 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:40.325524 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.288998 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:40.272596 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.327529 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:40.352065 31387 raft_consensus.cc:2393] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:40.351130 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.160476  1930 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:40.299029 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.356215 31540 raft_consensus.cc:2368] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
I20260709 12:24:40.359478 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.365312 31390 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:40.363775  2063 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:40.355365  1930 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.326020  1851 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:40.355755  2062 log.cc:927] Time spent T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:24:40.366109 31510 connection.cc:256] RPC call timeout handler was delayed by -1.4118781180000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 12:24:40.371104 31510 connection.cc:256] RPC call timeout handler was delayed by -1.3963052349999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 12:24:40.371704 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.372957 31386 raft_consensus.cc:2410] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:40.326185  1767 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.373184 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.377250 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.378094 31390 raft_consensus.cc:2410] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:40.399160 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:40.401221 31360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.003s
W20260709 12:24:40.401750 31360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.008s	sys 0.003s
I20260709 12:24:40.412599 31542 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:40.393100  1988 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.372640  1930 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.417881 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:40.420995 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 496333us
I20260709 12:24:40.422433  1799 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.422560  1778 raft_consensus.cc:3055] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:40.429044 31541 raft_consensus.cc:2376] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6. Re-sending same reply.
I20260709 12:24:40.397609  1407 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.430617 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.436480 31433 leader_election.cc:400] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
I20260709 12:24:40.416050  1767 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:40.436800 31433 leader_election.cc:403] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.428085  2063 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.439493  2070 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:40.445371 31542 raft_consensus.cc:2368] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8.
I20260709 12:24:40.433346  1778 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:40.449050 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.451089 31541 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
W20260709 12:24:40.459004 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.459875 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:40.460729 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.462124 31541 raft_consensus.cc:2410] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:40.462782 31433 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:40.462169  1778 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:40.470953  1873 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:40.471026 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.471544  1778 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.471897  1931 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.472112 31541 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:40.472687  1961 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
I20260709 12:24:40.477612  1931 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.478251  1931 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:40.481585 31389 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:40.485029 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:40.485080 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:40.460862  2066 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.480753  1931 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:40.496332 31433 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:40.494087  2068 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:40.498023  2068 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:40.450354  2063 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:40.499783  1716 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:40.500411  2068 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:40.500339  1716 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:40.500643  2063 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.501376  2063 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:40.450099  1767 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:40.502527  1716 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:40.503433 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.494053 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.494439  1961 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.505052  1961 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:40.505775  1792 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:40.506333  1792 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.494760  2064 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:40.507682  2064 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.508100  2064 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.508965  2007 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:40.510711 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.511312 32050 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:40.511533 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 360) took 1441 ms. Trace:
W20260709 12:24:40.503862 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.515973 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.516461 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.517078 31541 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:40.518009  2045 raft_consensus.cc:3055] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:40.518430  2045 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:40.518560 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.519172 31542 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.519385  2045 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:40.521010  2045 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.518019 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.524497 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.525345 31541 raft_consensus.cc:2393] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 10: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:40.506785  1792 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:40.535765 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.537438  1792 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.511950 31537 rpcz_store.cc:276] 0709 12:24:39.069916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.966095 (+896179us) service_pool.cc:224] Handling call
0709 12:24:40.033915 (+ 67820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.116031 (+ 82116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.139798 (+ 23767us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.159953 (+ 20155us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.483643 (+323690us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.483679 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.483740 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:40.511269 (+ 27529us) raft_consensus.cc:1685] finished
0709 12:24:40.511306 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.511463 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7262,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":103,"thread_start_us":184974,"threads_started":1,"wal-append.queue_time_us":225665}
I20260709 12:24:40.539395 31541 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:40.471714  1873 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:40.542344  1492 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:40.543071 31540 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.543805  1767 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.544956 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.545526 31394 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:40.545959 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1723) took 1350 ms. Trace:
I20260709 12:24:40.546233 31394 rpcz_store.cc:276] 0709 12:24:39.195939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.196256 (+   317us) service_pool.cc:224] Handling call
0709 12:24:40.544817 (+1348561us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:40.545883 (+  1066us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15937408}
I20260709 12:24:40.500976  2068 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:40.554124  2068 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:40.554526  2068 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.555579 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.567299 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.569242 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:40.572448 31542 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
W20260709 12:24:40.574286 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 78033.8us
I20260709 12:24:40.568018  1882 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.575068  1620 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:40.575126 31433 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:40.575662  1620 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.576063  1620 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:40.576093 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 93141.5us
I20260709 12:24:40.576992 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:40.515278  1716 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:40.577785  1450 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:40.577880  1716 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:40.579946  1899 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:40.580166  1716 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:40.586176 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.586894 31537 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.587882 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.590257 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.590309 31541 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:40.590875 31542 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:40.589349 31359 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:40.572587 31540 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
W20260709 12:24:40.595335 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.607769 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.583025  1961 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.613157 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.609012 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.583940  2071 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.608582 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:40.609368 31510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 1.501s (SENT) [suppressed 33 similar messages]
I20260709 12:24:40.583830  2020 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:40.619323 31541 raft_consensus.cc:2410] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:40.515424  2066 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:40.606946  2070 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.584863  1792 consensus_queue.cc:1059] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 12:24:40.650044 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.652917 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0828725960000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:24:40.653422 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0495725959999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:24:40.613675  2067 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:24:40.653818 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0312664419998328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 12:24:40.624503  1961 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:40.672163 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 72708us
I20260709 12:24:40.667248  1899 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:40.674041  1899 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:40.676160  1899 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:40.654232  2018 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.018s	sys 0.025s
I20260709 12:24:40.669972  1716 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.666980  2067 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:40.686743 31433 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:40.670557  2081 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:40.670305  1866 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:40.691704 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:40.694128 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 79976.6us
I20260709 12:24:40.700137  1792 raft_consensus.cc:3055] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:40.685680  2018 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.018s	sys 0.025s
I20260709 12:24:40.655462  2070 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:40.705919 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.713263 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1788) took 2022 ms. Trace:
I20260709 12:24:40.723897 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 473) took 1904 ms. Trace:
W20260709 12:24:40.725339 32077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 513) took 4009 ms (client timeout 2171 ms). Trace:
I20260709 12:24:40.726718 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:40.837924 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.971660 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:40.958552 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.772490 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:40.839564 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 152912us
I20260709 12:24:40.752452 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:40.752949 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:40.889251 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.758388 31507 leader_election.cc:336] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.522s (SENT)
I20260709 12:24:40.985500 31507 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:40.939805 31544 raft_consensus.cc:2410] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:40.989694 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:40.982996 31393 raft_consensus.cc:2376] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6. Re-sending same reply.
W20260709 12:24:40.982853 32077 rpcz_store.cc:269] 0709 12:24:36.715753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.715918 (+   165us) service_pool.cc:224] Handling call
0709 12:24:40.725054 (+4009136us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b54001d24d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:40.725233 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5235891456}
I20260709 12:24:40.743673 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.983971 31395 raft_consensus.cc:2376] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7. Re-sending same reply.
I20260709 12:24:40.982182 31388 rpcz_store.cc:276] 0709 12:24:38.819674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.819812 (+   138us) service_pool.cc:224] Handling call
0709 12:24:38.820105 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.980283 (+160178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.723618 (+1743335us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000a3054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:40.723821 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366511872}
I20260709 12:24:40.728049 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1689) took 4125 ms. Trace:
I20260709 12:24:40.982676 31535 raft_consensus.cc:2410] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:40.981668 31392 rpcz_store.cc:276] 0709 12:24:38.690583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.690700 (+   117us) service_pool.cc:224] Handling call
0709 12:24:38.691052 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.949841 (+1258789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.713005 (+763164us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000d3254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:40.713206 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2856603392}
W20260709 12:24:40.826283 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.758611 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:40.874725 31537 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:24:41.006793 32048 connection.cc:256] RPC call timeout handler was delayed by -1.5128932440002245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
I20260709 12:24:40.998263 31543 rpcz_store.cc:276] 0709 12:24:36.603102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.604325 (+  1223us) service_pool.cc:224] Handling call
0709 12:24:36.604631 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.991779 (+3387148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.727746 (+735967us) spinlock_profiling.cc:243] Waited 3.39 s on lock 0x7b5400077954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:40.727979 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7787451264}
I20260709 12:24:40.967593 31540 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:41.003840 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 394465us
I20260709 12:24:41.010259 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:41.003659 31433 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:41.012389 31433 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:41.013494 31433 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:41.015448 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.790511  2038 log.cc:927] Time spent T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 2.465s	user 0.011s	sys 0.016s
I20260709 12:24:41.019608 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.020596 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:41.026278 31387 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:40.766290  2054 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 1.633s	user 0.005s	sys 0.020s
I20260709 12:24:41.023650 31359 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:40.739598  2036 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 2.413s	user 0.013s	sys 0.022s
I20260709 12:24:41.024310 31538 raft_consensus.cc:2393] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:40.940675  1874 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:41.031203 32079 raft_consensus.cc:2393] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:40.937430  2066 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:40.866941  2081 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.032992  1540 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:24:41.033676  1885 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.818032 31289 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 9, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 9 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:41.050535 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:41.051127 31465 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.033756 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:41.051391 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.011427  1866 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:41.030462  1961 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:40.691293  1716 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:41.037143 31386 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:41.039680 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:41.040032 31389 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:41.032857  1882 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.072955  1875 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.073683  1875 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.075344 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.064697  1885 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.075637 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:40.764673  1922 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.076817  1922 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.078459 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.057086  2063 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:41.079895  2063 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:41.080003 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.080261  2090 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:41.080766  2090 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.080803 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:41.081143  2068 consensus_meta.cc:287] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.005s
I20260709 12:24:41.081349  2090 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.081655  2068 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.079100 31466 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:41.047214  1874 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.048978  1899 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.866758  1873 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:41.047930 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:40.729209  1896 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.780782  2022 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.052088 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.049672 31433 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:40.936195  2067 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.057101 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:41.094575 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44983.4us
I20260709 12:24:41.094681 31461 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.058701  1961 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.065956 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.030018  2079 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:40.855718  1620 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.085922  1874 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.076220 31464 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.113310 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.114300 31466 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 10: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:41.083668 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:41.039182 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:41.046259 31359 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:40.981508  1792 raft_consensus.cc:740] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:41.086707 31542 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
W20260709 12:24:41.087417 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 329063us
I20260709 12:24:41.118144  1792 consensus_queue.cc:260] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:41.120600 31507 leader_election.cc:336] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.547s (SENT)
I20260709 12:24:41.087425 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:41.120814  1988 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:41.120936 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 91080.1us
I20260709 12:24:41.121053 31507 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:41.121765  1988 raft_consensus.cc:697] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:41.014209  2064 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.123982  1873 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:41.122854 31507 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.603s (SENT)
I20260709 12:24:41.124915 31507 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:41.125362  2064 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:41.126066  1873 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:41.126191 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.128050 31386 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:40.844363  1930 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.092221 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.131495  1570 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:41.131810 31467 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:41.133208 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.134222 31467 raft_consensus.cc:2393] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 10: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:41.040539  1902 consensus_queue.cc:1059] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:24:41.057497 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.135735  1570 raft_consensus.cc:3055] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:41.136179 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.136322  1570 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:41.137367 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.138206  1930 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:41.094689 31536 raft_consensus.cc:2410] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:41.095310 31433 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:41.095927 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.099087 31468 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:41.098759  2022 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:41.139529 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.123025  1988 consensus_queue.cc:237] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.140847 31510 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:41.141454  2022 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:41.141638  1882 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:41.142155  1882 raft_consensus.cc:697] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:41.099488 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.103645 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:41.142566 31510 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:41.143152  1882 consensus_queue.cc:237] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.071743 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:41.137606  1570 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.142912  2020 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:24:41.136337 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:41.145061  1570 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.145258 31467 raft_consensus.cc:2393] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:41.144266 31538 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:24:41.138464 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.142059  2022 consensus_queue.cc:1059] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:41.101974  2066 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:41.147589  2066 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.147964  2066 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.080322  2063 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.151212 31467 raft_consensus.cc:1275] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:41.143730 31543 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:24:41.152027 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 105820us
I20260709 12:24:41.071816 31465 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:41.146731 31462 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:41.154734 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:41.093046  1899 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:41.164129 31507 leader_election.cc:336] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.691s (SENT)
W20260709 12:24:41.161499 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 488345us
I20260709 12:24:41.162930 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:41.166410 32075 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.103821  1961 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.171516 31461 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:24:41.110958  2079 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.166724 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.179251 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:41.180389 31388 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.182683 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:41.194468 31507 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.755s (SENT)
I20260709 12:24:41.163326  2007 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:41.194908 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:41.209739 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.166857  1899 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.209379 31507 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:41.231835 31386 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 4.
I20260709 12:24:41.242655 31464 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:41.244850 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:41.234622 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 48977.1us
I20260709 12:24:41.247642 31359 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:41.259889 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:41.181771  2079 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.186954  2064 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:41.289703 32077 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:24:41.321970 31535 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:41.321741 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 74223.6us
I20260709 12:24:41.372804 31539 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:41.351123 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:41.367542 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.381438 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 286198us
W20260709 12:24:41.357530 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 120516us
W20260709 12:24:41.384085 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 189620us
I20260709 12:24:41.386593 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:41.387166 31507 leader_election.cc:336] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.818s (SENT)
I20260709 12:24:41.387848 31391 raft_consensus.cc:1275] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:41.387058 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:41.385491 32075 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
W20260709 12:24:41.378144 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 212172us
I20260709 12:24:41.391556 31434 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:41.392597 31507 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:41.368886 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.400758 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:41.350729 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.312043  2010 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.393967 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:41.350842  1620 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:41.405853  1919 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.406267  2086 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:24:41.406419  1919 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:41.407423  2089 log.cc:927] Time spent T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:24:41.409024 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1741) took 1262 ms. Trace:
I20260709 12:24:41.409358 31390 rpcz_store.cc:276] 0709 12:24:40.146773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.395488 (+248715us) service_pool.cc:224] Handling call
0709 12:24:40.416550 (+ 21062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.445414 (+ 28864us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:40.623763 (+178349us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.705242 (+ 81479us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.705787 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.964707 (+258920us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:40.964764 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.964852 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.408791 (+443939us) raft_consensus.cc:1685] finished
0709 12:24:41.408813 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.408947 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190813,"prepare.queue_time_us":241284,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":17338,"raft.queue_time_us":325529,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":16751,"thread_start_us":188465,"threads_started":2,"wal-append.queue_time_us":458830}
I20260709 12:24:41.402900 32083 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:41.411509 32084 raft_consensus.cc:2410] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:41.390295  1896 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:24:41.412020 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:41.401268 32081 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:41.416512 31386 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:24:41.417526 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.417865 31388 raft_consensus.cc:2468] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
W20260709 12:24:41.432760 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 46245.6us
I20260709 12:24:41.385473  2068 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:41.417908 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:41.433766 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:41.471028 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53413.8us
I20260709 12:24:41.433780  2070 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:41.389096  1778 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.419034 31395 raft_consensus.cc:1240] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:41.438696 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:41.400311  2020 raft_consensus.cc:2764] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:41.442986 31541 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:41.443773 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.448973  1866 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:41.446918 32047 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:41.451900 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:41.449746  1964 raft_consensus.cc:3055] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:41.439767  1896 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.438535  2022 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:41.454314  1875 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:41.465263 32077 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:41.466468 31433 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:24:41.454880  2087 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:24:41.467221 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:41.358996  1988 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:41.472451 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 85308us
I20260709 12:24:41.476018 31386 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:41.469707  2104 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:41.563515 31389 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
W20260709 12:24:41.539819 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.564095 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 97645.5us
I20260709 12:24:41.496937 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:41.566342 31507 leader_election.cc:336] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.845s (SENT)
I20260709 12:24:41.525540 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.568378 31466 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:41.478507 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:41.462458  1450 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.509032  2097 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:24:41.603260 31510 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:41.605808 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 158960us
I20260709 12:24:41.563838  1988 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:41.607800 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 207369us
I20260709 12:24:41.474156  1882 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:41.565953  1964 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:41.460893  2103 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:41.616670 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 164841us
I20260709 12:24:41.564590  2104 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.566671 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:41.537724  2007 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:41.605118  2022 raft_consensus.cc:697] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:41.621807 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.628270 31544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 346) took 3689 ms (client timeout 1738 ms). Trace:
I20260709 12:24:41.552318  2081 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:41.640457 31544 rpcz_store.cc:269] 0709 12:24:37.939123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.973565 (+ 34442us) service_pool.cc:224] Handling call
0709 12:24:41.628052 (+3654487us) spinlock_profiling.cc:243] Waited 2.93 s on lock 0x7b540039fb54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:41.628201 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6737386368}
I20260709 12:24:41.615489  1875 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:41.640265 32048 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:41.643149 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 76572.2us
I20260709 12:24:41.622244  1988 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.616480  1778 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.624519  2104 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.531818  2063 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.646922 31541 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:41.644341 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:41.646921 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:41.627113  2103 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.616277  2101 raft_consensus.cc:2804] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:41.652091 31433 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:41.648984 32077 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:41.645004  1570 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.647594  2081 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:41.656977  2081 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.657807  2081 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:41.658092  2063 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:41.658406  2081 raft_consensus.cc:697] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:41.650759  2007 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.655711 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:41.655879 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:41.659265 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:41.641613  1866 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:41.663148 32081 raft_consensus.cc:2376] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7. Re-sending same reply.
I20260709 12:24:41.669039  1964 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.652406  2103 raft_consensus.cc:3060] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.619529  1450 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.647023  1875 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.708875  1875 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:41.645469  1882 raft_consensus.cc:697] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:41.710593  1882 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.712482  2079 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:41.688719  2066 consensus_meta.cc:287] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 12:24:41.689644  1919 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:41.690480  2101 raft_consensus.cc:697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:41.701638 32083 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEARNER]: Advancing to term 6
I20260709 12:24:41.702337 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1723) took 1033 ms. Trace:
I20260709 12:24:41.735248 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1724) took 1061 ms. Trace:
I20260709 12:24:41.715986 31434 leader_election.cc:400] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9.
I20260709 12:24:41.663961 32079 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:41.776423 31536 rpcz_store.cc:276] 0709 12:24:40.673417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.772122 (+ 98705us) service_pool.cc:224] Handling call
0709 12:24:41.734931 (+962809us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003615d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:41.735152 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255643392}
W20260709 12:24:41.745817 32084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 531) took 2637 ms (client timeout 2156 ms). Trace:
I20260709 12:24:41.715652 31470 raft_consensus.cc:1240] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 3. Current term is 5. Ops: [3.3-3.3]
I20260709 12:24:41.735963 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1722) took 1067 ms. Trace:
W20260709 12:24:41.737674 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.752859 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.779261 31539 rpcz_store.cc:276] 0709 12:24:40.668284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.726391 (+ 58107us) service_pool.cc:224] Handling call
0709 12:24:41.735773 (+1009382us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400242a54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:41.735896 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894441344}
I20260709 12:24:41.735591 31540 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:24:41.772755 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.778334 32084 rpcz_store.cc:269] 0709 12:24:39.108587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.108718 (+   131us) service_pool.cc:224] Handling call
0709 12:24:41.745557 (+2636839us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540059f6d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:41.745726 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3471230336}
I20260709 12:24:41.782384 31540 pending_rounds.cc:85] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 4
I20260709 12:24:41.783043 31540 pending_rounds.cc:107] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:41.783960 31540 raft_consensus.cc:2889] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:41.776429 31542 rpcz_store.cc:276] 0709 12:24:40.668557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.752654 (+ 84097us) service_pool.cc:224] Handling call
0709 12:24:41.702169 (+949515us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002b5054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:41.702284 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233818880}
W20260709 12:24:41.750953  2090 consensus_meta.cc:287] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.004s
I20260709 12:24:41.717757  1450 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:41.821367  2101 consensus_queue.cc:237] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.731635  2022 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.720695  2018 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.691558  2010 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.744720  2081 consensus_queue.cc:237] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:41.823853 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 123537us
I20260709 12:24:41.752921  2110 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.715176  2079 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:41.831548 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.869769 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:41.840418  1792 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.758528 32078 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:41.699296  1866 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.844408  2104 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.878546 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:41.678741  1874 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:41.819569  2108 log.cc:927] Time spent T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.212s	user 0.002s	sys 0.002s
I20260709 12:24:41.879382 31536 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:41.880347 31469 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:41.880671  1874 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:41.872359 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 220322us
I20260709 12:24:41.872727 31541 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:24:41.851953  2064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.007s
I20260709 12:24:41.878741  2104 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:41.848287 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.882807 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.883180 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.883323  1866 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:41.883585 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.884200  2064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.008s	sys 0.007s
I20260709 12:24:41.881735 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:41.884567  2064 raft_consensus.cc:697] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:41.885965  2064 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.806492  2066 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.871511  2094 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.854053  2090 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.915918 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:41.917057 31361 connection.cc:256] RPC call timeout handler was delayed by -3.9230193799999142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 12:24:41.918486  2091 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:41.918985  2091 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.923372  1866 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:41.923652 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 53937.8us
I20260709 12:24:41.927500 31434 leader_election.cc:400] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8.
I20260709 12:24:41.927793 31434 leader_election.cc:403] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:41.867117  2018 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:41.929620  1866 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:41.930097  2018 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:41.895278  2067 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:41.930881  2067 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:41.932675 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 50996.9us
W20260709 12:24:41.933596  2107 log.cc:927] Time spent T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.612s	user 0.000s	sys 0.002s
W20260709 12:24:41.942051 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.945492 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:41.948333 31541 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:41.953939 31510 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:41.900285  1778 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.906551  2079 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:41.956440 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.958256 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.959650 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:41.960407 31536 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:41.963616 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:41.871803  2110 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:41.964202 31462 raft_consensus.cc:2376] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7. Re-sending same reply.
W20260709 12:24:41.969077 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.971515 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.938812  1875 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:41.977010 31535 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:41.975332 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:41.978729 31541 raft_consensus.cc:2410] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:41.981257 31468 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:41.984298 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.984817 31465 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:41.986877 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.987370 31539 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.987636 31466 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:41.970444  1919 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:41.990268 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:41.964520  2079 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
W20260709 12:24:41.995219 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 67850.2us
I20260709 12:24:41.998594 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:41.969136  2091 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:41.973630  2068 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:42.006506 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.003082 31434 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.005474 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.007656 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.000145  2079 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.986305  1875 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.008559 31465 raft_consensus.cc:2368] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
I20260709 12:24:41.964921  2114 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8.
I20260709 12:24:42.012440 31462 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:42.014927 31434 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:42.002074  1961 consensus_meta.cc:287] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.814s	user 0.009s	sys 0.002s
I20260709 12:24:41.999987 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:41.999796  1919 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:41.944706  2094 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.038455 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.040266 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.040921 31465 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:42.011101  1778 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:42.056150 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.007205  1885 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:42.027683  1874 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:42.207670 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 175919us
I20260709 12:24:42.150362 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:42.177050 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:42.285889 31386 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:42.071112 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:42.084363 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:42.081355 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:42.149963 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:42.084625 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.287868 31462 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.084081 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.083706 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:42.059907  1899 consensus_meta.cc:287] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.701s	user 0.004s	sys 0.008s
I20260709 12:24:42.041018  1919 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.206841 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:42.080957 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:42.298548 31387 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
W20260709 12:24:42.253753 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 238874us
I20260709 12:24:42.254208 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:42.274076 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:42.283732 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.039702  1961 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.240892  2066 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:42.289508 31395 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:42.294957 31539 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:42.300403 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.303432 31391 raft_consensus.cc:2393] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:42.304263 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:42.304975  2117 log.cc:927] Time spent T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:24:42.305886  2119 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 12:24:42.340873 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:42.308339 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:42.309190  2103 consensus_meta.cc:287] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.000s
I20260709 12:24:42.309595 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:42.311407  1866 consensus_queue.cc:1059] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:42.313606 31507 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:42.314081 31462 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:42.314152  1885 consensus_queue.cc:1059] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:42.314968  2109 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:42.323662 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.350165 31463 raft_consensus.cc:2368] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8.
I20260709 12:24:42.350525  2123 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.350716 31465 raft_consensus.cc:2393] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:42.326788 32048 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:42.351047  2123 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.351995  2045 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:42.352423  2045 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.352265 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.352952  2045 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:42.353206  2123 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:42.353255 31465 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.353899  2114 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:42.298740  1899 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:42.328164 31469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1804) took 1251 ms (client timeout 1613 ms). Trace:
I20260709 12:24:42.355908  1866 raft_consensus.cc:3055] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:42.355777 31469 rpcz_store.cc:269] 0709 12:24:41.076503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.078183 (+  1680us) service_pool.cc:224] Handling call
0709 12:24:41.443593 (+365410us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:42.327992 (+884399us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54002c5e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:42.328109 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733969536}
I20260709 12:24:42.356455  1866 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:42.357173 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.357362  1866 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.357699  1899 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:42.358575  1866 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.338647 31386 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:42.379961 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 79643.3us
W20260709 12:24:42.167037  2105 log.cc:927] Time spent T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.546s	user 0.004s	sys 0.000s
W20260709 12:24:42.170439  2099 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:24:42.340932 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.414187 31461 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:42.338541  2124 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.341884 31390 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:42.297128  2116 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.349102 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.348147 31395 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:24:42.420159 31462 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:42.358625 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 45095.1us
I20260709 12:24:42.421020 31507 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:42.422381 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:42.328727  2071 consensus_queue.cc:1059] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:42.359391  1873 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:42.328248 31510 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:42.359658  2103 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:42.360896  2110 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:42.365303  2045 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:42.367476 31465 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
W20260709 12:24:42.336978  1988 consensus_meta.cc:287] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.676s	user 0.004s	sys 0.007s
I20260709 12:24:42.381697 31434 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:42.387019 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.308086  2094 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:42.418907 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.357900 31469 raft_consensus.cc:2393] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:42.423816 31507 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:42.427268 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 99060.3us
I20260709 12:24:42.466706 31462 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
W20260709 12:24:42.472585 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 48852.5us
I20260709 12:24:42.473282 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:42.473420 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.473964 31462 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:42.474380 31461 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:42.480396 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 52307.4us
I20260709 12:24:42.481837 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.482836 31462 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:42.482936 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:42.471784 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 90160.3us
I20260709 12:24:42.484540 31434 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:42.475183 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 123557us
I20260709 12:24:42.485711 31434 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.426929  1873 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.491899 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.492019 31434 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:42.492512 31465 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
W20260709 12:24:42.450688 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.422600 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:42.423905 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 51387.8us
I20260709 12:24:42.421511  2124 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.349788  2090 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:42.486759 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:42.468392  1885 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:42.490360 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:42.502820 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.490288 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:42.503222 32077 raft_consensus.cc:2410] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:42.495292 31391 raft_consensus.cc:2410] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:42.463282  1882 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:42.503360 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.494549 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.504590 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.507279 31461 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.506608 31469 raft_consensus.cc:2393] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:42.508018 31465 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:42.425669  2020 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:42.506963 31507 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:42.508955 32080 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 10: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:42.509353 31466 raft_consensus.cc:2393] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:42.510965 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.511914 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.512871 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:42.513552 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:42.526376 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:42.490234  2007 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:42.583022 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:42.583418  2007 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.583953  2007 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.586006 32081 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:42.587328 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:42.591511 32081 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:42.592948 31393 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:42.596488 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:42.532713 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:42.461087  2109 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:24:42.494338  1873 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.502496  2066 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:42.547942 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:42.551988 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:42.509498  1885 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:42.504063  2129 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:42.494190  1899 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:42.505189  2114 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:42.551115  1882 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:42.574723  2130 log.cc:927] Time spent T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:24:42.575035  2133 log.cc:927] Time spent T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.100s	user 0.000s	sys 0.005s
I20260709 12:24:42.574723  2020 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:42.486093  1988 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:42.483899  2127 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:24:42.509305  2110 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:42.578279 32084 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:42.578647 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 52333.4us
I20260709 12:24:42.607137  2090 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:42.579906 32076 raft_consensus.cc:1240] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 10. Ops: []
I20260709 12:24:42.580116 32082 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEARNER]: Advancing to term 8
W20260709 12:24:42.580878  2134 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:24:42.587417 32079 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:42.588071 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.618640  1885 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:42.599146 31461 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:42.682194 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1789) took 1631 ms. Trace:
I20260709 12:24:42.593483 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:42.545984 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.612933 31361 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.682708 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.613607 31436 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.546537  2063 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:24:42.669832 32077 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:42.675546 31507 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:42.579460 31462 raft_consensus.cc:2410] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:42.673513  2020 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:42.682696 31470 rpcz_store.cc:276] 0709 12:24:41.050476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.051177 (+   701us) service_pool.cc:224] Handling call
0709 12:24:41.065252 (+ 14075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.801837 (+736585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.681950 (+880113us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b540004ced4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:42.682141 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495020416}
I20260709 12:24:42.684522 32081 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 10: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:42.680173 31465 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:42.684821 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:42.530375 31434 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.683619 31461 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:42.670466  1882 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:42.687551 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 104627us
I20260709 12:24:42.691123 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:42.606891  2094 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 12:24:42.673470  2101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.020s	sys 0.020s
I20260709 12:24:42.674024  2114 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:42.673698  1961 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:42.704092 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.705325 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.671361  2139 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:42.681186  2090 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:42.708135 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.721421 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:42.722041 31461 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:42.709937 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:42.722677 32084 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
W20260709 12:24:42.704141  2101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.021s	sys 0.021s
I20260709 12:24:42.723217 31462 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:42.722239 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:42.713742 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 183440us
I20260709 12:24:42.686578  2020 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:42.714622  2135 log.cc:927] Time spent T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:24:42.712086  2091 raft_consensus.cc:3055] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:42.717928  2140 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:42.718309  2139 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.718600  2114 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.719756 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:42.720131  2131 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:24:42.743837  2091 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:42.713056 31465 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:42.694284  2110 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:42.713047  2079 consensus_meta.cc:287] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.001s
I20260709 12:24:42.686491  2128 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:42.723825 31469 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:42.746845 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:42.747305 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 55185.9us
I20260709 12:24:42.704548  2081 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:42.724607 31434 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:42.764886 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 151363us
I20260709 12:24:42.769821 31510 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:42.770318 31436 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.771083 31469 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:42.771435 31510 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:42.704164  2066 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:42.748174 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 72759.9us
I20260709 12:24:42.704320  2122 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.749650 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:42.750141 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 152726us
I20260709 12:24:42.746472  2140 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.749588  2139 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:42.758625 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.773181 31462 raft_consensus.cc:2410] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:42.774089 31507 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:42.774435 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1757) took 2208 ms. Trace:
W20260709 12:24:42.775959 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 51459.8us
I20260709 12:24:42.791635 31461 raft_consensus.cc:2393] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:42.790678 31540 rpcz_store.cc:276] 0709 12:24:40.568643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.044475 (+475832us) service_pool.cc:224] Handling call
0709 12:24:41.735105 (+690630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.807727 (+ 72622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.774248 (+966521us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54003615d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:42.774369 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561729792}
I20260709 12:24:42.793556 31436 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:42.791592 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.707890  2007 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.725215  2090 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:42.806763 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.857765 31434 connection.cc:256] RPC call timeout handler was delayed by -1.3308005910002976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:24:42.862390 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 48359.4us
I20260709 12:24:42.863401 31507 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:42.762921  2136 log.cc:927] Time spent T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.102s	user 0.000s	sys 0.002s
I20260709 12:24:42.754922  2124 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:42.866250 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:42.875626 31386 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 4.
I20260709 12:24:42.774073  2109 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:42.759617  2045 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:42.883639 31469 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:42.885073 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 82551.2us
I20260709 12:24:42.774744  1899 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:42.886161 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:42.886960 31395 raft_consensus.cc:3060] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:42.799664  1778 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:42.795006  1961 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.796305  2140 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:42.867396  2081 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:42.775676  2110 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:42.778748  1919 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.874837  2063 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.899740 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 108218us
I20260709 12:24:42.879597  1450 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:42.930702 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 159391us
I20260709 12:24:42.775923  2079 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.775808  2128 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:42.890811  2114 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.778973  2091 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:42.943107 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.947436 31361 leader_election.cc:400] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
I20260709 12:24:42.909763  2081 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:42.915299  2101 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:42.927554  2110 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.954679 31467 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:42.954869  2091 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.945933  2066 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.962168 32082 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:42.971594 31395 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:42.974310  2142 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:42.949820  1988 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:42.953130  2110 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.934041  2063 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:42.975368 32082 pending_rounds.cc:85] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Aborting all ops after (but not including) 4
I20260709 12:24:42.989483 32082 pending_rounds.cc:107] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:42.983511 31361 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:42.989849 32082 raft_consensus.cc:2889] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:42.917927  1899 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:42.947878  2114 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:43.003051  2141 log.cc:927] Time spent T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:24:42.980132  2142 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:43.003515  1919 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:42.975179  2146 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:42.956590  2101 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:42.987890  2109 raft_consensus.cc:697] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:42.982692  1450 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:43.001346  1988 raft_consensus.cc:2764] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:24:43.046763 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 115181us
W20260709 12:24:43.047139 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 75588.8us
I20260709 12:24:43.048399  1450 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:42.981647  2066 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.051651 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:43.048812 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 85030.9us
I20260709 12:24:43.041703  2142 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:43.053531 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 190257us
W20260709 12:24:43.257764 31463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1792) took 2204 ms (client timeout 1785 ms). Trace:
I20260709 12:24:43.592837 31507 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:43.592905 31463 rpcz_store.cc:269] 0709 12:24:41.053719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.053857 (+   138us) service_pool.cc:224] Handling call
0709 12:24:43.257505 (+2203648us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000fa0d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:43.257676 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2839557376}
W20260709 12:24:43.061120 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.113591  2145 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:24:43.594414 31463 raft_consensus.cc:1240] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.594944 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 375) took 1619 ms. Trace:
W20260709 12:24:43.190016  1866 consensus_meta.cc:287] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.000s
I20260709 12:24:43.051538  2081 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.595371 31463 rpcz_store.cc:276] 0709 12:24:41.982223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.593963 (+1611740us) service_pool.cc:224] Handling call
0709 12:24:43.594260 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.594769 (+   509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.594903 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.596966 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1629) took 1615 ms. Trace:
I20260709 12:24:43.597333 31463 rpcz_store.cc:276] 0709 12:24:41.981581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.596167 (+1614586us) service_pool.cc:224] Handling call
0709 12:24:43.596471 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.596678 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.596706 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.596743 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:43.596777 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.596825 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.596915 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:43.334172  2120 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 1.080s	user 0.002s	sys 0.005s
W20260709 12:24:43.275089 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 388553us
I20260709 12:24:43.598726 31463 raft_consensus.cc:1240] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:43.264708 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.599431 32083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 521) took 1947 ms. Trace:
I20260709 12:24:43.489676  2124 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:43.117138  2150 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:43.112844 31544 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:43.325314 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 373) took 1359 ms. Trace:
W20260709 12:24:43.193861 31468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1810) took 1249 ms (client timeout 1636 ms). Trace:
W20260709 12:24:43.603207 31468 rpcz_store.cc:269] 0709 12:24:41.944208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.944360 (+   152us) service_pool.cc:224] Handling call
0709 12:24:43.193659 (+1249299us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400415d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:43.193787 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55396224}
I20260709 12:24:43.261554 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:43.338979 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1815) took 1393 ms. Trace:
I20260709 12:24:43.606359 31467 rpcz_store.cc:276] 0709 12:24:41.945725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.751752 (+806027us) service_pool.cc:224] Handling call
0709 12:24:42.753125 (+  1373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.955089 (+201964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.338638 (+383549us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400190854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:43.338898 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462997760}
I20260709 12:24:43.321182 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:43.070185 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 371) took 1104 ms. Trace:
I20260709 12:24:43.607781 32080 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:43.608680 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 526) took 1076 ms. Trace:
W20260709 12:24:43.322335 31464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1807) took 1848 ms (client timeout 1982 ms). Trace:
I20260709 12:24:43.599454 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 376) took 1613 ms. Trace:
I20260709 12:24:43.612439 31463 rpcz_store.cc:276] 0709 12:24:41.985637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.598219 (+1612582us) service_pool.cc:224] Handling call
0709 12:24:43.598567 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.599267 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.599414 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:43.615646 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 462404us
I20260709 12:24:43.607728 31462 rpcz_store.cc:276] 0709 12:24:41.965878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.791635 (+825757us) service_pool.cc:224] Handling call
0709 12:24:42.795607 (+  3972us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.860343 (+ 64736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.860393 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:42.865437 (+  5044us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.952146 (+ 86709us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:43.056162 (+104016us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.056458 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.056561 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.069870 (+ 13309us) raft_consensus.cc:1685] finished
0709 12:24:43.069900 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.070102 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40713,"raft.queue_time_us":74423,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":21372,"thread_start_us":128645,"threads_started":2,"wal-append.queue_time_us":106014}
W20260709 12:24:43.577088  1873 consensus_meta.cc:287] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.950s	user 0.005s	sys 0.005s
I20260709 12:24:43.188360  1671 raft_consensus.cc:3055] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:43.619488 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 65219.9us
I20260709 12:24:43.600224 32083 rpcz_store.cc:276] 0709 12:24:41.652367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.652517 (+   150us) service_pool.cc:224] Handling call
0709 12:24:41.699846 (+ 47329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.844873 (+145027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.844903 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.845330 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:24:41.961496 (+116166us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:42.149619 (+188123us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.149875 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.149969 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.333487 (+1183518us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:43.599153 (+265666us) raft_consensus.cc:1685] finished
0709 12:24:43.599255 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.599358 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":311379,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":11009,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":8494,"spinlock_wait_cycles":26566912,"thread_start_us":231143,"threads_started":2,"wal-append.queue_time_us":211255}
I20260709 12:24:43.602939 31466 rpcz_store.cc:276] 0709 12:24:41.966381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.000378 (+ 33997us) service_pool.cc:224] Handling call
0709 12:24:43.325081 (+1324703us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400299fd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:43.325242 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143508352}
W20260709 12:24:43.579295  2090 consensus_meta.cc:287] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.000s
W20260709 12:24:43.678664 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 71489.2us
W20260709 12:24:43.677635 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 84869.2us
W20260709 12:24:43.703814 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 652307us
I20260709 12:24:43.710884 31470 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.672134 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 374) took 1705 ms. Trace:
W20260709 12:24:43.581269  2139 consensus_meta.cc:287] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.000s
I20260709 12:24:43.056856  2007 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:43.583472  2020 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.809s	user 0.003s	sys 0.007s
I20260709 12:24:43.323565 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1763) took 1425 ms. Trace:
I20260709 12:24:43.245723  1874 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:43.599511  1450 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:43.571868  1882 consensus_meta.cc:287] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.000s
W20260709 12:24:43.618854 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 565417us
I20260709 12:24:43.706012  1671 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:43.711551 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:43.711537 31465 rpcz_store.cc:276] 0709 12:24:41.966612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.866493 (+899881us) service_pool.cc:224] Handling call
0709 12:24:42.874321 (+  7828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.875615 (+  1294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.875644 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:42.883512 (+  7868us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.988351 (+104839us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:42.988409 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.988509 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.671917 (+683408us) raft_consensus.cc:1685] finished
0709 12:24:43.671938 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.672073 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":949,"raft.queue_time_us":23323,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":10903,"thread_start_us":80298,"threads_started":1,"wal-append.queue_time_us":114745}
W20260709 12:24:43.709501 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 92224.9us
W20260709 12:24:43.610672 31464 rpcz_store.cc:269] 0709 12:24:41.473700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.496606 (+ 22906us) service_pool.cc:224] Handling call
0709 12:24:43.322064 (+1825458us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b540029aed4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:43.322257 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682036096}
I20260709 12:24:43.051985  2152 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.115404  2114 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.112442  1961 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.676611  2122 consensus_meta.cc:287] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.001s
I20260709 12:24:43.716913 31462 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:43.765543 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 380) took 1764 ms. Trace:
I20260709 12:24:43.766057 31462 rpcz_store.cc:276] 0709 12:24:42.001509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.642287 (+1640778us) service_pool.cc:224] Handling call
0709 12:24:43.705053 (+ 62766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.765204 (+ 60151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.765483 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.609521 32080 rpcz_store.cc:276] 0709 12:24:42.532196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.532361 (+   165us) service_pool.cc:224] Handling call
0709 12:24:43.320976 (+788615us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:43.608603 (+287627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4195072}
I20260709 12:24:43.229820  2140 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:43.227452  1716 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:43.676131  2068 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:43.712936  2158 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:43.719544 31466 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.600822  2124 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.719674 31539 rpcz_store.cc:276] 0709 12:24:41.898228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.898438 (+   210us) service_pool.cc:224] Handling call
0709 12:24:43.323333 (+1424895us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b540039e754. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:43.323464 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162269568}
I20260709 12:24:43.121083  2101 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.704492  2063 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.706578  1922 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.264266  1875 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.281189  2066 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:43.281935  2079 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.059804  2098 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.263021  1930 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:43.747489 32076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 522) took 1250 ms. Trace:
I20260709 12:24:43.862498 32076 rpcz_store.cc:276] 0709 12:24:42.497162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.497282 (+   120us) service_pool.cc:224] Handling call
0709 12:24:42.535197 (+ 37915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.680310 (+145113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.747278 (+1066968us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b54006aed50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:43.747432 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7179136}
W20260709 12:24:43.733592 31393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1811) took 2675 ms (client timeout 1933 ms). Trace:
I20260709 12:24:43.748989 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:43.864058 31393 rpcz_store.cc:269] 0709 12:24:41.058104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.058551 (+   447us) service_pool.cc:224] Handling call
0709 12:24:43.733389 (+2674838us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001a18d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:43.733513 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778162048}
I20260709 12:24:43.793013  2158 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:43.750867 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.713263  2110 consensus_meta.cc:287] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 12:24:43.812453  2091 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.764994 31464 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:43.768945 31461 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:43.769233 31465 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:43.872614 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 382) took 1865 ms. Trace:
I20260709 12:24:43.808557  2161 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.705427  1964 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:43.777499 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 66134.7us
I20260709 12:24:43.793449 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1624) took 1838 ms. Trace:
I20260709 12:24:43.877707 31469 rpcz_store.cc:276] 0709 12:24:41.955737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.771863 (+816126us) service_pool.cc:224] Handling call
0709 12:24:42.772152 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.885820 (+113668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.793188 (+907368us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000fa5d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:43.793380 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255936768}
I20260709 12:24:43.879666 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1643) took 1558 ms. Trace:
I20260709 12:24:43.880163 31469 rpcz_store.cc:276] 0709 12:24:42.321543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.878769 (+1557226us) service_pool.cc:224] Handling call
0709 12:24:43.879038 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.879198 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.879254 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.879314 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:43.879366 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.879466 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.879597 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.882275 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1649) took 1499 ms. Trace:
I20260709 12:24:43.710002  1873 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:43.885251  1873 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:43.886826 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:43.887710 31388 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:43.765136  2022 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.052s	sys 0.108s
W20260709 12:24:43.888904  2022 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.052s	sys 0.111s
I20260709 12:24:43.556674  2109 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.893003 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:43.809599 31462 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:43.894083 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1642) took 1573 ms. Trace:
I20260709 12:24:43.894425 31462 rpcz_store.cc:276] 0709 12:24:42.321178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.790615 (+1469437us) service_pool.cc:224] Handling call
0709 12:24:43.809277 (+ 18662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.893835 (+ 84558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.894032 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.894904 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:43.808825 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 381) took 1802 ms. Trace:
I20260709 12:24:43.895773 31466 rpcz_store.cc:276] 0709 12:24:42.006684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.707038 (+1700354us) service_pool.cc:224] Handling call
0709 12:24:43.719421 (+ 12383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.808549 (+ 89128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.808770 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.747189  1778 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.770081  1885 consensus_meta.cc:287] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.066s	user 0.005s	sys 0.009s
I20260709 12:24:43.716320  2090 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.719084  2139 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.768865  2122 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:43.864609 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 115741us
I20260709 12:24:43.711737 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1630) took 1721 ms. Trace:
I20260709 12:24:43.753396  1450 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:43.778013  2068 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.730446  2020 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:43.790699  2007 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:43.931694 31462 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:24:43.866219 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 155334us
I20260709 12:24:43.731575  1874 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:43.330736  2067 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:43.868317 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 103749us
I20260709 12:24:43.868978 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:43.933466 31393 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:43.872984 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 383) took 1865 ms. Trace:
I20260709 12:24:43.934275 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:43.934342 31465 rpcz_store.cc:276] 0709 12:24:42.007449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.764838 (+1757389us) service_pool.cc:224] Handling call
0709 12:24:43.768992 (+  4154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.872755 (+103763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.872928 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.186633  2128 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:43.872936 31464 rpcz_store.cc:276] 0709 12:24:42.007141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.764442 (+1757301us) service_pool.cc:224] Handling call
0709 12:24:43.764797 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.872364 (+107567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.872556 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:43.873924 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 147438us
I20260709 12:24:43.937577 32047 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:43.876358 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 165507us
I20260709 12:24:43.882666 31469 rpcz_store.cc:276] 0709 12:24:42.382920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.881322 (+1498402us) service_pool.cc:224] Handling call
0709 12:24:43.881637 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.881874 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.881910 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.881962 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:43.882009 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.882076 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.882209 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.768875  1961 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.944613  1961 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:43.897583 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:43.945310  2020 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:43.945773 31390 raft_consensus.cc:2393] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:43.946540 31463 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.931396  1450 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:43.812105  1896 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:24:43.948462  1450 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.904663  1778 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:43.861996  1930 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:43.893072  2161 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:43.949697 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 368) took 2921 ms. Trace:
I20260709 12:24:43.949795  1930 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.950109 31544 rpcz_store.cc:276] 0709 12:24:41.028065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.642929 (+614864us) service_pool.cc:224] Handling call
0709 12:24:41.662291 (+ 19362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.626331 (+1964040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.949470 (+323139us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540021e154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:43.949637 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3335393536}
I20260709 12:24:43.950592  1778 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.950840  1930 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.951483 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:43.951552  2098 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:43.951496 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:43.953588  2157 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:43.865818  2018 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.955811  2139 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:43.956868  2167 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:43.958609 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 377) took 1971 ms. Trace:
I20260709 12:24:43.731763  1882 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.959012 31468 rpcz_store.cc:276] 0709 12:24:41.987629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.604365 (+1616736us) service_pool.cc:224] Handling call
0709 12:24:43.668219 (+ 63854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.672487 (+  4268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.672517 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.673013 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.780297 (+107284us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:43.905608 (+125311us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.914114 (+  8506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.914184 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.958409 (+ 44225us) raft_consensus.cc:1685] finished
0709 12:24:43.958427 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.958552 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3856,"raft.queue_time_us":37372,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":22919,"thread_start_us":192445,"threads_started":2,"wal-append.queue_time_us":153321}
I20260709 12:24:43.960918  1882 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:43.961061 31468 raft_consensus.cc:1240] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:43.961709 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1820) took 1351 ms. Trace:
I20260709 12:24:43.868651  1716 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:43.913252  1873 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.904009 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:43.962481 31543 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:43.962885 31539 raft_consensus.cc:2410] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:43.869021  2158 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:43.913347 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:43.827908  1922 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.967890  2140 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:43.938552  2007 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.969383  1922 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.916049 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:43.916218 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:43.970309  2007 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:43.970897 31540 raft_consensus.cc:2393] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 10: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:43.971665  2090 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:43.916939 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:43.917094 31470 rpcz_store.cc:276] 0709 12:24:41.990194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.605968 (+1615774us) service_pool.cc:224] Handling call
0709 12:24:43.710704 (+104736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.711465 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.711686 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.919765 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:43.974617 31538 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:24:43.876631  2103 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:43.923082 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:43.915649 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:43.930518 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:43.933902 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:43.975937 31541 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:43.935832 31388 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:43.976518 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 386) took 1382 ms. Trace:
I20260709 12:24:43.919386 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:43.938475 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:43.976907 31465 rpcz_store.cc:276] 0709 12:24:42.593967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.939196 (+1345229us) service_pool.cc:224] Handling call
0709 12:24:43.965022 (+ 25826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.976175 (+ 11153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.976205 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.976252 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:43.976295 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.976360 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.976468 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10777}
I20260709 12:24:43.978005 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:43.940454 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:43.978677 31391 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:43.978919  1874 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:43.942476 31469 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:43.934969 31394 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:43.978623 32083 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
W20260709 12:24:43.865994  2148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.024s	sys 0.044s
I20260709 12:24:43.903812 31537 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:43.955526  2018 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:43.963964 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1652) took 1483 ms. Trace:
I20260709 12:24:44.016546 31462 rpcz_store.cc:276] 0709 12:24:42.480196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.905879 (+1425683us) service_pool.cc:224] Handling call
0709 12:24:43.914752 (+  8873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.932114 (+ 17362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.963897 (+ 31783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.962006 31468 rpcz_store.cc:276] 0709 12:24:42.610702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.960598 (+1349896us) service_pool.cc:224] Handling call
0709 12:24:43.960902 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.961489 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.961661 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.950592  2161 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:43.878644  2110 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:43.914177  2101 consensus_queue.cc:1059] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:24:43.978155  2129 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.962990 31395 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:43.891122  1671 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.006045  2174 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.007875  2124 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:44.008144 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 75145.6us
I20260709 12:24:43.912272  1885 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.006094  2169 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:44.011053 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:43.982309 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.111002 31536 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:44.011773 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:44.111903 31386 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.012466 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:43.980266 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63408.9us
W20260709 12:24:44.112236 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 69288.1us
I20260709 12:24:43.981293 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:44.109455 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 75514.5us
I20260709 12:24:44.113380 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.113586 31359 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.114225 31541 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:44.114344 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.113425 31394 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:43.982362 31436 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:44.116503 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:43.980302 32047 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:43.995323 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.979704 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1657) took 1397 ms. Trace:
I20260709 12:24:43.972009  1716 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.979728 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:44.017544 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 94578.3us
I20260709 12:24:44.024336 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.026274 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.028156 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:44.028227 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 379) took 2032 ms. Trace:
I20260709 12:24:44.030144 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 378) took 2039 ms. Trace:
I20260709 12:24:44.030864 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:44.033954 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:44.032835 31535 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:44.045270 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.136113 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:43.979346  2173 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.014353  2128 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:44.136898 31394 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.975541  1873 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:44.141326 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 202905us
I20260709 12:24:44.156026 31510 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:44.154356 31393 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.149498 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.035737  2140 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:44.151067 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:44.137532 31470 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:44.023638  2045 consensus_queue.cc:1059] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:24:44.033496  2174 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.152338 31538 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.152772 31390 raft_consensus.cc:3060] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:44.141439 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 159159us
I20260709 12:24:44.148864 31389 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:44.150043 31537 raft_consensus.cc:2410] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:44.153836 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:44.087194 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:44.173844 31395 raft_consensus.cc:2393] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:44.149051 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:44.117278 31539 raft_consensus.cc:2393] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:44.144160 31463 rpcz_store.cc:276] 0709 12:24:41.996185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.613644 (+1617459us) service_pool.cc:224] Handling call
0709 12:24:43.712534 (+ 98890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.946935 (+234401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.028008 (+ 81073us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54001c8ed4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:44.028165 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537724672}
I20260709 12:24:44.174286 31510 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:44.174286 31387 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.030297  2175 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 12:24:44.164695 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:44.151299  2091 raft_consensus.cc:2764] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:44.151799 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.110667  2169 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.168305 31359 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.164237  1450 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:44.196612 31391 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:44.140909 31469 rpcz_store.cc:276] 0709 12:24:42.582069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.938454 (+1356385us) service_pool.cc:224] Handling call
0709 12:24:43.938714 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.979480 (+ 40766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.979652 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.195870 31392 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:44.206972 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:44.203379 31387 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:44.207748 31395 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:44.153337  1716 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.210673 31510 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.156363  1671 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.204213 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:44.215099 31392 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:44.216007  2128 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:44.216501  2128 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.135941 31467 rpcz_store.cc:276] 0709 12:24:41.991058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.606987 (+1615929us) service_pool.cc:224] Handling call
0709 12:24:43.714490 (+107503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.714701 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:43.751318 (+ 36617us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.029345 (+278027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.029849 (+   504us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:44.029904 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.029962 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.030092 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34761,"prepare.queue_time_us":36926,"raft.queue_time_us":680,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":12346,"spinlock_wait_cycles":28741888,"thread_start_us":274746,"threads_started":1,"wal-append.queue_time_us":280746}
I20260709 12:24:44.216945  2128 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.218520  1885 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:44.026829  2090 consensus_queue.cc:1059] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 12:24:44.219657  2090 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:44.220072  2090 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:44.204914  1919 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.220932  2090 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.221556  1919 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:44.222011  1919 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.224509  1873 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.225593  2128 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.226717 31387 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.154464  1875 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:24:44.152676  2067 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:24:44.271996 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.176541  2124 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:44.212451 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 59348.5us
I20260709 12:24:44.288300 31394 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:44.289160 32048 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:44.213415 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 45186.4us
I20260709 12:24:44.088165  2129 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:44.289909 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 79288.9us
I20260709 12:24:44.211826 31393 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:44.260767 32083 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:44.196666  2172 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.222081  2090 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:44.250221  2142 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.003s
I20260709 12:24:44.026933  2148 consensus_queue.cc:1059] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 12:24:44.286069 31538 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:44.297147 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.172463  1874 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.240773  2128 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:44.172744  2174 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.301472 31390 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:44.240694  2110 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.333674 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.248204  2018 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:44.239585  2101 raft_consensus.cc:2804] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:44.314108 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.344027 31463 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:44.349830 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.213029  2169 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:44.239923  2045 raft_consensus.cc:3055] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:44.315740 31359 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.316637 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.355777 31540 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.240147  1450 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:44.285164 31386 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:44.319289 31468 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:44.357795 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.321300  2068 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.314411  1873 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:44.303822  2091 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:24:44.324973  2129 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:44.311267  2139 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.326853 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.227156  2158 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.329659  2022 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.330082  1882 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:44.393354  1882 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.331418  2066 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:44.319082 31470 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:44.162736  2173 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.335491 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.204595  2161 consensus_queue.cc:1059] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:24:44.341817 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.362579  2079 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:44.368907  2098 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:44.313450 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 162459us
I20260709 12:24:44.344136 31433 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:44.304015  2140 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.352970 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.353957 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.413794 31539 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:44.414008 31467 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:44.306180  2124 raft_consensus.cc:697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:44.362789 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.362895 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.419175 31535 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:44.420907 31537 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:44.374773 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.381484 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:44.422389 31468 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
W20260709 12:24:44.327557  2156 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.766s	user 0.004s	sys 0.000s
I20260709 12:24:44.382570  2101 raft_consensus.cc:697] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:44.351354  2171 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.429806  2171 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.387826  1450 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.390084  2068 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:44.390653  2129 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:44.435115  2129 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.436848 31464 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:24:44.437219  2129 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:44.392416  2175 consensus_queue.cc:1059] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:44.437937  2175 consensus_queue.cc:1243] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:24:44.393306  2022 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.331651 32048 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:44.439898 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 108305us
I20260709 12:24:44.441735 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:44.357669  2081 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.355433  2045 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:44.369377  1930 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:44.457844 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.458694 31463 raft_consensus.cc:2393] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:44.458560 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 372) took 2492 ms. Trace:
I20260709 12:24:44.459291 31461 rpcz_store.cc:276] 0709 12:24:41.966111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.792684 (+826573us) service_pool.cc:224] Handling call
0709 12:24:42.861774 (+ 69090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.872438 (+1010664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.458234 (+585796us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b5400271d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:44.458470 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085771520}
I20260709 12:24:44.460322  1882 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:44.463029  2129 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.463776  2129 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.465565  2022 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:44.466187  2129 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:44.466533  2045 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.467906  2045 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.425563  2079 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:44.470520 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 490244us
I20260709 12:24:44.471805  2079 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:44.473286 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.474295  2124 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.474789 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.483733 31537 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:44.483831 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.484798 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.405972 31540 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:44.416913 31536 raft_consensus.cc:2393] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:44.416936 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:44.418116 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 75203.5us
I20260709 12:24:44.487962 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.312541  2172 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.489001 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:44.427681 31543 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 6: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:44.490208 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:44.343508  2007 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:44.426988  2140 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.441825 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.396339 31465 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.491958 31433 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:44.317337  2142 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:44.450453 31462 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:44.449188 31434 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:44.493870 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 44766.1us
I20260709 12:24:44.493489 31433 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:44.456867  2081 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.457499 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.499522 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.499944 31539 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.501006 31540 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:44.501950 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.502650 31544 raft_consensus.cc:2393] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 5: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:44.502595 31540 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:44.472963  2101 consensus_queue.cc:237] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.230093  1919 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.446866  2098 raft_consensus.cc:697] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:44.428200  2104 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:44.475972  2158 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.488086 31359 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.498728  2129 raft_consensus.cc:2764] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:44.533516  2172 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.534071 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.534699 31544 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:44.535524 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.536139 31544 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:44.536880 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.536720  2174 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.538856  2174 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:44.540122 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.540879  2068 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.541285  2068 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.541615  2068 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.548862  2068 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.416023 31361 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.395277  1873 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:44.496119 31433 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:44.564395 31289 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:44.568528 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 72478.2us
I20260709 12:24:44.569178 31433 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:44.496109 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.505048 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.463033  2173 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:44.492566  1778 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.510980 31386 raft_consensus.cc:1275] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:44.575491 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.511704 31542 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.576295 31541 raft_consensus.cc:2410] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:44.495414  2066 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.498831  1961 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:44.515924 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.515986 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.517153 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:44.578286 31388 raft_consensus.cc:2410] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:44.491262 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.498242  2185 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.579294  1961 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.579509  2185 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:44.500252  2170 consensus_queue.cc:1059] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:24:44.577333  2066 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:44.579870  2129 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:44.501050  1716 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:44.580550  2066 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.580845  2170 raft_consensus.cc:3055] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:44.581249  2170 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:44.582141  2170 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.552189  2140 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.498123  2007 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.583510  2170 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:44.554219  2171 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.554530  2098 consensus_queue.cc:237] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.531165  2104 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:44.556394  2081 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:44.580000  2185 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.557152  1874 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.587857  1874 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.587764  2104 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.502130  2079 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:44.559376 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:44.562438 31537 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.429195 31467 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:44.563278 31434 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.563592 31539 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:44.570912 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.571820 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.568040  2155 raft_consensus.cc:3055] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:44.573720 31536 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:44.574453 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 158537us
I20260709 12:24:44.496183  1922 raft_consensus.cc:3055] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:44.579038  1778 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:44.579622 31543 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.527932  2091 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:44.557313  1919 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.557850  2142 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.577611  1671 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:44.625861 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:44.630257 31543 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:44.632234 31535 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:44.635419 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 65239.8us
I20260709 12:24:44.597561  2103 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:44.597971 31544 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:44.645996 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.602455 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.608153 31510 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.579778  1961 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.649147 32082 raft_consensus.cc:3055] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:44.649566 32082 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:44.618481 31536 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:24:44.594969  2155 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:44.616500  2140 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:24:44.653489 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:44.653734  2155 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.654304 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:44.654737  2155 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.640921 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:44.596608 31361 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.655651 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:44.655905 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.655930 31462 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:44.657338 31466 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.657642  2198 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:44.636365 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:44.619647  2110 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 12:24:44.659421 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 51334.5us
I20260709 12:24:44.643548 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:44.645103 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:44.660101 31463 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:44.594831  1922 raft_consensus.cc:740] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:24:44.647512 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 45124.4us
I20260709 12:24:44.661430  1922 consensus_queue.cc:260] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.628957  2091 raft_consensus.cc:697] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:44.662412  1922 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.663196  2174 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.663650  2174 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.663995  2174 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.664963  1919 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:44.666378  1919 consensus_queue.cc:1059] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:44.667191  2068 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:44.667394  1875 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:44.667404  2172 raft_consensus.cc:3055] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:44.668080  2172 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:44.668414 32075 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:44.663179  2091 consensus_queue.cc:237] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.670023 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:44.670606 32075 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.578809  1873 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:44.618047 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.650070 32077 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:44.647907 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.654106 31461 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:44.655400 31468 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:44.657248  2200 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:44.616277  2081 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.637151 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.710358 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:44.654649 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:44.711969 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:44.674579 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.736939 31470 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:44.671326 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 74833.9us
I20260709 12:24:44.611454  2079 raft_consensus.cc:697] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:44.736595 32075 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
W20260709 12:24:44.716463 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.738332 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.739593 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:44.741214 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.749182 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:44.767031 31535 raft_consensus.cc:2410] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:44.749162 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.668274  1875 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:24:44.656391 32078 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:44.773111 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:44.774271 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.651933  1778 consensus_queue.cc:1059] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
W20260709 12:24:44.746132  2194 log.cc:927] Time spent T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:24:44.776077 32077 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:24:44.667197  1919 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:24:44.736050  2081 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.777385 31510 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.748811  2067 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:44.779403 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.780053 31539 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.750605  2022 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:44.781764 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 144636us
I20260709 12:24:44.645080  2190 consensus_queue.cc:1048] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:24:44.793983 31361 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:44.808967 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 145959us
I20260709 12:24:44.796821 31510 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:44.744220  2195 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:44.738415  2068 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:24:44.752115  2140 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:44.748564  2189 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:44.796128  2081 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.775910  2098 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:44.813755 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:44.872162 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 58501.1us
I20260709 12:24:44.873886 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.813369  2128 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.826102  2189 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:44.815820  1882 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:24:44.816753  2158 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:24:44.875316  2045 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.875440  2098 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:44.881824  2198 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:44.870764  2079 consensus_queue.cc:237] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.797871  1450 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:44.907068  2191 log.cc:927] Time spent T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:24:44.895977  2067 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:44.856199  2200 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:24:44.811388  2022 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:44.927279 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 102463us
I20260709 12:24:44.938375 31433 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:44.928791 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 115006us
I20260709 12:24:44.831697  2169 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:44.947702  2202 log.cc:927] Time spent T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:24:44.948508  2169 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:44.949023  2201 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:24:44.949311  2022 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:44.950160 31433 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:44.825142  2192 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:24:44.816279  2195 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:44.897914  2189 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.907143  2128 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.810530  1885 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.957746 31470 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
W20260709 12:24:44.960299  2090 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.635s	user 0.003s	sys 0.007s
I20260709 12:24:44.934273  2198 raft_consensus.cc:697] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:44.972150 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:45.004043 31395 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:24:45.004500 31395 pending_rounds.cc:85] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 5
I20260709 12:24:44.911767  2045 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.004796 31395 pending_rounds.cc:107] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:24:45.005102 31395 raft_consensus.cc:2889] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:45.030224 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.960968  2067 raft_consensus.cc:697] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:44.964430  2128 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:44.924175  2098 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:44.973029  1885 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.929572  2185 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.051781  2207 raft_consensus.cc:2804] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:45.052462  2213 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:45.006942  2140 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:45.005460  2110 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:45.052651  2197 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:24:45.065694 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:45.069878  2174 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:45.039556  2128 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.049021  1778 consensus_queue.cc:1243] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:45.002038  2200 consensus_queue.cc:1059] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:24:44.977098  1874 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.044080  2068 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:45.048571  1885 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.104182 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1775) took 1093 ms. Trace:
W20260709 12:24:45.111931 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.105410 31395 rpcz_store.cc:276] 0709 12:24:44.010233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.225156 (+214923us) service_pool.cc:224] Handling call
0709 12:24:44.225505 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.005560 (+780055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.103937 (+ 98377us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54000942d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:45.104123 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789490048}
W20260709 12:24:45.077188 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 127106us
I20260709 12:24:45.086972 31539 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:45.088382 32083 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:45.093446 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:45.122526 31535 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.035892  2206 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:24:45.079881  2207 raft_consensus.cc:697] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:45.084293  2213 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:45.101310  1716 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:45.139894 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 199771us
I20260709 12:24:45.134907 32050 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:45.144651 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:45.096447  2140 raft_consensus.cc:697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:45.163795 31539 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:45.059002  2209 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:24:45.095633  1873 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:45.104918  2068 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:45.173220 32082 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.182067 32082 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:45.144052  2212 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.183697 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 309902us
I20260709 12:24:45.172618  2018 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:45.186210 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:45.138366  2169 consensus_queue.cc:1059] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:24:45.187956 31469 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
W20260709 12:24:45.180469  2199 log.cc:927] Time spent T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:24:45.176487  1873 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.193280 31461 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:45.032269 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:45.187907 31361 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:45.178916  2146 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.197286 31361 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:45.203159 31468 raft_consensus.cc:1240] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:45.200740 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:45.204449  1450 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:45.206635  2218 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.206832  2098 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:45.189828  2018 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.207367  2195 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:45.208010 31289 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 5 to 8, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:45.103417  2198 consensus_queue.cc:237] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:45.229084 32082 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:45.141237  2067 consensus_queue.cc:237] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:45.202651  2155 consensus_meta.cc:287] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.002s
I20260709 12:24:45.237879 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:45.240869  2186 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:24:45.197165  1873 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:45.202934  2090 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.219776  2215 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:45.271687  2214 log.cc:927] Time spent T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 12:24:45.275858  2208 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:45.238973  2068 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:45.219857  2206 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:45.279928  2205 log.cc:927] Time spent T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
I20260709 12:24:45.280663  1874 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:45.280840  2216 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:24:45.281352  2045 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:45.282078  2200 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:45.239367  2218 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:45.284169 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 46421.6us
I20260709 12:24:45.241423  1875 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:45.299113 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:45.239609  2018 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.193063  2212 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:45.282984  2007 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:45.325333 31463 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:24:45.293249  1450 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:45.302640  1922 consensus_meta.cc:287] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.000s
I20260709 12:24:45.292898  2215 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:45.361315 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1738) took 1020 ms. Trace:
I20260709 12:24:45.361631 31535 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:45.240007  2213 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:45.361783 31538 rpcz_store.cc:276] 0709 12:24:44.340498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.594571 (+254073us) service_pool.cc:224] Handling call
0709 12:24:44.597663 (+  3092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.608416 (+ 10753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.608463 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.617709 (+  9246us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.002602 (+384893us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:45.140990 (+138388us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.141198 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.141303 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.361099 (+219796us) raft_consensus.cc:1685] finished
0709 12:24:45.361118 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.361250 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10342,"prepare.queue_time_us":245009,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":11055,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":15541,"spinlock_wait_cycles":1792,"thread_start_us":362764,"threads_started":2,"wal-append.queue_time_us":435252}
I20260709 12:24:45.372882 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:45.373564 31468 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:45.374104 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 47222.1us
I20260709 12:24:45.374332 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:45.326871  1875 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:45.387866 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1785) took 1004 ms. Trace:
I20260709 12:24:45.388386 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:45.390337  1875 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.390604  2215 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:45.302901  2206 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.393293  2206 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:45.267041  2207 consensus_queue.cc:237] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:45.389305 31541 rpcz_store.cc:276] 0709 12:24:44.383721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.594891 (+211170us) service_pool.cc:224] Handling call
0709 12:24:44.629763 (+ 34872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.636794 (+  7031us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:44.636825 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.637307 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.998692 (+361385us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:44.998772 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.998967 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.376360 (+377393us) raft_consensus.cc:1685] finished
0709 12:24:45.376376 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.387803 (+ 11427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35987,"raft.queue_time_us":131,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":15574,"thread_start_us":246302,"threads_started":1,"wal-append.queue_time_us":447928}
I20260709 12:24:45.267750  2140 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.372387  2210 raft_consensus.cc:3055] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:45.398046 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1773) took 1480 ms. Trace:
I20260709 12:24:45.398622 31542 rpcz_store.cc:276] 0709 12:24:43.917593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.917706 (+   113us) service_pool.cc:224] Handling call
0709 12:24:43.917959 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.576311 (+658352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.397793 (+821482us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54002b5054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:45.397972 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365052800}
I20260709 12:24:45.400825 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:45.401921 31543 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:45.389602 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:45.404284 31463 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:45.375787  2170 consensus_meta.cc:287] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.779s	user 0.002s	sys 0.009s
W20260709 12:24:45.376669  2066 consensus_meta.cc:287] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.796s	user 0.003s	sys 0.008s
I20260709 12:24:45.373467  2068 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.373663  2174 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:45.388619  2185 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:45.403853  2210 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:45.410125  2079 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:45.338750  2200 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.389101  2155 consensus_queue.cc:1059] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:24:45.418042  2098 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.456418 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:45.457321 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:45.421411  2066 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:45.457346 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:45.552978 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:45.553565 31390 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.547029 31389 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:24:45.555817 31389 pending_rounds.cc:85] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 8
I20260709 12:24:45.467200 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:45.556110 31389 pending_rounds.cc:107] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:24:45.459841  2091 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:45.556176 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:45.557199 31391 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:45.557335  2230 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:24:45.558210 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:45.558410 31467 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:45.558786 31391 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:45.561733 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.562852 32050 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:45.556383 31389 raft_consensus.cc:2889] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:45.565333 31388 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:45.566151 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:45.556303 31392 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:45.567123 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:45.567513 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:45.568205 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:45.568557 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:45.567590 31391 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:45.569646 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:45.569685 31395 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
W20260709 12:24:45.570364 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.570401 31391 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:45.567827 31388 raft_consensus.cc:2376] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10. Re-sending same reply.
I20260709 12:24:45.431838  2218 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:45.597376 31390 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:45.419783  2128 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:45.701598 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 298042us
W20260709 12:24:46.149633 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.770745 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.606s (SENT) [suppressed 45 similar messages]
I20260709 12:24:45.695683 31468 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:45.466639 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:45.977900 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.518290 32081 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:24:45.646510 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:45.466264 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:46.056686 32083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 543) took 1452 ms. Trace:
W20260709 12:24:46.147670 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 584850us
I20260709 12:24:45.432925  2222 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.167042 31391 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:46.168421 32083 rpcz_store.cc:276] 0709 12:24:44.604198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.604370 (+   172us) service_pool.cc:224] Handling call
0709 12:24:44.604657 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.122071 (+517414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.056351 (+934280us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54000dbbd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:46.056602 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111795456}
I20260709 12:24:46.147867 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:46.153483 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:46.049832 31289 catalog_manager.cc:5697] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 6, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 6 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:46.168637 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:45.424969  2215 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:46.177191 31538 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:24:45.801883  1961 consensus_meta.cc:287] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.071s	user 0.012s	sys 0.000s
I20260709 12:24:45.520828  2079 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.251614 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:46.285935 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:46.231372 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:46.231102 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 62872.6us
W20260709 12:24:45.738618  2081 consensus_meta.cc:287] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.855s	user 0.006s	sys 0.006s
I20260709 12:24:46.228209 31542 raft_consensus.cc:2393] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:45.798137  2231 log.cc:927] Time spent T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:24:46.171954 31390 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
W20260709 12:24:46.230479  2213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.009s	sys 0.004s
I20260709 12:24:45.957207  2146 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:45.671983  2140 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:46.280640 31393 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:46.229351 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 58952.4us
I20260709 12:24:46.178399 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:46.247628 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:46.020228  1885 consensus_meta.cc:287] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.000s
W20260709 12:24:45.641053 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.290413 31387 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:45.529861  2189 consensus_meta.cc:287] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.001s
I20260709 12:24:45.811648  2124 raft_consensus.cc:3055] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:46.076514  2173 raft_consensus.cc:3055] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:46.142542  2233 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 12:24:45.815771 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:46.294483 32048 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:46.045629 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:45.646677  2170 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:46.036804  2110 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:46.248451  2068 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.000s
I20260709 12:24:46.133471  2128 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:45.815435  1922 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.716325  2103 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:46.287740  1716 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:24:45.594062  2098 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.595525  2091 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.566512  1450 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.741s
I20260709 12:24:45.459328  1875 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.286746 31395 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.594936  1873 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:45.963351  2210 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.408473 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:46.670857 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:46.393530 31289 catalog_manager.cc:5697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:46.338850  2045 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:46.678301  2045 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.678529 31289 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:46.679423 31292 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38044 (request call id 249) took 32770 ms (client timeout 15000 ms). Trace:
I20260709 12:24:46.680388 31289 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:46.617811 32081 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 552) took 1992 ms (client timeout 1606 ms). Trace:
I20260709 12:24:46.299260 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:46.696765 32079 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.803663  2142 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.384073 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:46.682313 32084 raft_consensus.cc:2393] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:46.682605 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1857) took 1369 ms. Trace:
I20260709 12:24:46.519666 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:46.695731 31542 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:46.702863 32084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 557) took 2067 ms (client timeout 2063 ms). Trace:
I20260709 12:24:46.380616 31390 raft_consensus.cc:1275] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:24:46.703529 32084 rpcz_store.cc:269] 0709 12:24:44.635552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.649426 (+ 13874us) service_pool.cc:224] Handling call
0709 12:24:45.815603 (+1166177us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:46.702796 (+887193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56483200}
I20260709 12:24:45.777014  2211 raft_consensus.cc:3055] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:46.702939 31462 rpcz_store.cc:276] 0709 12:24:45.313447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.326674 (+ 13227us) service_pool.cc:224] Handling call
0709 12:24:45.374986 (+ 48312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.409926 (+ 34940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.409956 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.418240 (+  8284us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.704918 (+286678us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:45.704973 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.705065 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.639601 (+934536us) raft_consensus.cc:1685] finished
0709 12:24:46.639624 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.682524 (+ 42900us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36145,"raft.queue_time_us":40482,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":15587,"thread_start_us":242925,"threads_started":1,"wal-append.queue_time_us":865696}
I20260709 12:24:46.067705  2104 raft_consensus.cc:3055] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:46.701552 31436 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:46.285092  1671 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.451s
I20260709 12:24:46.418367  2238 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:46.681878 32081 rpcz_store.cc:269] 0709 12:24:44.625786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.631513 (+  5727us) service_pool.cc:224] Handling call
0709 12:24:46.617518 (+1986005us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b5400530cd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:46.617693 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570396928}
I20260709 12:24:46.700318  2103 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:46.570888  2155 consensus_queue.cc:1059] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
W20260709 12:24:46.708189  2090 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.423s	user 0.007s	sys 0.006s
I20260709 12:24:46.708660 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:46.708683 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:46.701066 31289 catalog_manager.cc:5697] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 3 to 6, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 6 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.798497  2172 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:46.712540 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.697430  2213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.022s	sys 0.013s
I20260709 12:24:46.731603 31394 raft_consensus.cc:2393] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:46.723272 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:46.768985 31387 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:46.725716 31537 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:24:46.722836 31542 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:46.769923 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:46.723644 31392 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.702205 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1794) took 1042 ms. Trace:
I20260709 12:24:46.771008 31389 rpcz_store.cc:276] 0709 12:24:45.659585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.178132 (+518547us) service_pool.cc:224] Handling call
0709 12:24:46.702148 (+524016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.730717 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:46.435321  2193 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.681162  2045 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:46.706050 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 411616us
I20260709 12:24:46.729619  2098 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:46.418815  2159 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.696704  2170 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.701834  2110 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:46.737321 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:46.418480  2218 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.697649  2124 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:46.698590  2173 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:46.741955 31395 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:46.774793  2192 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:46.727026  1873 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:46.709766  1922 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.748284  2090 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:46.706625  2211 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:46.708632  2204 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:46.288848  1961 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.701714  2146 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.708878  2244 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:46.770519 31387 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:46.847425  1671 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.297145  2081 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.729641  2128 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:46.725134  2091 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:46.775322 32048 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:46.917676 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 142468us
I20260709 12:24:46.864766  2192 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:46.733353  2104 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:46.928402  2148 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:46.928952  2148 raft_consensus.cc:697] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:46.929033  2104 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.930083  2104 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:46.929901  2148 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.733498  2245 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:46.931547  2245 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.933924  2245 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:46.558691  2067 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.189s
I20260709 12:24:46.699900  1885 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.937167 32079 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:46.937463  1885 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:46.786185 31507 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.002s	sys 0.001s
W20260709 12:24:46.938227 31507 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.003s	sys 0.002s
W20260709 12:24:46.938555 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 1.16773e+06us
I20260709 12:24:46.891916  1873 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.958443 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:46.296784  2215 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.838410 31391 raft_consensus.cc:2410] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:24:46.837675 31289 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 5 to 6, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 6 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:46.709631  2142 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.843008  1875 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:46.849637 31393 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:46.784547  2193 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.873323  2218 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.853240 31392 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:46.807554  2159 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.784958  2172 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:46.864207 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.004s	sys 0.013s
W20260709 12:24:46.973680 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.004s	sys 0.013s
W20260709 12:24:46.974130 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 805950us
I20260709 12:24:46.735296  2189 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:46.874207 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.006s
W20260709 12:24:46.980003 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.015s	sys 0.006s
W20260709 12:24:46.980381 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 694400us
I20260709 12:24:46.983039  2142 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:46.983259 31386 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:46.881410  2203 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:46.984054 32075 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:46.917487  1450 consensus_queue.cc:1059] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:24:46.984054  2203 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.986789  2203 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:46.968776  1875 consensus_queue.cc:1059] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:24:46.679913 31292 rpcz_store.cc:269] 0709 12:24:13.841378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.841568 (+   190us) service_pool.cc:224] Handling call
0709 12:24:14.508946 (+667378us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x7b540014e454. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91226090 00007f6e912c4f3a 00007f6e9707ae9c 00007f6e9717904e 00007f6e9563a2a4 00007f6e9563a232 00007f6e9563a161 00007f6e9563a0dc 00007f6e95639392 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:46.598103 (+32089157us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:36.313247 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:36.313968 (+   721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:36.314042 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:24:36.314069 (+    27us) tablet.cc:662] Decoding operations
0709 12:24:36.338082 (+ 24013us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:36.338150 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:36.338175 (+    25us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:24:36.582285 (+244110us) tablet.cc:701] Row locks acquired
0709 12:24:36.630052 (+ 47767us) write_op.cc:260] PREPARE: finished
0709 12:24:36.679859 (+ 49807us) write_op.cc:270] Start()
0709 12:24:36.704678 (+ 24819us) write_op.cc:276] Timestamp: P: 1783599876658967 usec, L: 0
0709 12:24:36.731758 (+ 27080us) op_driver.cc:348] REPLICATION: starting
0709 12:24:36.732852 (+  1094us) log.cc:844] Serialized 5193 byte log entry
0709 12:24:37.825891 (+1093039us) op_driver.cc:464] REPLICATION: finished
0709 12:24:37.829696 (+  3805us) write_op.cc:301] APPLY: starting
0709 12:24:37.829800 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:37.830263 (+   463us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:37.830397 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:37.967717 (+137320us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:37.968263 (+   546us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:24:37.968357 (+    94us) write_op.cc:312] APPLY: finished
0709 12:24:37.968979 (+   622us) log.cc:844] Serialized 95 byte log entry
0709 12:24:37.969366 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:37.969883 (+   517us) write_op.cc:454] Released schema lock
0709 12:24:37.969952 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:37.970619 (+   667us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:37.970655 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1416892,"reported_tablets":47,"spinlock_wait_cycles":190088960,"child_traces":[["op",{"apply.queue_time_us":3516,"apply.run_cpu_time_us":5914,"apply.run_wall_time_us":140757,"num_ops":13,"prepare.queue_time_us":311937,"prepare.run_cpu_time_us":58609,"prepare.run_wall_time_us":605270,"raft.queue_time_us":50688,"raft.run_cpu_time_us":1228,"raft.run_wall_time_us":3804,"replication_time_us":1093876,"spinlock_wait_cycles":1280,"thread_start_us":449250,"threads_started":4,"wal-append.queue_time_us":410009,"wal-append.run_cpu_time_us":9874,"wal-append.run_wall_time_us":1753005}]]}
W20260709 12:24:46.983055 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.989030  1922 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:46.989482  2246 log.cc:927] Time spent T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.812s	user 0.003s	sys 0.000s
I20260709 12:24:46.989514  2247 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:46.886669  2228 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:46.865864  2018 consensus_meta.cc:287] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.517s	user 0.015s	sys 0.002s
I20260709 12:24:46.802517  2170 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:46.912106 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 175647us
I20260709 12:24:46.862656  2079 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:46.915673 31388 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:46.874414  2155 raft_consensus.cc:3055] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:46.916438 31434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.010s	sys 0.024s
I20260709 12:24:46.339313  2187 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.919016 32048 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:46.919044  1671 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.927270  2124 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.924429  2128 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:46.937827 32079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 554) took 2311 ms (client timeout 1740 ms). Trace:
I20260709 12:24:46.787835 31433 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:46.941948 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1673464320001585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260709 12:24:46.946538 31542 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:46.947131  2259 consensus_queue.cc:1059] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:46.989579  2142 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:46.951838 31538 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:46.952065 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:46.953675 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:46.955920 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:46.836966  2213 consensus_queue.cc:1059] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 12:24:46.706020  2140 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.743439  2238 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.912910  2098 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.850911  2173 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:46.941973  2192 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:46.924629  2251 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.884398  2129 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:46.979585  2189 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:47.177536 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 389726us
I20260709 12:24:46.230868  2222 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:46.992028 31289 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 5, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:46.941226  2090 consensus_queue.cc:1059] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:46.964532  1873 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:47.004122 31434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.011s	sys 0.024s
I20260709 12:24:47.155732 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:47.220247 31289 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 3 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 8 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.009335 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1759) took 1722 ms. Trace:
W20260709 12:24:47.164973 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1013535960000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:24:46.916761  2244 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:47.166787 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.221952 31537 rpcz_store.cc:276] 0709 12:24:45.286675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.298372 (+ 11697us) service_pool.cc:224] Handling call
0709 12:24:45.298694 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.769676 (+1470982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.008995 (+239319us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003ff054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:47.009256 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3281217280}
W20260709 12:24:47.223389 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0071464319998995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 12:24:47.222313 31289 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 6, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 6 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:24:47.213766 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 234945us
W20260709 12:24:47.226145 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.225261 31289 catalog_manager.cc:5697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 4, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 4 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:47.227258 31540 raft_consensus.cc:1275] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:47.227751 31540 pending_rounds.cc:85] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 2
I20260709 12:24:47.228148 31540 pending_rounds.cc:107] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:24:47.228482 31540 raft_consensus.cc:2889] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:47.176636 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 257707us
I20260709 12:24:47.226385 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:47.229872 32048 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:47.165342 32079 rpcz_store.cc:269] 0709 12:24:44.626450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.626564 (+   114us) service_pool.cc:224] Handling call
0709 12:24:46.045414 (+1418850us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:46.937734 (+892320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52244736}
W20260709 12:24:47.190544 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.231585 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.231438 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:47.231729 31542 raft_consensus.cc:1275] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:47.178750 31433 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:47.214815 31541 raft_consensus.cc:2368] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6.
I20260709 12:24:46.990331  2247 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:47.169663 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:47.176388 31535 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:24:47.274585 31544 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:47.261009 31393 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
W20260709 12:24:47.286919 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 117372us
I20260709 12:24:47.259665 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:47.245635 31390 raft_consensus.cc:1275] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:24:47.265466 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 86772.7us
I20260709 12:24:47.007752 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:47.259826 31542 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:47.234138 31540 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:47.289126 31433 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:47.009836 31465 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:47.253029 31537 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:24:47.234850 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:47.292336 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:47.293118 31467 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:47.297474 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:47.198549  1922 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:46.983165  2193 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.259332 31289 catalog_manager.cc:5697] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 5, leader changed from <none> to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 5 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:24:47.303861 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:47.318115 31541 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:47.317049 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:47.319684 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:47.330319 31538 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:47.229192  2261 raft_consensus.cc:3055] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:46.980311  2211 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:47.332187 31507 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.241s (SENT)
I20260709 12:24:47.332671 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:47.274415  2173 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:47.005985  2081 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.003068  2155 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:47.299914  2204 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.346316 31507 leader_election.cc:336] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.243s (SENT)
I20260709 12:24:47.229595  2249 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.275028  2169 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:47.334014 31361 connection.cc:256] RPC call timeout handler was delayed by -3.8480466650003109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
I20260709 12:24:47.228149  2142 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:47.358863 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 178221us
I20260709 12:24:47.214254  2098 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:47.218577  2129 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:47.319876  2228 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:47.332458  2066 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.323472  2256 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:46.997104  2018 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:47.370767 31361 connection.cc:256] RPC call timeout handler was delayed by -3.7895466650002163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 12:24:47.466665 31361 connection.cc:256] RPC call timeout handler was delayed by -3.7418466650001392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 12:24:47.467079 31361 connection.cc:256] RPC call timeout handler was delayed by -2.6294466650001596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31520000000000004s for a response
I20260709 12:24:47.266579  2259 raft_consensus.cc:3055] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:47.377810 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.344295  2110 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:47.378252 32078 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:47.378750 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:47.215821  2250 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.174s
I20260709 12:24:47.382488 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:47.488658 32082 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:47.488978 32081 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:47.213979  2251 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:47.310156  2184 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:24:47.214972  2187 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:47.339442  2261 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:47.347962  2068 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.528028 32076 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:47.411916 31465 raft_consensus.cc:2410] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:47.334755  2248 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:47.432217 31541 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:47.348449  2213 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.347358  1875 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
W20260709 12:24:47.473160 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.384934  2211 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:47.371692  1961 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:47.492916 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 188220us
W20260709 12:24:47.498718 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 209634us
I20260709 12:24:47.547435 31433 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:47.548705 31433 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:47.515842 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 169533us
W20260709 12:24:47.549696 31507 leader_election.cc:336] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.350s (SENT)
I20260709 12:24:47.550113 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:47.524463 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:47.471256  2256 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:47.544644 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:47.472659  2259 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:47.557039 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.559875 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:47.562510 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:47.571362 31391 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:47.563881 31433 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:47.572610  2104 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:47.573200  2104 raft_consensus.cc:697] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:47.574231  2104 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:47.576817 31433 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:47.577692  2203 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.578042 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:47.578969  2203 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:47.579557  2203 raft_consensus.cc:697] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:47.580597  2203 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:47.582834 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.528792  2218 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.593218 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:47.593659  2210 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:47.595831  1671 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.385138  2204 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:47.530735  2215 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.534375  2068 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:47.613196 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:47.632278 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:47.633670  2128 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:47.568681  2256 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:47.634500  1873 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:47.548331  2248 raft_consensus.cc:697] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:47.586294  2228 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:47.635040  2172 consensus_meta.cc:287] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.002s
I20260709 12:24:47.627552  1671 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:47.637154  2276 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:47.637844  2103 consensus_meta.cc:287] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.870s	user 0.006s	sys 0.002s
I20260709 12:24:47.548992  2213 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:47.638914  2129 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:47.639616  2238 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:47.587311  2066 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:47.558719  2090 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:47.635632  2280 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.641660 31433 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:47.634745 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:47.640021  2110 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:47.638782  2187 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.763319 32081 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:24:47.727722 31467 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:47.899479 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 525) took 1170 ms. Trace:
I20260709 12:24:47.894587 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:48.170552 31393 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 11: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:48.043144 31394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1782) took 2576 ms (client timeout 1795 ms). Trace:
I20260709 12:24:47.693284  2140 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:48.171868 31394 rpcz_store.cc:269] 0709 12:24:45.466203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.466423 (+   220us) service_pool.cc:224] Handling call
0709 12:24:48.042866 (+2576443us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54000a3a54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:48.043055 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331484928}
I20260709 12:24:47.895613  2212 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.760208 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:48.173378 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.173610 32080 raft_consensus.cc:2376] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9. Re-sending same reply.
I20260709 12:24:48.174188 31394 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:48.174695 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:47.831990  2090 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.176298 31391 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:47.814651  2259 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:48.177440  2259 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:47.913367  2018 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:47.859575 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.179885 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.897008 31462 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:24:47.847451 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 432397us
W20260709 12:24:47.967835 31434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.006s	sys 0.026s
W20260709 12:24:48.182732 31434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.007s	sys 0.036s
I20260709 12:24:47.900244 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 514) took 3035 ms. Trace:
I20260709 12:24:48.170946 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1866) took 1173 ms. Trace:
I20260709 12:24:47.900033 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:48.183936 31467 rpcz_store.cc:276] 0709 12:24:46.997479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.007932 (+ 10453us) service_pool.cc:224] Handling call
0709 12:24:48.170875 (+1162943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.184608 31391 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
W20260709 12:24:47.766601 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 216908us
I20260709 12:24:48.185374 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:48.186022 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 850143us
I20260709 12:24:47.888155 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:48.169144 31387 rpcz_store.cc:276] 0709 12:24:46.728848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.895526 (+166678us) service_pool.cc:224] Handling call
0709 12:24:46.895940 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.218897 (+322957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.218942 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.219002 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:47.219058 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.899221 (+680163us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002e13d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:47.899294 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.899425 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742144896}
W20260709 12:24:48.185377 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.168942 31289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.009s
W20260709 12:24:48.193956 31289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.004s	sys 0.009s
W20260709 12:24:48.193993 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.188385  2110 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.691996  2264 log.cc:927] Time spent T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.434s	user 0.001s	sys 0.000s
W20260709 12:24:48.169384  2210 consensus_meta.cc:287] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.001s
W20260709 12:24:48.191159 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.753983  2170 consensus_meta.cc:287] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.002s
I20260709 12:24:47.882547  2158 raft_consensus.cc:3055] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:48.191777 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 573834us
I20260709 12:24:48.183683 31386 rpcz_store.cc:276] 0709 12:24:44.864758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.864906 (+   148us) service_pool.cc:224] Handling call
0709 12:24:44.865181 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.983646 (+2118465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.899998 (+916352us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b540028c154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:47.900160 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4870593280}
I20260709 12:24:47.789108  2142 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:48.191017 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:47.901125  2146 consensus_meta.cc:287] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.982s	user 0.007s	sys 0.004s
W20260709 12:24:48.041594  2241 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 1.868s	user 0.008s	sys 0.008s
W20260709 12:24:48.026120  2278 log.cc:927] Time spent T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:24:47.889842 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:47.695839  2128 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.191757 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:48.202706 31507 leader_election.cc:336] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 3.321s (SENT)
I20260709 12:24:48.065173  2284 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 12:24:47.886881  2251 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:48.225845  2146 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.194950  2124 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.208758  2203 consensus_queue.cc:1048] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:24:48.231106  2128 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.203374  2173 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:48.233363 31510 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:47.898792  2155 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:47.791103  2222 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.198798  2110 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:47.647193  2192 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.197577 32047 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:47.761844  2247 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.188256 32079 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:47.836975  2066 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:47.895530  2068 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:47.883412  2268 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.748901  2159 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:48.204816  2170 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.253859  2090 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.197347  2129 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:48.236646  2251 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:48.254896  2200 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.255441 32077 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:48.195080  2140 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.186297  2204 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.256047  2268 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.259003  2170 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.258859  2140 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:47.843715  2280 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.189939  2103 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.211928  2104 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:24:48.225302  2209 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:24:48.206090  2253 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.207074  2158 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:48.230707  2146 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:48.234892  2142 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:48.235390  2284 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:48.269225  2284 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.270220  2103 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.271560  2284 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.206487  2279 consensus_queue.cc:1059] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:24:48.236508  2173 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.253497  2192 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.214780  2210 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:24:48.259251  2213 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.040596  2256 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.261137  2268 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.265450  2253 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:48.266975  2243 log.cc:927] Time spent T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 2.093s	user 0.000s	sys 0.010s
I20260709 12:24:48.267165  2280 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:47.886291  2248 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:48.272043  2261 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:48.281895  2261 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.211524 31394 raft_consensus.cc:2393] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:48.205840 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.318261 31393 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:48.318627 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.320324 31394 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:48.320602 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:48.321709 31393 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.321791 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:48.322690 31394 raft_consensus.cc:2376] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9. Re-sending same reply.
I20260709 12:24:48.324071 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:48.325188 31394 raft_consensus.cc:2376] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8. Re-sending same reply.
I20260709 12:24:48.197281 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:48.331697 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 98254.5us
I20260709 12:24:48.332258 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:48.332981 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.333567 31394 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:48.211350 31433 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:48.335822 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1859) took 3021 ms. Trace:
W20260709 12:24:48.336377 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.192257 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1867) took 1104 ms. Trace:
I20260709 12:24:48.196201 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:48.328809 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 114765us
I20260709 12:24:48.207907 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:48.343254 31462 rpcz_store.cc:276] 0709 12:24:47.088392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.089190 (+   798us) service_pool.cc:224] Handling call
0709 12:24:47.896582 (+807392us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:47.896775 (+   193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.191954 (+295179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.192201 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84883712}
I20260709 12:24:48.336452 31469 rpcz_store.cc:276] 0709 12:24:45.314310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.397064 (+ 82754us) service_pool.cc:224] Handling call
0709 12:24:45.397413 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.418037 (+ 20624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.418068 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.418459 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.697755 (+279296us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:45.697819 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.697919 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.040843 (+2342924us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:48.327448 (+286605us) raft_consensus.cc:1685] finished
0709 12:24:48.327496 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.335456 (+  7960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34176,"raft.queue_time_us":24007,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":12907,"spinlock_wait_cycles":135208832,"thread_start_us":234479,"threads_started":1,"wal-append.queue_time_us":739790}
W20260709 12:24:48.337450 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 126116us
I20260709 12:24:48.344192 31434 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:48.345885 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:48.346329 31434 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:48.346698 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:48.348114 31467 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:48.334841 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.228245 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:48.365737  2173 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.334797 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.247107  2018 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:48.352357 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.353614  1874 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:48.354871  2010 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:48.367187 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:48.246449  2066 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.463263  2148 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.464075  2148 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.466873  2148 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.469257  2010 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.472122  2010 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.253484  2110 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:48.256349  2155 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.479423 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 522) took 1751 ms. Trace:
I20260709 12:24:48.479938 31395 rpcz_store.cc:276] 0709 12:24:46.727982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.841331 (+113349us) service_pool.cc:224] Handling call
0709 12:24:46.852092 (+ 10761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.935640 (+ 83548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.935670 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.935721 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:46.935759 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.472148 (+1536389us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b540028d054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:48.472214 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.479102 (+  6888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191582976}
I20260709 12:24:48.480824 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1667) took 1268 ms. Trace:
I20260709 12:24:48.481261 31465 rpcz_store.cc:276] 0709 12:24:47.212395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.291599 (+ 79204us) service_pool.cc:224] Handling call
0709 12:24:48.480364 (+1188765us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400415354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:48.480618 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260836608}
I20260709 12:24:48.481851 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.483546  2018 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:48.484328  2018 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.361747  2158 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.362723  2171 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.485548  2158 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.485289  2171 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.271011  2098 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:48.364851  2237 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 2.189s	user 0.005s	sys 0.002s
I20260709 12:24:48.350943 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:48.350610 31510 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:48.482875 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:48.401368 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:48.399972  2211 consensus_meta.cc:287] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.831s	user 0.012s	sys 0.008s
I20260709 12:24:48.451483 31389 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
W20260709 12:24:48.453198 31392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 515) took 2634 ms (client timeout 2029 ms). Trace:
W20260709 12:24:48.402418  2295 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:24:48.367069  2172 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.356078 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:48.401018  2250 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.403080  2254 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:48.400470  2238 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.369477  2103 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:48.496487 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:48.367799  2142 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.473912 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1673) took 1098 ms. Trace:
I20260709 12:24:48.498457 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.370188  2104 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:48.359843  2128 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.501214 31467 rpcz_store.cc:276] 0709 12:24:47.348720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.195939 (+847219us) service_pool.cc:224] Handling call
0709 12:24:48.444781 (+248842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.399900  2242 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:48.368750  2068 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:48.487164 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 141152us
I20260709 12:24:48.370702  2129 raft_consensus.cc:697] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:48.491948 31392 rpcz_store.cc:269] 0709 12:24:45.818435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.670540 (+852105us) service_pool.cc:224] Handling call
0709 12:24:48.452629 (+1782089us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b5400405e54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:48.452913 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105616768}
I20260709 12:24:48.494267  2171 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:48.494362 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1855) took 3183 ms. Trace:
I20260709 12:24:48.473655  2256 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.495854 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:48.536202 31465 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:48.552006  2142 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.553839 31395 raft_consensus.cc:2376] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6. Re-sending same reply.
I20260709 12:24:48.368136  2146 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:48.505575  2172 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.507402 32079 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:48.553051  2242 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.558684 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:48.511605  2098 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.552593 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:48.559907  2098 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.560534 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1664) took 1349 ms. Trace:
I20260709 12:24:48.560583  2172 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:48.560989 31467 rpcz_store.cc:276] 0709 12:24:47.211510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.552161 (+1340651us) service_pool.cc:224] Handling call
0709 12:24:48.560453 (+  8292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.561532  2146 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:48.562465  2098 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.563536 32079 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:48.564078 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:48.564738 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:48.565181 31469 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:48.566196 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:48.566792  2079 raft_consensus.cc:3055] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:48.506714  2250 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.515391  2249 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:48.567646  2249 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:48.548591 32084 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:24:48.568243  2189 raft_consensus.cc:3055] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:48.515923 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:48.516013 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1796) took 2330 ms. Trace:
W20260709 12:24:48.516749 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 166449us
I20260709 12:24:48.517160 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:48.518203 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:48.519146  2248 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:48.519750 31386 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 11: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:48.570410 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.570681  2248 raft_consensus.cc:697] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:48.550151 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:48.571368 31537 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:48.571938 32078 raft_consensus.cc:2376] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11. Re-sending same reply.
I20260709 12:24:48.572006  2248 consensus_queue.cc:237] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.572628 32078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 566) took 1021 ms. Trace:
I20260709 12:24:48.539482  2148 consensus_queue.cc:1059] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:24:48.573248 32078 rpcz_store.cc:276] 0709 12:24:47.551550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.628813 (+ 77263us) service_pool.cc:224] Handling call
0709 12:24:48.549772 (+920959us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:48.572539 (+ 22767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4062464}
I20260709 12:24:48.574126  2173 raft_consensus.cc:3055] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:48.569679 31388 rpcz_store.cc:276] 0709 12:24:46.166995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.167133 (+   138us) service_pool.cc:224] Handling call
0709 12:24:46.167495 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.997158 (+829663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.470991 (+1473833us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54001a22d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:48.497479 (+ 26488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720192256}
I20260709 12:24:48.545033 32075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 552) took 2137 ms. Trace:
I20260709 12:24:48.575585 32075 rpcz_store.cc:276] 0709 12:24:46.407929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.408140 (+   211us) service_pool.cc:224] Handling call
0709 12:24:48.544567 (+2136427us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540040fe54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:48.544810 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660308224}
I20260709 12:24:48.498914  2103 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.521348 31462 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:48.522667 31393 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:48.526901  1874 raft_consensus.cc:2804] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:48.503945  2104 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:48.584565  2104 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:48.553236 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:48.586102 32082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 539) took 1223 ms. Trace:
I20260709 12:24:48.586447 32082 rpcz_store.cc:276] 0709 12:24:47.362605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.589242 (+226637us) service_pool.cc:224] Handling call
0709 12:24:48.552803 (+963561us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b58001e0698. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:48.586038 (+ 33235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4033920}
W20260709 12:24:48.547298 32076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 550) took 2163 ms (client timeout 2028 ms). Trace:
I20260709 12:24:48.530618 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 396) took 2324 ms. Trace:
I20260709 12:24:48.531836 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:48.531973 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:48.556185 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:48.567189  2079 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:48.590248 31507 leader_election.cc:336] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.606s (SENT)
I20260709 12:24:48.590445 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:48.591166  2140 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.591305 32084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 561) took 1348 ms. Trace:
I20260709 12:24:48.591380  2079 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.591926 32084 rpcz_store.cc:276] 0709 12:24:47.242439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.242580 (+   141us) service_pool.cc:224] Handling call
0709 12:24:48.547868 (+1305288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.568785 (+ 20917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.590964 (+ 22179us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54004a10d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:48.591181 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822727040}
I20260709 12:24:48.592875  2079 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.590901 31507 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:48.567700 32081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 535) took 1249 ms. Trace:
I20260709 12:24:48.515697 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:48.568924  2189 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:48.569407  2250 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.574676  2173 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:48.601624  2173 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:48.520402 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 62996.2us
I20260709 12:24:48.603158 31544 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:48.606998 31542 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:24:48.604460 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.570796 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1838) took 1101 ms. Trace:
I20260709 12:24:48.562386 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:48.519482  2254 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.575659 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:48.595698 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1854) took 1064 ms. Trace:
I20260709 12:24:48.593900 32084 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:48.587622 31543 rpcz_store.cc:276] 0709 12:24:46.205883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.206071 (+   188us) service_pool.cc:224] Handling call
0709 12:24:46.231567 (+ 25496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.235189 (+1003622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.235255 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.235316 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:47.235371 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.530047 (+1294676us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400207bd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:48.530105 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.530349 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307492608}
W20260709 12:24:48.587509 32076 rpcz_store.cc:269] 0709 12:24:46.383391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.383519 (+   128us) service_pool.cc:224] Handling call
0709 12:24:48.546734 (+2163215us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54004a10d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:48.547067 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887853440}
I20260709 12:24:48.586961  2242 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.607339 31387 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:48.595106 32081 rpcz_store.cc:276] 0709 12:24:47.318385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.509688 (+191303us) service_pool.cc:224] Handling call
0709 12:24:48.550745 (+1041057us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400111f54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:48.567481 (+ 16736us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470250752}
W20260709 12:24:48.599649 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 254080us
I20260709 12:24:48.598867 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:48.621932 31393 rpcz_store.cc:276] 0709 12:24:47.520287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.320057 (+799770us) service_pool.cc:224] Handling call
0709 12:24:48.584152 (+264095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.628644 32082 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:48.587345  2103 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.631342 31394 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:48.631868 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.635396 31388 raft_consensus.cc:2410] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:24:48.595062  1874 raft_consensus.cc:697] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:48.613065  2173 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.652870 31541 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.653342  1873 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:48.654026 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.658552 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:48.680516 31393 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:48.682859 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:48.681532 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 54399.1us
I20260709 12:24:48.534947 31466 rpcz_store.cc:276] 0709 12:24:45.310825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.310939 (+   114us) service_pool.cc:224] Handling call
0709 12:24:45.343707 (+ 32768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.399656 (+ 55949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.399686 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.404271 (+  4585us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.672283 (+268012us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:45.672323 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.024997 (+352674us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b54001c93d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:46.025063 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.363428 (+2338365us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:48.493925 (+130497us) raft_consensus.cc:1685] finished
0709 12:24:48.493947 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.494186 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12189,"raft.queue_time_us":59351,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2584,"spinlock_wait_cycles":154132992,"thread_start_us":267663,"threads_started":1,"wal-append.queue_time_us":770498}
I20260709 12:24:48.610551 31386 rpcz_store.cc:276] 0709 12:24:47.468997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.350481 (+881484us) service_pool.cc:224] Handling call
0709 12:24:48.570723 (+220242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:48.694708 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 81313.5us
I20260709 12:24:48.701990 31386 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:24:48.702929  2253 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.698736 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:48.599488  2249 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.704008 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1840) took 1233 ms. Trace:
W20260709 12:24:48.711500 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.712466 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1805) took 1557 ms. Trace:
I20260709 12:24:48.712185  2146 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.712922  2279 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:48.621253  2238 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.705475 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1807) took 1544 ms. Trace:
I20260709 12:24:48.715701 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:48.717442  2104 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.718480 31465 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.720302 31386 rpcz_store.cc:276] 0709 12:24:47.469573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.700874 (+1231301us) service_pool.cc:224] Handling call
0709 12:24:48.701552 (+   678us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:48.702421 (+   869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.702658 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.721391 31392 rpcz_store.cc:276] 0709 12:24:47.155525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.622843 (+1467318us) service_pool.cc:224] Handling call
0709 12:24:48.711725 (+ 88882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.712111 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.712135 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.712187 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:48.712215 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.712273 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.712408 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.715701 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1853) took 1195 ms. Trace:
W20260709 12:24:48.726233 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 67886.5us
I20260709 12:24:48.763106 31393 rpcz_store.cc:276] 0709 12:24:47.156121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.630810 (+1474689us) service_pool.cc:224] Handling call
0709 12:24:48.663415 (+ 32605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.699882 (+ 36467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.700106 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:48.765766 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.766433 32079 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:48.769079 31394 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:48.769500 31392 pending_rounds.cc:85] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 3
I20260709 12:24:48.769762 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1808) took 1613 ms. Trace:
I20260709 12:24:48.769824 31392 pending_rounds.cc:107] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:48.770440 31433 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:48.700023  2142 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:48.766335 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:48.770329 31394 rpcz_store.cc:276] 0709 12:24:47.156403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.679800 (+1523397us) service_pool.cc:224] Handling call
0709 12:24:48.763771 (+ 83971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.769511 (+  5740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.769705 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.771159 31392 raft_consensus.cc:2889] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:48.765535 31391 rpcz_store.cc:276] 0709 12:24:47.519960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.589678 (+ 69718us) service_pool.cc:224] Handling call
0709 12:24:48.715337 (+1125659us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001a27d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:48.715483 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780255104}
W20260709 12:24:48.790223 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 200185us
I20260709 12:24:48.774565 32079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 536) took 1432 ms. Trace:
I20260709 12:24:48.794607  2260 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.794683 31433 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:48.798424  2203 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:48.799024  2203 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:48.798556  2129 consensus_queue.cc:237] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.799598  2209 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:48.800252 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:48.801236  2253 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:48.801718 31387 raft_consensus.cc:1275] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:48.799571  2203 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.804121 31462 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:48.805393  2253 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:48.804330  2068 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:48.807389 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 83327.6us
I20260709 12:24:48.808012 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:48.808568 31510 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:48.791641 32079 rpcz_store.cc:276] 0709 12:24:47.334887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.567167 (+1232280us) service_pool.cc:224] Handling call
0709 12:24:48.652286 (+ 85119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.766960 (+114674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.767145 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.802484 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1806) took 1646 ms. Trace:
I20260709 12:24:48.809677 31433 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:48.816921 31387 rpcz_store.cc:276] 0709 12:24:47.155828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.646112 (+1490284us) service_pool.cc:224] Handling call
0709 12:24:48.763979 (+117867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.802147 (+ 38168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.802397 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.809558  2103 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.764277  2279 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.840957  2103 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:48.841562 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.842041 31388 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:48.842391  2297 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.844583  2254 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.844425 31433 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:48.854619 31541 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:48.862502  2253 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:48.863554 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:48.863956 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:48.864848 31539 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:48.865123 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:48.865871 31543 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.866364  2297 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.867586 32077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 562) took 1624 ms. Trace:
I20260709 12:24:48.867926 31434 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:48.865022 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.767565  2018 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:48.858188 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1841) took 1388 ms. Trace:
W20260709 12:24:48.871678 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.727097  2066 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.871582 31388 rpcz_store.cc:276] 0709 12:24:47.469839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.704322 (+1234483us) service_pool.cc:224] Handling call
0709 12:24:48.826608 (+122286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.857860 (+ 31252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.858114 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:48.873770 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.867980 32077 rpcz_store.cc:276] 0709 12:24:47.242914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.243045 (+   131us) service_pool.cc:224] Handling call
0709 12:24:47.302837 (+ 59792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.255874 (+953037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.867114 (+611240us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b5400494154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:48.867401 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190274304}
I20260709 12:24:48.846060  2068 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:48.854221  2279 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.880781 31391 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:48.841622  2104 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:48.730628  1874 consensus_queue.cc:237] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.884625 31466 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:48.885314 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1852) took 1365 ms. Trace:
I20260709 12:24:48.886533 31391 rpcz_store.cc:276] 0709 12:24:47.519611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.793281 (+1273670us) service_pool.cc:224] Handling call
0709 12:24:48.874562 (+ 81281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.883440 (+  8878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.885251 (+  1811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.731181  2189 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.899549 31467 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:48.898025 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:48.904940 32078 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:48.885730  2142 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:48.915202 31393 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:48.907930  2068 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:48.914691 31436 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:48.921358 31434 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:48.924346 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1846) took 1436 ms. Trace:
I20260709 12:24:48.907433  2253 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:48.930846 31393 rpcz_store.cc:276] 0709 12:24:47.488399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.776843 (+1288444us) service_pool.cc:224] Handling call
0709 12:24:48.885735 (+108892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.922382 (+ 36647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.924274 (+  1892us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.938704 31541 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:48.942669 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 98400.9us
I20260709 12:24:48.930307  2068 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:48.952322 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.923887  2142 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:48.945158 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:48.920516  2297 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:48.957527 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.955325 32075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 557) took 1356 ms. Trace:
I20260709 12:24:48.943851  2253 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:48.952363  2254 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.975921 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:48.960568  2189 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.011013  2287 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.012434  2287 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:49.015772 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 294787us
I20260709 12:24:48.975744  2129 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:49.026468 31507 leader_election.cc:336] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.606s (SENT)
I20260709 12:24:49.026755  2287 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:48.986570 32075 rpcz_store.cc:276] 0709 12:24:47.590085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.576555 (+986470us) service_pool.cc:224] Handling call
0709 12:24:48.577011 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.577393 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:48.869375 (+291982us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.946252 (+ 76877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.946358 (+   106us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:48.946425 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.946490 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.946602 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":328214,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":6141,"raft.queue_time_us":4286,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11223,"thread_start_us":269069,"threads_started":2}
I20260709 12:24:49.036185  2066 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:49.039695  2210 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.039779 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:49.040287  2210 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.040555 32079 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:49.040716  2210 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.043608 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 565) took 1778 ms. Trace:
I20260709 12:24:49.047449 31462 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:24:48.975111 31466 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:48.955350  2068 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.988889 31544 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:24:48.985826 31536 raft_consensus.cc:2468] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:24:48.991367  2184 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.991264 31434 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:48.993072  2203 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:48.991261 31468 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:49.048885 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:49.059773  2184 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:49.060246  2142 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:49.064625 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.065310  2203 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:49.065624 31461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1666) took 1853 ms (client timeout 1700 ms). Trace:
W20260709 12:24:49.066083 31461 rpcz_store.cc:269] 0709 12:24:47.212121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.290433 (+ 78312us) service_pool.cc:224] Handling call
0709 12:24:49.064255 (+1773822us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:49.065513 (+  1258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8090880}
I20260709 12:24:49.065954  2253 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:49.068578 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1669) took 1842 ms. Trace:
W20260709 12:24:49.069737 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 99227.2us
I20260709 12:24:49.072219 31466 rpcz_store.cc:276] 0709 12:24:47.212960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.896972 (+1684012us) service_pool.cc:224] Handling call
0709 12:24:48.943855 (+ 46883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.052332 (+108477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.055733 (+  3401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.075673 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:49.079911 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 123312us
I20260709 12:24:49.086814 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:49.087466 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 61030.3us
I20260709 12:24:49.088527 31543 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:49.016973  2254 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:49.115520 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 81701.4us
I20260709 12:24:49.044087 32080 rpcz_store.cc:276] 0709 12:24:47.264936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.175590 (+910654us) service_pool.cc:224] Handling call
0709 12:24:48.556979 (+381389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.557736 (+   757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.557773 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.558548 (+   775us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.681674 (+123126us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:48.681759 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.685750 (+  3991us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.726415 (+ 40665us) raft_consensus.cc:1685] finished
0709 12:24:48.726434 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.043086 (+316652us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540040fe50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:49.043370 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13073,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":166,"spinlock_wait_cycles":873907968,"thread_start_us":122349,"threads_started":1,"wal-append.queue_time_us":148348}
I20260709 12:24:49.116627 31436 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:49.118311 31436 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:49.127503 31544 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:49.088133  2203 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:49.135481 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.089921  2018 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:49.148852 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 55224.3us
I20260709 12:24:49.087548  2238 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:49.135087 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:49.140746 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 175641us
I20260709 12:24:49.153684 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 516) took 2508 ms. Trace:
I20260709 12:24:49.154124 31390 rpcz_store.cc:276] 0709 12:24:46.645062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.708997 (+ 63935us) service_pool.cc:224] Handling call
0709 12:24:46.709365 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.288092 (+578727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.148484 (+1860392us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54002e2cd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:49.153487 (+  5003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232341760}
I20260709 12:24:49.155423 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.160990 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1668) took 1948 ms. Trace:
I20260709 12:24:49.160912 31433 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:49.162573 31543 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:49.161590 31467 rpcz_store.cc:276] 0709 12:24:47.212669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.646086 (+1433417us) service_pool.cc:224] Handling call
0709 12:24:49.160790 (+514704us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002c5954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:49.160927 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284152192}
I20260709 12:24:49.174820 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.133800  2129 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:49.176494  2314 log.cc:927] Time spent T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:24:49.176568  2203 raft_consensus.cc:697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:24:49.176503  2312 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:24:49.179931 31541 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:49.179900 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 61698.8us
I20260709 12:24:49.182502 31465 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:24:49.191370 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:49.134768  2103 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:49.204429 31461 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:49.207710  2209 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.209656 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1671) took 1912 ms. Trace:
I20260709 12:24:49.213049 31461 rpcz_store.cc:276] 0709 12:24:47.296962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.069754 (+1772792us) service_pool.cc:224] Handling call
0709 12:24:49.164342 (+ 94588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.204973 (+ 40631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.209578 (+  4605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.209409 31390 raft_consensus.cc:2376] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11. Re-sending same reply.
I20260709 12:24:49.216542 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1845) took 1743 ms. Trace:
I20260709 12:24:49.216626 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.216851 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.185166  2146 consensus_queue.cc:1059] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:24:49.183436  2158 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.217527 31541 raft_consensus.cc:2393] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:49.240617 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1842) took 1770 ms. Trace:
I20260709 12:24:49.227173 31393 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:49.234301 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.189160 31388 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
W20260709 12:24:49.209285  2079 consensus_meta.cc:287] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.007s
I20260709 12:24:49.217041 31392 rpcz_store.cc:276] 0709 12:24:47.470907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.768630 (+1297723us) service_pool.cc:224] Handling call
0709 12:24:48.769156 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.867597 (+ 98441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.867631 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.868070 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.940744 (+ 72674us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:48.940813 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.940905 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.214323 (+273418us) raft_consensus.cc:1685] finished
0709 12:24:49.214355 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.214476 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":72165,"threads_started":1,"wal-append.queue_time_us":201563}
W20260709 12:24:49.271347 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 61095.4us
I20260709 12:24:49.266173 31391 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
W20260709 12:24:49.217824 31470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1662) took 2039 ms (client timeout 1676 ms). Trace:
I20260709 12:24:49.270946 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1674) took 1887 ms. Trace:
W20260709 12:24:49.273164 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 73389.8us
I20260709 12:24:49.261924 31466 raft_consensus.cc:1275] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:49.270478 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.275576 31466 pending_rounds.cc:85] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 3
I20260709 12:24:49.275022 31467 rpcz_store.cc:276] 0709 12:24:47.383933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.171845 (+1787912us) service_pool.cc:224] Handling call
0709 12:24:49.270215 (+ 98370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.270554 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.270578 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.270635 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:49.270667 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.270725 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.270870 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.276041 31466 pending_rounds.cc:107] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:49.276552 31466 raft_consensus.cc:2889] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.238642 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:49.274688 31470 rpcz_store.cc:269] 0709 12:24:47.178428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.197331 (+ 18903us) service_pool.cc:224] Handling call
0709 12:24:49.162082 (+1964751us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:49.217751 (+ 55669us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85642624}
I20260709 12:24:49.272205 31544 raft_consensus.cc:1275] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:49.249259 31386 rpcz_store.cc:276] 0709 12:24:47.470098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.776988 (+1306890us) service_pool.cc:224] Handling call
0709 12:24:48.794163 (+ 17175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.810889 (+ 16726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.810931 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.879557 (+ 68626us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.988885 (+109328us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:48.989027 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.989360 (+   333us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.225798 (+236438us) raft_consensus.cc:1685] finished
0709 12:24:49.225816 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.240559 (+ 14743us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16201,"raft.queue_time_us":16352,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":28986,"thread_start_us":44992,"threads_started":1,"wal-append.queue_time_us":310591}
I20260709 12:24:49.330312 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:49.332561 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.311877 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.392342 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.331837 31461 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
W20260709 12:24:49.312853 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 177223us
I20260709 12:24:49.331015 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:49.304785 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.304100 31434 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:49.327549 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:49.342546 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.351519 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:49.415263 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1676) took 1943 ms. Trace:
I20260709 12:24:49.415654 31461 rpcz_store.cc:276] 0709 12:24:47.472002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.272856 (+1800854us) service_pool.cc:224] Handling call
0709 12:24:49.331558 (+ 58702us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:49.411584 (+ 80026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.415186 (+  3602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.327054 31465 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:24:49.351022 32082 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: Advancing to term 9
I20260709 12:24:49.346431 31359 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:49.418788 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.419340 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1675) took 2035 ms. Trace:
I20260709 12:24:49.408555 31541 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:49.419818 31465 rpcz_store.cc:276] 0709 12:24:47.384376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.214079 (+1829703us) service_pool.cc:224] Handling call
0709 12:24:49.272983 (+ 58904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.417811 (+144828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.419287 (+  1476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.432307 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.432540 31543 raft_consensus.cc:2393] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:49.239737  2155 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:49.228946  2309 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
I20260709 12:24:49.230927  2209 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:49.424804 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 120818us
I20260709 12:24:49.440025 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:49.361995  2308 log.cc:927] Time spent T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:24:49.438766 31392 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:49.439806 32077 raft_consensus.cc:2393] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:49.225220  2254 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:49.235612  2270 raft_consensus.cc:3055] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.447678 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.448287 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1672) took 2121 ms. Trace:
I20260709 12:24:49.446187 31467 raft_consensus.cc:1275] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:49.448666 31466 rpcz_store.cc:276] 0709 12:24:47.320665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.127733 (+1807068us) service_pool.cc:224] Handling call
0709 12:24:49.184250 (+ 56517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.441353 (+257103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.441589 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.443344 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.451625 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.210598  1873 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.234s
I20260709 12:24:49.450057 31386 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:49.453531 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1678) took 1896 ms. Trace:
I20260709 12:24:49.453917 31467 rpcz_store.cc:276] 0709 12:24:47.556685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.276410 (+1719725us) service_pool.cc:224] Handling call
0709 12:24:49.376594 (+100184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.449058 (+ 72464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.453472 (+  4414us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:49.455037 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 197182us
I20260709 12:24:49.458312 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.436993  2155 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:49.273059  2158 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:49.466506 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.447506  2270 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:49.473686  2301 log.cc:927] Time spent T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.478s	user 0.002s	sys 0.001s
I20260709 12:24:49.473873  2270 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:49.474890  2307 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:24:49.475416  2270 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.476276  2198 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:49.477427 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1849) took 1987 ms. Trace:
I20260709 12:24:49.469118 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:49.226055  2210 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:49.472133 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.452512  2173 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.447572  2203 consensus_queue.cc:237] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:49.500523 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.721864 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.567610 31470 raft_consensus.cc:1240] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:49.509222 31388 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 3.
I20260709 12:24:49.505740 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.757688 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.758255 31392 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:49.509666 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.759125 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.759503 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.686056 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.760667 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.506621 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.603529 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:49.567889 31466 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:49.765754 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1875) took 1563 ms. Trace:
I20260709 12:24:49.766255 31466 rpcz_store.cc:276] 0709 12:24:48.201974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.456524 (+1254550us) service_pool.cc:224] Handling call
0709 12:24:49.562760 (+106236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.765445 (+202685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.765689 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.713231  2209 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.768151 31466 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:49.770821 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1878) took 1567 ms. Trace:
I20260709 12:24:49.771826 31466 rpcz_store.cc:276] 0709 12:24:48.203899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.767379 (+1563480us) service_pool.cc:224] Handling call
0709 12:24:49.767886 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.770471 (+  2585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.770730 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:49.768646 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 321125us
I20260709 12:24:49.767941  2209 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:49.598961 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.783912 31536 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:24:49.646559  2313 log.cc:927] Time spent T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:24:49.784284  2104 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:49.477967 31394 rpcz_store.cc:276] 0709 12:24:47.489518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.780639 (+1291121us) service_pool.cc:224] Handling call
0709 12:24:48.808306 (+ 27667us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:48.808781 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.808812 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:48.809532 (+   720us) log.cc:844] Serialized 52 byte log entry
0709 12:24:48.906773 (+ 97241us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:49.476458 (+569685us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b1800371ce0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e90e644bc 00007f6e8e1b248b 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cc455 00007f6e94cb43c7 00007f6e912c69a7 00007f6e912d60bf
0709 12:24:49.476594 (+   136us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.476839 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.476955 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.477034 (+    79us) raft_consensus.cc:1685] finished
0709 12:24:49.477151 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.477324 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":317498,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":1424,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":10060,"spinlock_wait_cycles":7990016,"thread_start_us":159915,"threads_started":2,"wal-append.queue_time_us":207036}
I20260709 12:24:49.518349 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:49.785113  2297 consensus_queue.cc:1048] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:49.523139  2198 raft_consensus.cc:697] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:49.787519  2198 consensus_queue.cc:237] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:49.791829 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.565914 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.795794  2209 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:49.796950 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1869) took 2212 ms. Trace:
I20260709 12:24:49.797346 31470 rpcz_store.cc:276] 0709 12:24:47.584703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.440885 (+1856182us) service_pool.cc:224] Handling call
0709 12:24:49.561506 (+120621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.796709 (+235203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.796900 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.779887  2249 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:49.718675 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.607321 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 104772us
W20260709 12:24:49.802062 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.560153 31464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1663) took 2380 ms (client timeout 1705 ms). Trace:
I20260709 12:24:49.461759  2254 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.604051 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.470525  2155 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:49.551394  2308 log.cc:927] Time spent T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:24:49.812721 32082 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:24:49.742964  2279 consensus_meta.cc:287] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.830s	user 0.011s	sys 0.002s
W20260709 12:24:49.804414 31464 rpcz_store.cc:269] 0709 12:24:47.179954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.203688 (+ 23734us) service_pool.cc:224] Handling call
0709 12:24:49.431636 (+2227948us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:49.560054 (+128418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85587712}
W20260709 12:24:49.814245 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.817821 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.818243 31467 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:49.687062  2158 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:49.821460 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.823915 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1876) took 1621 ms. Trace:
I20260709 12:24:49.824280 31467 rpcz_store.cc:276] 0709 12:24:48.202687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.456889 (+1254202us) service_pool.cc:224] Handling call
0709 12:24:49.801911 (+345022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.823682 (+ 21771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.823863 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.826717 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.827173 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.807765  2254 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.829667 31390 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:49.830081 31434 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:49.834781 31540 raft_consensus.cc:2410] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:49.811609  2172 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.835543 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.838186 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.839372 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.839690 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.840673 31536 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:49.843616 31390 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:49.845357 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1785) took 1315 ms. Trace:
I20260709 12:24:49.845767 31537 rpcz_store.cc:276] 0709 12:24:48.529538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.572205 (+ 42667us) service_pool.cc:224] Handling call
0709 12:24:48.572666 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.573398 (+   732us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:48.686094 (+112696us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.894645 (+208551us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.931334 (+ 36689us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.931492 (+   158us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:48.931523 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.931587 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.845131 (+913544us) raft_consensus.cc:1685] finished
0709 12:24:49.845152 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.845280 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":124186,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":1965,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":9122,"thread_start_us":272918,"threads_started":2,"wal-append.queue_time_us":326673}
I20260709 12:24:49.847669 31470 raft_consensus.cc:2410] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:24:49.848552 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.849102 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.841166 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.849622 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.850389 31467 raft_consensus.cc:2410] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:24:49.850653 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.851176 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.811113  2173 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:49.857367 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.862614 31388 raft_consensus.cc:2393] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 11: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:49.834931  2104 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.833490  2254 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.858009 31470 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:49.886353 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.820876  2279 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:49.887117 31390 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:49.835084  2018 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.887449 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.888592 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.890347 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.888240  2209 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.895823  2209 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.896330  2209 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.897128 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.865784  2171 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:49.895855 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 448828us
I20260709 12:24:49.899564 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.900427 31390 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:49.899832  2171 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:49.901666  2171 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.903306  1716 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:49.896284  2325 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 12:24:49.903970  1716 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:49.905301  2310 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.861s	user 0.002s	sys 0.000s
I20260709 12:24:49.906797  1873 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:49.909509 31510 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:49.912218 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.912983 31386 raft_consensus.cc:2393] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 5: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:49.913748 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.914466 31386 raft_consensus.cc:2410] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:49.918058 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.925532 31393 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:49.925851 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.926291 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.926510 31391 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
W20260709 12:24:49.927281 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 61524.3us
I20260709 12:24:49.929092 31537 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:49.927004 31393 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:24:49.930091 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.932380 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.933126 31387 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:49.933547 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.934064 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:49.921351  2260 consensus_meta.cc:287] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.126s	user 0.009s	sys 0.005s
I20260709 12:24:49.915211 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.920928  2184 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:49.934705 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 114591us
I20260709 12:24:49.936439 31386 raft_consensus.cc:2410] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:49.935297  2260 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:49.918514 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:49.924677 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1862) took 2928 ms. Trace:
I20260709 12:24:49.937893 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.934698 31390 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.939870 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:49.934698 31387 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:49.954599 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.940325 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:49.941192  2244 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:49.943267 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:49.939576 31469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1665) took 2727 ms (client timeout 2263 ms). Trace:
W20260709 12:24:49.958058 31469 rpcz_store.cc:269] 0709 12:24:47.211820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.345957 (+1134137us) service_pool.cc:224] Handling call
0709 12:24:49.939395 (+1593438us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001900d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:49.939501 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340043136}
I20260709 12:24:49.946327 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.947201 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.918094  2142 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:49.948283 32083 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:49.962445 31465 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:49.934589  2210 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:49.924584  1716 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:49.954900 31393 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:49.955435 31395 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.952373 31468 rpcz_store.cc:276] 0709 12:24:46.996142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.999049 (+  2907us) service_pool.cc:224] Handling call
0709 12:24:48.528492 (+1529443us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:48.528915 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.069378 (+540463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.924434 (+855056us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540036c254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:49.924593 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043169408}
I20260709 12:24:49.969334 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.961189 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:49.963703 31466 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:49.969955 31388 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
W20260709 12:24:49.855789  2068 consensus_meta.cc:287] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.000s
I20260709 12:24:49.964525 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:49.964797 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:49.966537 31391 raft_consensus.cc:3060] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.966981 31462 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:49.967833 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.842873  2172 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:49.970270 31470 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:49.973927 31393 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:49.975049 31392 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
W20260709 12:24:49.982352 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.003618 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:50.007879 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:50.008643 31393 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.009914 31536 raft_consensus.cc:2368] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6.
I20260709 12:24:50.010246  1716 raft_consensus.cc:3055] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:50.010613  1716 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:50.011369 32050 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.011569  1716 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:50.012415 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 58671.7us
I20260709 12:24:50.012578  1716 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.003062  1873 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.962217  2142 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.967068  2270 raft_consensus.cc:2764] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:50.020468 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.019222 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.021432 31392 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:24:50.033558 31468 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:50.025825 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:49.957504  2018 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:50.024139 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 105702us
I20260709 12:24:50.035660 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:50.038856 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:50.044031 31507 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.678s (SENT)
I20260709 12:24:50.044545 31507 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.045055 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:50.045302 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.033762 31392 pending_rounds.cc:85] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 4
I20260709 12:24:50.046437 31392 pending_rounds.cc:107] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:24:50.046710 31392 raft_consensus.cc:2889] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.053541 31391 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:50.057616 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:50.065032 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 43561.3us
I20260709 12:24:50.058758 31387 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:50.071838 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:50.026840  2184 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.076205 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:50.080525 31388 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.032286  2142 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.077474 32082 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:50.077370 31436 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.076442 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:50.080070 31461 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:50.085937 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:50.086827 31391 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.978488  2068 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.007352  2104 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.094067 31540 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:50.063007  2244 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:50.095366 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:50.095655 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:50.107425 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 277399us
I20260709 12:24:50.107589 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.073550  2260 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.110845 31461 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:50.112095 31390 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:50.120815 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1872) took 1043 ms. Trace:
I20260709 12:24:50.122282 31390 rpcz_store.cc:276] 0709 12:24:49.077207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.901106 (+823899us) service_pool.cc:224] Handling call
0709 12:24:50.120763 (+219657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.113111 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:50.103358  2155 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.126822  2155 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.128159 31391 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:50.128937 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:50.129736 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1879) took 1772 ms. Trace:
I20260709 12:24:50.130137 31461 rpcz_store.cc:276] 0709 12:24:48.340880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.092829 (+1751949us) service_pool.cc:224] Handling call
0709 12:24:50.110692 (+ 17863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.112666 (+  1974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.112828 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.127573 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:50.127269  2146 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:50.132926 31393 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:50.137262 31386 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:50.140782 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 120158us
I20260709 12:24:50.137890 31464 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:50.142369  2091 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:50.142402 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:50.143138 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 110275us
W20260709 12:24:50.147207 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 102213us
I20260709 12:24:50.110459  2244 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.112874  2210 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:50.118206  2253 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:50.158169 31395 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
W20260709 12:24:50.158991 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 89030.4us
I20260709 12:24:50.160609 31433 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:50.164455 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 92754us
I20260709 12:24:50.097905  2209 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.168383 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:50.170024 31388 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:50.174634 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:50.175184 31388 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.176059 31510 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:50.161397  2244 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.161314  2210 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:50.182901  2210 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.186580  2104 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.186792 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.187523 31468 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:50.152989  2260 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.188601 31468 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:50.189352  2260 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.190824 32078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 556) took 2623 ms. Trace:
I20260709 12:24:50.191092 32078 rpcz_store.cc:276] 0709 12:24:47.567247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.574591 (+1007344us) service_pool.cc:224] Handling call
0709 12:24:48.574982 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.905462 (+330480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.190612 (+1285150us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540068f1d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:50.190768 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742317824}
I20260709 12:24:50.192965 32083 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:50.194305 31465 raft_consensus.cc:2393] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:50.157913  2146 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:50.187336  2333 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:50.204613 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.256525 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 91208.9us
W20260709 12:24:50.259258 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.262590 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 72179.3us
W20260709 12:24:50.264904 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 104387us
I20260709 12:24:50.173715  2184 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.268020 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.269853 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:50.270262 31390 raft_consensus.cc:1240] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 10. Ops: [8.5-8.5]
I20260709 12:24:50.171021  2284 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:50.272183 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:50.267107  2155 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:50.274500  2328 log.cc:927] Time spent T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:24:50.275723  2172 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.275781  2209 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.276266  2171 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.276607 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.278394 31467 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:24:50.307741 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.308125 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:50.308571 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:50.308790 31544 raft_consensus.cc:2410] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:50.309136 31541 raft_consensus.cc:2410] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:50.307747 31389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1855) took 2755 ms (client timeout 1740 ms). Trace:
I20260709 12:24:50.281419 31361 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.285218 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1866) took 1209 ms. Trace:
I20260709 12:24:50.264377  2333 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:24:50.302701 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 136892us
I20260709 12:24:50.310240 31386 rpcz_store.cc:276] 0709 12:24:49.075522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.972314 (+896792us) service_pool.cc:224] Handling call
0709 12:24:50.134041 (+161727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.137659 (+  3618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.285027 (+147368us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003f1e50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:50.285160 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261346688}
I20260709 12:24:50.312132 31543 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 11: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:50.312393 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.312276 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.312364  2158 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:50.317306 31540 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:50.313776 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:50.309881 31389 rpcz_store.cc:269] 0709 12:24:47.529362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.899702 (+370340us) service_pool.cc:224] Handling call
0709 12:24:50.273056 (+2373354us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540027f954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:50.285120 (+ 12064us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311296896}
W20260709 12:24:50.317318 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.318369 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.312846 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.278652  2279 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.318869 31537 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:50.313369 31541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:50.213258  2253 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:24:50.313591  2270 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:50.323403  2270 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.324204  2018 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.325261  2068 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.325829  2270 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:50.326344  2329 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:24:50.320182  2155 raft_consensus.cc:697] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:50.316583  2333 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.329115  2155 consensus_queue.cc:237] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:50.330181 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 151402us
W20260709 12:24:50.323817  2336 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:50.332958  2272 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.333489  2272 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.335497 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:50.336083 31539 raft_consensus.cc:3060] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.333485  2172 consensus_queue.cc:1059] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:24:50.283215  2184 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.338454  1873 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:50.332823  2338 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:24:50.338577  2254 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.446007 31388 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:50.447511 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:50.448395 31388 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:50.321820 31541 raft_consensus.cc:606] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.339722 31538 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:50.339797 31543 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:50.432401  2146 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:50.438648 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 257484us
W20260709 12:24:50.439926 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 174092us
W20260709 12:24:50.355718 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.309731  1874 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.457681 31539 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
W20260709 12:24:50.365482 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.385215 31386 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:50.378077 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.483680 31544 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:50.369149 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.486527 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:50.487613 31388 raft_consensus.cc:2393] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:50.493000 31433 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.494146 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:50.496096  2018 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:50.497139  2209 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.497713  2209 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.485790  1874 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.368507  2171 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.507318 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:50.511531 31542 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.370183  2270 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:50.512104 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.515739 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 325053us
I20260709 12:24:50.338577  2184 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:50.474470  1716 consensus_queue.cc:1059] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:24:50.488863  2272 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.527812 31544 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:50.531644 31361 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.532346  2209 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.533353 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:50.539973  2272 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.540925  2272 raft_consensus.cc:2764] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:50.542712  2338 raft_consensus.cc:3055] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:50.543313  2338 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:50.543637 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 174557us
I20260709 12:24:50.546150 31433 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:50.545153 32047 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:50.526080  2068 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.544593  2338 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:50.558947 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 243472us
I20260709 12:24:50.559803 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.564744  2171 consensus_queue.cc:1059] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:50.565780  2155 raft_consensus.cc:3055] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:50.566156  2155 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:50.567030  2155 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.568051  2210 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.568624  2155 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.570429  2210 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.571105 31468 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:50.571453 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.553714  2018 consensus_queue.cc:1048] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:24:50.588691 31542 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:50.589129 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:50.597481 31469 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:50.599519 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:50.610365 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 64284.4us
I20260709 12:24:50.545107  2142 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.612149 31433 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.598258  2066 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:50.561152  2270 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:24:50.615648  2272 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:50.616333  2091 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:50.616394 31359 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:50.598606  2210 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:50.590134  2018 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:50.631094 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 86020.4us
I20260709 12:24:50.633003 31433 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.639806 31469 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:50.619557  2158 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:50.619158  2338 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.637708 31542 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:50.640594 31433 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:50.652074 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.641253 32047 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.634259  2068 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.638651  2018 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:50.668397 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.675489 32050 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.675719  2018 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.681200  2361 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.683811 31469 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:50.636319  2210 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:50.697732 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.661446  2254 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.661537  2203 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:50.715036  2363 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:50.671258  2184 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:50.659592  2158 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.671386  2249 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:50.721084  2209 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.727293 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 110905us
I20260709 12:24:50.702729  2210 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.737579 31535 raft_consensus.cc:1275] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:50.742988 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 61130.8us
I20260709 12:24:50.745229 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:50.745993 31469 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:50.725906  2363 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:50.736865  2158 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.740665  2244 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.756891 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:50.762622 31507 leader_election.cc:336] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.610s (SENT)
I20260709 12:24:50.750556  2363 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.769135 31507 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.764127 31359 leader_election.cc:400] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6.
I20260709 12:24:50.769877 31359 leader_election.cc:403] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:50.740990  2184 consensus_queue.cc:1059] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:24:50.774277 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:50.777196  2346 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.777675  2172 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:50.792888  2142 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:50.750727  2209 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:50.819996 31388 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:24:50.821048 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:50.821271 32047 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:50.821640 31388 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:50.822767 31388 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:24:50.833277 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.205s (SENT) [suppressed 67 similar messages]
W20260709 12:24:50.843353  2333 consensus_meta.cc:287] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.007s
I20260709 12:24:50.843657  2361 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.843850  2333 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.845963  2209 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.846136  2333 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:50.846483 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.851639  2333 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.853859  2333 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:50.856019 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.857183 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.856042  2333 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.857836 31470 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:50.858479  2146 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:50.859037 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:50.863516 31470 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:50.864486 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.865257 31470 raft_consensus.cc:2368] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
I20260709 12:24:50.839110  2360 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:50.866062  2360 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.866465  2360 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.867489 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:50.867749 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:50.868497  2333 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:50.869750  1716 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:50.869887  2333 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:50.870800  2333 raft_consensus.cc:3055] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:50.871150  2333 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:50.872043 31507 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.871987  2333 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.873235  2333 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:50.873644 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.876989  1874 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:50.877722  2210 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.879261  2155 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:24:50.879637  2244 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.868539 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.881551 31465 raft_consensus.cc:2393] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:50.866148 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.882440 31470 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 10: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:50.870205  1716 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.885872  2342 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:50.885228  2155 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:50.884766  2146 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.891389  2350 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.885195 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:50.890396  2018 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:50.889393 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 140170us
W20260709 12:24:50.888288  2341 log.cc:927] Time spent T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.367s	user 0.002s	sys 0.000s
I20260709 12:24:50.888656 31536 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:50.884202 31507 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:50.901561 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.900511 31434 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:50.908489 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.895643  1716 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.918776 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:50.923789  2270 consensus_queue.cc:1059] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:50.910284 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.924754 31470 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:50.925676 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.926646 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.927320 31434 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:50.928732 31361 connection.cc:256] RPC call timeout handler was delayed by -2.0842122889994243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 12:24:50.929177 31361 connection.cc:256] RPC call timeout handler was delayed by -2.0626122889993894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 12:24:50.929477 31361 connection.cc:256] RPC call timeout handler was delayed by -2.0581122889993821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 12:24:50.929775 31361 connection.cc:256] RPC call timeout handler was delayed by -1.9942122889997336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:24:50.930109 31361 connection.cc:256] RPC call timeout handler was delayed by -1.9150122889996055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 12:24:50.930357 31361 connection.cc:256] RPC call timeout handler was delayed by -1.7872122889993989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 12:24:50.930671 31361 connection.cc:256] RPC call timeout handler was delayed by -1.5559122889994796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2263s for a response
W20260709 12:24:50.930935 31361 connection.cc:256] RPC call timeout handler was delayed by -1.116712288999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2751s for a response
I20260709 12:24:50.931810  1874 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:50.933983  2018 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:50.899442  2366 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6.
I20260709 12:24:50.934765  2155 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:50.936002 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:50.950515 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.950593 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.951469 31469 raft_consensus.cc:2393] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:50.952533 31433 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.954385 31433 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:50.955739  2213 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:50.956244  2213 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:50.957886 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.959436 31433 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.931433  2360 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.963065 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:50.917392  2284 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.982705 31470 raft_consensus.cc:2393] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:50.984157 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.937532  2203 raft_consensus.cc:2804] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:50.988515 31535 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:50.932476  1874 raft_consensus.cc:697] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:50.998076  1874 consensus_queue.cc:237] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.957218  2213 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.000754 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.001461 31543 raft_consensus.cc:2368] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
I20260709 12:24:51.002365 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.002898 31543 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:51.003588 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.005718 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:51.005860  2210 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:51.006522  2210 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.006970  2210 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.009308  2210 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:50.937893  2363 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:51.011051 31387 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:50.936756  2171 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:24:50.992141 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:51.013284 31361 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:50.962952  2253 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:51.014284  2371 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.014613  2253 raft_consensus.cc:697] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:51.016001  2253 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:50.996246 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:51.020144 31470 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:51.021229 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:51.021288 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:51.013511  2158 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:50.994143  1716 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:51.003461  2368 raft_consensus.cc:3055] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:51.022730 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.023546 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:51.028626 31469 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:51.023883 31542 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:51.024325 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.029640 31537 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
W20260709 12:24:51.029716 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 208509us
I20260709 12:24:50.936861  2249 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:24:51.030794 32047 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:51.031741 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.034430 31470 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:51.035400 31469 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:51.035878 31465 raft_consensus.cc:2410] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:24:51.036255 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:50.990449  2209 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.042256 31359 leader_election.cc:400] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
I20260709 12:24:51.042536 31535 raft_consensus.cc:2393] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:51.042673 31359 leader_election.cc:403] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:50.936414  2342 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:51.044155 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 227292us
I20260709 12:24:51.046814 31470 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.047541 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:51.049620 31464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 410) took 1256 ms (client timeout 1662 ms). Trace:
W20260709 12:24:51.050100 31464 rpcz_store.cc:269] 0709 12:24:49.792943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.843370 (+ 50427us) service_pool.cc:224] Handling call
0709 12:24:51.049406 (+1206036us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540004d8d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:51.049552 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662573824}
I20260709 12:24:51.015118  2371 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.054919  2158 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:51.055091  1716 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:51.055748 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.066337 31542 raft_consensus.cc:2393] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:51.066632 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.067222 31394 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.068061 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.069571 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.070886 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.072497 31540 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:51.025144  2364 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.060484 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:51.041970  2018 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:51.062361 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 49250.1us
I20260709 12:24:51.065173  2270 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
I20260709 12:24:51.059415 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:51.087560 31538 raft_consensus.cc:2368] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9.
I20260709 12:24:51.025583  2203 raft_consensus.cc:697] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:51.073442 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.026708  2368 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:51.089663  2203 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.089781  2368 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:51.091048  2368 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.095453 31538 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:51.096381 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:51.097294  2371 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.096309  2270 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:51.052979 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.098866 31535 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
W20260709 12:24:51.075677 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 116308us
W20260709 12:24:51.100562 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.100742 31537 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.084563  2018 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.119210  2158 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:24:51.121174 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 577) took 1705 ms. Trace:
I20260709 12:24:51.121565 32080 rpcz_store.cc:276] 0709 12:24:49.416123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.416294 (+   171us) service_pool.cc:224] Handling call
0709 12:24:49.445927 (+ 29633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.446073 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:49.805489 (+359416us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.120706 (+1315217us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b180022ca20. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e90e644bc 00007f6e8e1b248b 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c23a
0709 12:24:51.120872 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.120925 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:51.120971 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.121028 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.121123 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":516682,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2548,"spinlock_wait_cycles":21116160,"thread_start_us":590056,"threads_started":2,"wal-append.queue_time_us":276584,"wal-append.run_cpu_time_us":1365,"wal-append.run_wall_time_us":1002847}
I20260709 12:24:51.130686 31394 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:51.133582 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.138130 31394 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:51.116413  2018 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.141767 31433 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:51.142944 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.144479 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.116606  2210 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:24:51.160148 31394 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.146528 31433 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:51.148579  2364 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:51.178474 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.150137  2173 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:51.187134 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.152959  2342 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:51.190523 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.191190 31391 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:51.154376 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1817) took 1206 ms. Trace:
I20260709 12:24:51.192149 31386 rpcz_store.cc:276] 0709 12:24:49.947519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.315745 (+368226us) service_pool.cc:224] Handling call
0709 12:24:50.316135 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.477881 (+161746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.154159 (+676278us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b54002e18d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:51.154320 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56400640}
I20260709 12:24:51.193495 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.194186 31386 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.154496 31361 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:51.154836 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1833) took 1137 ms. Trace:
I20260709 12:24:51.195269 31389 rpcz_store.cc:276] 0709 12:24:50.017327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.886991 (+869664us) service_pool.cc:224] Handling call
0709 12:24:50.887420 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.900045 (+ 12625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.900070 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.900512 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.022385 (+121873us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:51.022422 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.022482 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.154648 (+132166us) raft_consensus.cc:1685] finished
0709 12:24:51.154668 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.154787 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12163,"raft.queue_time_us":20466,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":44849,"thread_start_us":103406,"threads_started":1,"wal-append.queue_time_us":195024}
I20260709 12:24:51.157297 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.197829 31536 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:51.140236  2333 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.201162  2333 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:51.136876  2249 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.203738  2249 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.165725  2360 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:51.162138  2383 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:51.138115  2363 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:51.116889  2146 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:24:51.178354 31466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 403) took 1387 ms (client timeout 1526 ms). Trace:
I20260709 12:24:51.182076 31537 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:51.184104 31436 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:51.185670 31507 leader_election.cc:336] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.063s (SENT)
W20260709 12:24:51.186968  2375 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.082s	user 0.000s	sys 0.003s
I20260709 12:24:51.151803 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1670) took 3921 ms. Trace:
I20260709 12:24:51.189760  2256 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.199442 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:51.199601 32080 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:51.161784  2366 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.177983  2339 raft_consensus.cc:3055] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.205942 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.329098  2339 raft_consensus.cc:740] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:51.329823 31507 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:51.224750 31394 raft_consensus.cc:2468] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:51.331641 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.330881 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.332439 31462 rpcz_store.cc:276] 0709 12:24:47.229923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.089770 (+1859847us) service_pool.cc:224] Handling call
0709 12:24:49.113731 (+ 23961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.971602 (+857871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.151574 (+1179972us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400415d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:51.151727 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961835904}
I20260709 12:24:51.332949 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.329381 32077 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:51.333703 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.333804 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:51.334425 31466 rpcz_store.cc:269] 0709 12:24:49.790913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.791565 (+   652us) service_pool.cc:224] Handling call
0709 12:24:51.165360 (+1373795us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400272c54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:51.178288 (+ 12928us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393315200}
W20260709 12:24:51.244861 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.331660 32082 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.267159 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:51.331640 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 147605us
I20260709 12:24:51.340504 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.366999 31389 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
W20260709 12:24:51.340435 31463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1868) took 4172 ms (client timeout 2878 ms). Trace:
I20260709 12:24:51.374294 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:51.367624 31394 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.297287 31393 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
W20260709 12:24:51.364333 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 209919us
I20260709 12:24:51.206001  2249 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:51.373870 31463 rpcz_store.cc:269] 0709 12:24:47.168230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.197092 (+ 28862us) service_pool.cc:224] Handling call
0709 12:24:49.238370 (+2041278us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:51.331898 (+2093528us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540036b854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:51.340361 (+  8463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603203072}
W20260709 12:24:51.377007 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 191356us
I20260709 12:24:51.328052  2340 raft_consensus.cc:3055] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:51.331168  2333 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:51.341385  2256 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.378248 32081 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:51.380961 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:51.380950 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:51.414808 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.416028 31462 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:51.381687  2391 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 12:24:51.382289 31393 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:51.365288  1716 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.298049  2272 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.388733 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:51.426456 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 538) took 1086 ms. Trace:
I20260709 12:24:51.426854 31536 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:51.426841 31393 rpcz_store.cc:276] 0709 12:24:50.334145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.381757 (+1047612us) service_pool.cc:224] Handling call
0709 12:24:51.382064 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.420496 (+ 38432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.420673 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:51.393596 31386 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:51.394304 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:51.394671 31507 leader_election.cc:336] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.068s (SENT)
I20260709 12:24:51.395212 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.334501  1874 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.416985 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.334365  2366 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.190621  2158 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.204s
I20260709 12:24:51.374454  2383 raft_consensus.cc:697] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:51.428516 31394 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:24:51.428993 31391 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:51.431130 32048 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:51.396499  2340 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:51.431936 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.428539 32080 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:51.442067 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:51.388751  2371 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.440701 32082 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:51.419737  2256 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.436417 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.464206 32077 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:51.465137 31393 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:51.465315 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.465795 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 541) took 1131 ms. Trace:
I20260709 12:24:51.466190 31393 rpcz_store.cc:276] 0709 12:24:50.334853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.436194 (+1101341us) service_pool.cc:224] Handling call
0709 12:24:51.464954 (+ 28760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.465549 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.465739 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:51.466696 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:24:51.468583  2337 log.cc:927] Time spent T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.940s	user 0.002s	sys 0.000s
I20260709 12:24:51.485415  2364 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:51.461576 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.462265 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:51.458622  2376 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:51.457743 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.489127 32075 raft_consensus.cc:2393] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:51.470023 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 542) took 1118 ms. Trace:
I20260709 12:24:51.468565 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:51.490059 32082 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:51.467661  2238 raft_consensus.cc:3055] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:51.469565 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:51.471455 32077 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.461095  2284 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.472201 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:51.472532 32047 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:51.473994  2371 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.474817 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 540) took 1140 ms. Trace:
W20260709 12:24:51.474948  2374 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.469s	user 0.000s	sys 0.003s
W20260709 12:24:51.475924  2390 log.cc:927] Time spent T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:51.459429  2253 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 12:24:51.477507 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 82867.8us
I20260709 12:24:51.481433 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1880) took 3140 ms. Trace:
I20260709 12:24:51.482702 31393 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:51.467831  2383 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.484567 31462 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:24:51.528934 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:51.486846 32080 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:24:51.487784 32081 raft_consensus.cc:2368] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
I20260709 12:24:51.489693 31386 rpcz_store.cc:276] 0709 12:24:50.335090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.436499 (+1101409us) service_pool.cc:224] Handling call
0709 12:24:51.436777 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.453463 (+ 16686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.453510 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.453569 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:51.453626 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.453705 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.453852 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:51.424032  2333 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:24:51.500073 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:51.500855 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:51.533596 31465 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.501580 31389 rpcz_store.cc:276] 0709 12:24:50.334617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.436293 (+1101676us) service_pool.cc:224] Handling call
0709 12:24:51.474280 (+ 37987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.474462 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.474501 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.474550 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:51.474582 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.474640 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.474763 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:51.508330 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 97705.9us
I20260709 12:24:51.536906 31434 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:51.536145 31386 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:51.538877 31386 raft_consensus.cc:1275] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:51.536391 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:51.542869 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 70408us
I20260709 12:24:51.544179 32047 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:51.547947  2388 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:24:51.548326 31389 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:51.549418 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:51.550710 31470 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:51.544179 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:51.552625 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1825) took 1537 ms. Trace:
I20260709 12:24:51.553169  2401 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.553742  2401 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.554260  2401 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.553025 31390 rpcz_store.cc:276] 0709 12:24:50.015111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.663082 (+647971us) service_pool.cc:224] Handling call
0709 12:24:50.663485 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:50.752958 (+ 89473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.752994 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:50.764629 (+ 11635us) log.cc:844] Serialized 52 byte log entry
0709 12:24:50.900356 (+135727us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:50.923703 (+ 23347us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.939303 (+ 15600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.939364 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.474336 (+534972us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:51.552333 (+ 77997us) raft_consensus.cc:1685] finished
0709 12:24:51.552422 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.552556 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23543,"prepare.queue_time_us":29116,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":78309,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":23905,"spinlock_wait_cycles":36504832,"thread_start_us":150083,"threads_started":2,"wal-append.queue_time_us":159885}
I20260709 12:24:51.437309  2339 consensus_queue.cc:260] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.555792  2339 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.556768  2256 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:51.560010 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:51.562296 31393 raft_consensus.cc:1275] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:51.563067 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 404) took 1771 ms. Trace:
I20260709 12:24:51.559119  2256 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:51.495448  2238 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:51.579969 31467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 408) took 1787 ms (client timeout 1766 ms). Trace:
W20260709 12:24:51.587865 31467 rpcz_store.cc:269] 0709 12:24:49.792434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.896872 (+104438us) service_pool.cc:224] Handling call
0709 12:24:51.579252 (+1682380us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400271d54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:51.579902 (+   650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875449216}
I20260709 12:24:51.588089 31468 rpcz_store.cc:276] 0709 12:24:49.791296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.277161 (+485865us) service_pool.cc:224] Handling call
0709 12:24:50.277443 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.571510 (+294067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.562857 (+991347us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400191754. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:51.563014 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674945792}
I20260709 12:24:51.589536 31467 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:51.514072 31461 rpcz_store.cc:276] 0709 12:24:48.341422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.131067 (+1789645us) service_pool.cc:224] Handling call
0709 12:24:51.050143 (+919076us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:51.063418 (+ 13275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.063463 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:51.066956 (+  3493us) log.cc:844] Serialized 52 byte log entry
0709 12:24:51.107977 (+ 41021us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:51.108016 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.108095 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.386265 (+278170us) raft_consensus.cc:1685] finished
0709 12:24:51.386283 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.481150 (+ 94867us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b540004d8d0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:51.481364 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4153,"raft.queue_time_us":4360,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":2069088128,"thread_start_us":40536,"threads_started":1,"wal-append.queue_time_us":317453}
I20260709 12:24:51.589838 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:51.559470 31434 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:51.590869 31463 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:51.592633 31507 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.103s (SENT)
W20260709 12:24:51.582541 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 112959us
I20260709 12:24:51.585274 32047 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:51.563957 31539 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:51.580710 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:51.594987 31462 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.601397 31465 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:51.605578 31507 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:51.513295  2364 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:24:51.527153  2272 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:24:51.560276  2360 raft_consensus.cc:2764] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:24:51.627734 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 67798.3us
I20260709 12:24:51.628701 31361 leader_election.cc:400] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
W20260709 12:24:51.610381 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 51016.1us
I20260709 12:24:51.629602 31361 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:51.630729 31434 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:51.631649  2253 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:51.631886 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:51.613389 31468 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:51.581768  2366 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:51.632943  2363 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:51.633394 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.620299  2346 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.607438  2244 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:51.627295  2380 consensus_queue.cc:1059] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:24:51.634560  2244 raft_consensus.cc:697] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:24:51.619740 31507 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.117s (SENT)
I20260709 12:24:51.635699 31507 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:51.592020  2376 raft_consensus.cc:2804] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:51.630512  2333 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:51.632189  2253 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.644719 31462 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:51.647069 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:51.609596  2365 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:51.528868  2371 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:51.653090 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 537) took 1319 ms. Trace:
I20260709 12:24:51.612792  2184 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:51.657694 31387 rpcz_store.cc:276] 0709 12:24:50.333922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.919534 (+585612us) service_pool.cc:224] Handling call
0709 12:24:50.919814 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.011576 (+ 91762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.652850 (+641274us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b540028da54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:51.653023 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209256832}
I20260709 12:24:51.637826  2256 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:51.663350 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:51.663594 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:51.663599  2256 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.664423  2256 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:51.665591  2378 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.669s	user 0.000s	sys 0.002s
I20260709 12:24:51.665793 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:51.666769  2142 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:51.667124 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1832) took 1650 ms. Trace:
I20260709 12:24:51.664000 32078 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.667514 31388 rpcz_store.cc:276] 0709 12:24:50.017063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.826337 (+809274us) service_pool.cc:224] Handling call
0709 12:24:50.826699 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.891587 (+ 64888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.891619 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.892134 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.943512 (+ 51378us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.959033 (+ 15521us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.963156 (+  4123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.963263 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.175568 (+212305us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b18004a9380. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:24:51.664980 (+489412us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:51.666913 (+  1933us) raft_consensus.cc:1685] finished
0709 12:24:51.666937 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.667066 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112980,"prepare.queue_time_us":17046,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":85621,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":35054,"spinlock_wait_cycles":74840704,"thread_start_us":50953,"threads_started":1,"wal-append.queue_time_us":89307}
W20260709 12:24:51.663702 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44009.6us
I20260709 12:24:51.655114 31361 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:51.671520 31507 leader_election.cc:336] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.123s (SENT)
I20260709 12:24:51.671941 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:51.646157  2210 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:51.672977 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.674608 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 64545.5us
I20260709 12:24:51.667464  2365 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:51.638353  2346 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.646768  2253 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.694541 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.703399 31388 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:51.694424 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.704154 31395 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:51.653929  2363 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:51.582265  2340 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.715919 32077 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:51.677544  2210 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:51.724647 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 69622.7us
W20260709 12:24:51.724762 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 117762us
I20260709 12:24:51.727867 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:51.730270 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:51.752275 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.708436  2363 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.757272 31361 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:51.716861  2366 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.719333  2142 raft_consensus.cc:697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:51.729360  2210 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.725236  2171 consensus_queue.cc:1059] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:24:51.755159  2346 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:51.753865  2254 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.760074  2363 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.759116  2364 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.766187  2171 consensus_queue.cc:1243] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Peer 842fbe33f4144fa69f1fd428652b6998 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:51.808914 32077 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:51.776165  2366 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:51.812667 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 146932us
I20260709 12:24:51.729127  2244 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:51.815655  2142 consensus_queue.cc:237] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:51.817871 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 547) took 1138 ms. Trace:
I20260709 12:24:51.818334 31394 rpcz_store.cc:276] 0709 12:24:50.679926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.442194 (+762268us) service_pool.cc:224] Handling call
0709 12:24:51.442515 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.457888 (+ 15373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.457918 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.458413 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.695183 (+236770us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:51.695222 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.695359 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.817638 (+122279us) raft_consensus.cc:1685] finished
0709 12:24:51.817660 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.817807 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15091,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":146722,"threads_started":1,"wal-append.queue_time_us":265194}
W20260709 12:24:51.821866 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 64688.7us
I20260709 12:24:51.822964 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:51.825029 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 153533us
I20260709 12:24:51.775195  2368 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:24:51.826368 31507 leader_election.cc:336] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.147s (SENT)
I20260709 12:24:51.829823 31507 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:51.804587  2376 raft_consensus.cc:697] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:24:51.823753  2400 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:24:51.849323  2346 raft_consensus.cc:697] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:51.853785  2346 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:51.838666  2364 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.811007  2365 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:51.862403 31507 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.161s (SENT)
I20260709 12:24:51.864238 31507 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:51.839679  2419 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:51.873474 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 145835us
I20260709 12:24:51.883847 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.863317  2402 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.889667 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:51.890775 31394 raft_consensus.cc:2368] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8.
I20260709 12:24:51.866969  2339 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.896608 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.897686 31388 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:51.899248 31507 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.196s (SENT)
I20260709 12:24:51.872977  2272 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.882853  2146 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.955662 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.956413 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.960155 31392 raft_consensus.cc:2368] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10.
I20260709 12:24:51.960690 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:51.899595  2405 log.cc:927] Time spent T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:24:51.890020  2371 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:51.962539 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:51.991797 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 92608.1us
W20260709 12:24:52.000936 31507 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.529s (SENT)
I20260709 12:24:52.001432 31507 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:52.010172 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.011128 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.012810 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.013592 31395 raft_consensus.cc:2393] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:52.016986 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:52.025988 31359 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.025453 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:52.020572 32078 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:52.028435 31394 raft_consensus.cc:2376] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7. Re-sending same reply.
W20260709 12:24:51.997032  2018 consensus_meta.cc:287] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.849s	user 0.007s	sys 0.004s
I20260709 12:24:52.023835 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.033754 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:51.866014  2364 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.038210 31395 raft_consensus.cc:2376] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8. Re-sending same reply.
I20260709 12:24:52.037674 31392 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
W20260709 12:24:52.044515  2399 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 12:24:52.046922 31539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1808) took 1482 ms (client timeout 1721 ms). Trace:
W20260709 12:24:52.047637 31539 rpcz_store.cc:269] 0709 12:24:50.564001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.918511 (+354510us) service_pool.cc:224] Handling call
0709 12:24:52.046627 (+1128116us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b540017ff54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:52.046804 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439410944}
I20260709 12:24:52.049356 31543 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:52.056744 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 333020us
W20260709 12:24:52.057067 31507 leader_election.cc:336] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.601s (SENT)
I20260709 12:24:52.057725 31507 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:52.058908 31394 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:52.059420 32048 leader_election.cc:400] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9.
I20260709 12:24:52.060010 32048 leader_election.cc:403] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.060102 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35368 (request call id 29) took 1779 ms. Trace:
I20260709 12:24:52.054687 31436 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:52.060575 31541 rpcz_store.cc:276] 0709 12:24:50.284920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.313186 (+ 28266us) service_pool.cc:224] Handling call
0709 12:24:52.041239 (+1728053us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540011bd20. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e91239520 00007f6e912b6652 00007f6e9628460a 00007f6e8f80a7d4 00007f6e8f80a762 00007f6e8f80a691 00007f6e8f80a60c 00007f6e8f8098c2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:52.041559 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281600256}
I20260709 12:24:52.072376 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:52.079187 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.081216 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.082351 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.029838  2339 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.093034 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:52.098506 31507 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.476s (SENT)
I20260709 12:24:52.016508  2416 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.220s
W20260709 12:24:52.075006  2405 log.cc:927] Time spent T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:52.051043  1873 raft_consensus.cc:3055] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:52.099123 31507 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:51.960806  2426 consensus_queue.cc:1059] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.196s
I20260709 12:24:52.101804 31433 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.110425 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:52.110997 31536 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.111682 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:52.073771  2333 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:51.900084  2402 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:52.105096 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 90280.2us
I20260709 12:24:52.135015 32050 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:52.113929 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 87991.3us
I20260709 12:24:52.079540  2068 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:24:52.053982  2018 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.133881 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:52.136780 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.137496 31359 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.141798 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:52.121956 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:52.104892  2383 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:52.146562 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:52.149612 31392 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:52.152065 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:52.152667 31539 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:52.115267 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.155969 31535 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 11: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:52.156963 31395 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:52.157740 31535 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:52.158947 31359 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.158960 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:52.160033 31539 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:52.161993  2430 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.162186 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.017966  2376 consensus_queue.cc:237] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.170141 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.177546 31395 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:52.170710  2438 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9.
I20260709 12:24:52.171108  2424 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:52.171641  2382 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:52.172034  2427 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:24:52.172196  2425 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.172598  2414 consensus_queue.cc:1059] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
W20260709 12:24:52.173126  2407 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:24:52.172124  2184 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:52.173768 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 75312.5us
I20260709 12:24:52.176381  2426 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.183053  2068 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:52.107455  1873 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:52.185043 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:52.167874  2401 consensus_meta.cc:287] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.003s
I20260709 12:24:52.189371 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.172070  2415 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:52.167654  2371 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:52.193639 31507 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.163s (SENT)
I20260709 12:24:52.109306  2104 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:24:52.183643  2256 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 12:24:52.179311 31536 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:52.150959  2333 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.198776 31539 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:52.198910 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:52.199715 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 97979.3us
W20260709 12:24:52.204525  2413 log.cc:927] Time spent T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260709 12:24:52.205868  2429 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:52.195854  2184 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:52.207520 31541 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:52.209571 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:52.227003 31535 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:52.227051 31433 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.230561 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 548) took 1550 ms. Trace:
I20260709 12:24:52.282588 31391 rpcz_store.cc:276] 0709 12:24:50.680245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.442278 (+762033us) service_pool.cc:224] Handling call
0709 12:24:51.463470 (+ 21192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.463707 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.463748 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.464241 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.638249 (+174008us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:51.638287 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.638359 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.230373 (+592014us) raft_consensus.cc:1685] finished
0709 12:24:52.230391 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.230506 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":173605,"threads_started":1,"wal-append.queue_time_us":238341}
I20260709 12:24:52.218909  2068 raft_consensus.cc:697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:52.233484  2333 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:52.231525  2256 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.303560  2068 consensus_queue.cc:237] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:52.304812  2256 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:52.306921  2104 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:52.307057 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 80079.5us
I20260709 12:24:52.307919 31433 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:52.308673  2333 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:52.308995 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.309176  2333 raft_consensus.cc:697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:52.310177  2333 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.310729  2382 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.218658  2383 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:52.311125  2382 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:52.311549  2382 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.312112  2396 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:52.312983  2404 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:52.314039 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.240298  2018 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:52.241083 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:52.243577 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.315263 31388 raft_consensus.cc:2393] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:52.243803  1873 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:52.255405  2432 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.217824  2401 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:52.266794 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.319692 31433 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.271606 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1903) took 1148 ms. Trace:
W20260709 12:24:52.280369 31507 leader_election.cc:336] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.710s (SENT)
I20260709 12:24:52.321213 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:52.280408  2091 raft_consensus.cc:3055] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:52.183521  2436 consensus_queue.cc:1059] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.163s
W20260709 12:24:52.323758 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 57052.2us
I20260709 12:24:52.324473  2436 raft_consensus.cc:3055] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:52.324661 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:52.288367  2361 raft_consensus.cc:3055] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:52.293192  2402 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:52.226245  2368 consensus_queue.cc:1059] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:24:52.325464  2361 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:52.191704  2425 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:52.326359  2363 consensus_meta.cc:287] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.006s
I20260709 12:24:52.326412  2361 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.280872  2254 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.201603  2424 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.093s
W20260709 12:24:52.301427  2411 log.cc:927] Time spent T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 12:24:52.301905  2253 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.000s
I20260709 12:24:52.302449 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.311933  2383 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.314644 31390 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:24:52.320365 31470 rpcz_store.cc:276] 0709 12:24:51.123640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.580492 (+456852us) service_pool.cc:224] Handling call
0709 12:24:51.580815 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:51.608186 (+ 27371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.608235 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:51.618692 (+ 10457us) log.cc:844] Serialized 52 byte log entry
0709 12:24:51.676998 (+ 58306us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:51.677036 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.677104 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.271320 (+594216us) raft_consensus.cc:1685] finished
0709 12:24:52.271347 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.271536 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22147,"raft.queue_time_us":27170,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":42689,"thread_start_us":57808,"threads_started":1,"wal-append.queue_time_us":193165}
I20260709 12:24:52.249059  2364 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:52.321687 31507 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:52.322341 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.323891  2091 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:52.324410  2203 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:52.325071  2436 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:52.292654 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:52.328233 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.370054 31392 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:52.300331  2210 consensus_meta.cc:287] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.003s
I20260709 12:24:52.331879 31433 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.331988 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:52.354264 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 191031us
I20260709 12:24:52.324527  1873 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.358175 31388 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:52.352514  2209 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:52.376767 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 44850.1us
I20260709 12:24:52.377559 31391 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:24:52.355182 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 194487us
I20260709 12:24:52.336273  2416 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.326993  2363 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:52.363531 31361 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:52.392706 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 60882.3us
I20260709 12:24:52.327881  2425 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:52.371771 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:52.372897  1716 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:52.335335  2426 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:52.374887 31395 raft_consensus.cc:2393] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:52.378917 31359 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:24:52.363214 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 82878.2us
I20260709 12:24:52.380865 31388 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:52.380846 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:52.359102  2253 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:52.319197  2256 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:24:52.386003 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:52.490338 31390 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.392694 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:52.446659 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:52.335783  2284 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:24:52.363726  2424 consensus_queue.cc:1243] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:52.395260 31392 raft_consensus.cc:1240] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:52.395931 31465 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:52.472710 31386 raft_consensus.cc:2368] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10.
I20260709 12:24:52.491127 32076 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.325160  2104 consensus_queue.cc:1048] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:24:52.441435 32078 raft_consensus.cc:1240] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:24:52.491904 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 111185us
I20260709 12:24:52.380177  2209 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.389766 32048 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:24:52.495390 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.496124 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:52.491957 31395 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:52.507710 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 144297us
I20260709 12:24:52.508479 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:24:52.502130 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 123265us
I20260709 12:24:52.486038 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:52.518447 31463 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:52.396116  2203 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:52.535175  2414 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:52.535478 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 145803us
I20260709 12:24:52.536497 32048 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.538409 32048 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:52.539175  2434 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.543764  2363 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:52.539361  2437 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.545406  2438 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.546305  2438 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:52.529611 31359 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:52.376328  2210 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.500890  2018 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:52.554179 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 45800.4us
I20260709 12:24:52.562995 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:52.564123 31361 leader_election.cc:400] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
I20260709 12:24:52.564389 31361 leader_election.cc:403] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.496258  2209 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:52.552449 31395 raft_consensus.cc:1240] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:24:52.570497 31463 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:52.559837 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 65574.4us
I20260709 12:24:52.512504  2272 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:52.551818 31359 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:52.574433 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.572634 31507 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:52.526535  2364 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:52.542811  2253 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:52.535220  2445 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.554960  2363 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:52.596417 31463 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:24:52.660876 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.553619  2450 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:52.588135  2371 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.592849  2364 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:52.717044  2364 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:52.664811 31390 raft_consensus.cc:2468] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:52.583525  2426 raft_consensus.cc:2764] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:52.617304  2419 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.573307  2184 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.660732  2396 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.660892  2424 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
I20260709 12:24:52.744233  2210 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:52.763918  2401 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:52.768494 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 195906us
I20260709 12:24:52.750034  2364 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:52.751739 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1834) took 1793 ms. Trace:
W20260709 12:24:52.751930  2451 log.cc:927] Time spent T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:24:52.776460  2443 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:52.597312  2437 consensus_queue.cc:1059] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
W20260709 12:24:52.761390 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 197363us
I20260709 12:24:52.611877  2414 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:24:52.776258 31543 rpcz_store.cc:276] 0709 12:24:50.958788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.089782 (+130994us) service_pool.cc:224] Handling call
0709 12:24:52.049162 (+959380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.071330 (+ 22168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.751543 (+680213us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b540017ff50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:52.751672 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2205690240}
I20260709 12:24:52.732331  2371 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.782291 31507 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:52.662457  2445 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.787174 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1856) took 1110 ms. Trace:
I20260709 12:24:52.715987  2272 consensus_queue.cc:1059] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:24:52.792457  2184 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:52.772572  2396 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:52.805593  2382 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:52.816180 32076 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:24:52.819882 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 47463.6us
I20260709 12:24:52.828712 31393 rpcz_store.cc:276] 0709 12:24:51.677017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.303104 (+626087us) service_pool.cc:224] Handling call
0709 12:24:52.315306 (+ 12202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.319979 (+  4673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.320008 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.327615 (+  7607us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.590862 (+263247us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:52.590912 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.590988 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.786957 (+195969us) raft_consensus.cc:1685] finished
0709 12:24:52.786983 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.787116 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1563,"raft.queue_time_us":398,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":22471,"thread_start_us":262885,"threads_started":1,"wal-append.queue_time_us":457307}
I20260709 12:24:52.805541  2203 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.842897 31434 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:24:52.849797 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:52.831017  2371 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:52.858937 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 283904us
I20260709 12:24:52.827276  2018 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:52.857414 31464 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:52.856508 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 78099.5us
I20260709 12:24:52.860922 31465 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:52.862999 31359 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:52.865453 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:24:52.852917  2272 consensus_queue.cc:1243] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:52.870133 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:52.831172  2209 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:52.870133 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:52.854053  2419 raft_consensus.cc:3055] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:52.860598  2437 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:52.861413  2213 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:52.905248 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:52.865033  2363 raft_consensus.cc:697] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:52.940325  2018 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.938030  2254 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:52.941408  2209 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:52.884114  2142 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:52.881839  2426 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:52.939010  2419 raft_consensus.cc:740] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:24:52.947623 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 77546.7us
W20260709 12:24:52.967474  2443 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:52.954052 31463 raft_consensus.cc:1217] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-9.5]   Dedup: 9.5->[]
I20260709 12:24:52.980422 31463 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:24:52.964048 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.966246 31539 raft_consensus.cc:1217] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Deduplicated request from leader. Original: 5.3->[7.4-9.5]   Dedup: 9.5->[]
I20260709 12:24:52.981751 31539 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:24:52.982203 31507 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:52.881713  2416 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.971474 31393 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:52.952503  2445 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:52.973652 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:52.977140  2363 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.973223  2254 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.981431 31390 raft_consensus.cc:2368] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8.
I20260709 12:24:52.981591  2396 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:52.981384  2419 consensus_queue.cc:260] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:52.984894 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:52.971040  2213 raft_consensus.cc:697] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:52.967373  2437 raft_consensus.cc:697] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:52.952548  2272 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:24:53.033707 31507 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:52.989092  2142 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.009500  2254 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:53.050550 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 83665.7us
I20260709 12:24:53.068725 31359 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:53.042068 31507 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:53.043035  2419 raft_consensus.cc:3060] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.044996  2465 raft_consensus.cc:3055] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:53.045588  2171 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.080315  2421 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.078728 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:53.036360  2461 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:53.080852 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.066277  2360 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:53.091802  2142 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:53.092716 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 50870.8us
I20260709 12:24:53.019424  2364 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:53.109781  2244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.004s	sys 0.002s
I20260709 12:24:53.113355 31542 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:53.112039  2382 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:53.099388  2426 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:53.096798  2465 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:53.127595 31388 raft_consensus.cc:1240] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:24:53.126307 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1902) took 1171 ms. Trace:
I20260709 12:24:53.134012 31386 rpcz_store.cc:276] 0709 12:24:51.955199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.955350 (+   151us) service_pool.cc:224] Handling call
0709 12:24:53.126078 (+1170728us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54000a3f54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:53.126248 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179424512}
I20260709 12:24:53.120955 31507 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:53.114308  2383 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:53.123246  2373 log.cc:927] Time spent T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 2.200s	user 0.000s	sys 0.007s
W20260709 12:24:53.124591  2410 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 1.310s	user 0.000s	sys 0.007s
I20260709 12:24:53.157760 31386 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:24:53.118585  2244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.005s	sys 0.002s
W20260709 12:24:53.126289  2438 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 12:24:53.117889  2474 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:53.175519 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 54657.5us
I20260709 12:24:53.176190 31507 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:53.179667  2465 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:53.180971  2465 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.190716  2450 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:53.196826  2340 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:53.199918 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.206127 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:53.206929 31469 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:53.213914  2436 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:53.151882  2171 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:53.115747  2421 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:53.220784 31389 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:53.245479 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 69344.5us
I20260709 12:24:53.221289 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1909) took 1189 ms. Trace:
I20260709 12:24:53.246225 31394 rpcz_store.cc:276] 0709 12:24:52.032003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.041752 (+  9749us) service_pool.cc:224] Handling call
0709 12:24:52.058579 (+ 16827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.059388 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.221049 (+1161661us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5400404050. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:53.221218 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37780864}
I20260709 12:24:53.247097 31540 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:53.232283 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1811) took 2667 ms. Trace:
I20260709 12:24:53.258929 31507 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:53.255637 31386 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:53.123795  2364 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 9.5, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:24:53.263939  2364 consensus_queue.cc:1243] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:53.133333  2437 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:53.264683  2416 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:53.266397  2416 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.271481 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:53.117564  2213 consensus_queue.cc:237] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:53.169510  2383 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:53.278800  2383 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:53.243218  2438 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:53.280854  2438 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:53.281304  2438 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:53.284127 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:53.117978  2360 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:53.287382  2360 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:53.293817 32083 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:53.264428  2364 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:53.231377  2471 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:24:53.229282  2469 log.cc:927] Time spent T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:24:53.221211  2466 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:24:53.230799  2470 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:24:53.228370  2456 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.536s	user 0.000s	sys 0.001s
W20260709 12:24:53.219185  2406 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 1.444s	user 0.001s	sys 0.002s
I20260709 12:24:53.324985 32076 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:53.256669 31544 rpcz_store.cc:276] 0709 12:24:50.564940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.598574 (+ 33634us) service_pool.cc:224] Handling call
0709 12:24:50.618520 (+ 19946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.636299 (+ 17779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.636332 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.672060 (+ 35728us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.834893 (+162833us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:50.834918 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.834961 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.079850 (+2244889us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:53.231987 (+152137us) raft_consensus.cc:1685] finished
0709 12:24:53.232008 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.232225 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1692,"raft.queue_time_us":4840,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":23794,"spinlock_wait_cycles":14239488,"thread_start_us":90484,"threads_started":1,"wal-append.queue_time_us":197710}
I20260709 12:24:53.328866 31462 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 9. Ops: []
W20260709 12:24:53.334105 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 238591us
I20260709 12:24:53.309306  2438 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:53.295548  2436 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.306392  2415 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:53.354969 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.115906  2461 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:53.326390  2364 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:53.239675  2426 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:53.386472  2461 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:53.384653 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:53.351519  2420 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:53.327932  2371 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:53.961649 31387 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:53.955973 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.966326  2420 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:53.835006  2419 consensus_meta.cc:287] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.001s
I20260709 12:24:53.532413 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1703) took 1145 ms. Trace:
I20260709 12:24:53.968151 31465 rpcz_store.cc:276] 0709 12:24:52.387280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.495372 (+108092us) service_pool.cc:224] Handling call
0709 12:24:53.532165 (+1036793us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54001c98d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:53.532322 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833346816}
I20260709 12:24:53.426783  2238 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:53.426924 32079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 583) took 2226 ms. Trace:
W20260709 12:24:53.788395  2480 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:24:53.433208  2421 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:53.970831  2409 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.465837 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1698) took 1082 ms. Trace:
I20260709 12:24:53.972739  2396 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:53.410646 31544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afa2173634bd428990b41e94ec873527"
dest_uuid: "b63f042a541248b88888cbd3049b38ca"
mode: GRACEFUL
new_leader_uuid: "503bef451a2b424fa35e8e46b8c06f29"
 from {username='slave'} at 127.0.0.1:35368
I20260709 12:24:53.973724 31544 raft_consensus.cc:606] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Received request to transfer leadership to TS 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:24:53.437026 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:53.592749  2365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.332s	user 0.009s	sys 0.018s
W20260709 12:24:53.974789 31389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1912) took 1882 ms (client timeout 2486 ms). Trace:
W20260709 12:24:53.975337 31389 rpcz_store.cc:269] 0709 12:24:52.092314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.103632 (+ 11318us) service_pool.cc:224] Handling call
0709 12:24:53.974605 (+1870973us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003f3754. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:53.974732 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476364672}
W20260709 12:24:53.614567 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.969719  2091 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:53.977398  2091 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.978170  2213 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.976639 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:53.978999 31389 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.365480  2415 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:53.968813  2420 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:53.969700  2238 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.962244  2361 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.387739  2462 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:53.971637 31467 rpcz_store.cc:276] 0709 12:24:52.383611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.383750 (+   139us) service_pool.cc:224] Handling call
0709 12:24:52.442398 (+ 58648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.598163 (+155765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.598205 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.692575 (+ 94370us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.750053 (+ 57478us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b4800272358. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:24:52.987994 (+237941us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:53.028144 (+ 40150us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.037822 (+  9678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.037933 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.465472 (+427539us) raft_consensus.cc:1685] finished
0709 12:24:53.465586 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.465769 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55727,"prepare.queue_time_us":40188,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":63030,"raft.run_cpu_time_us":2694,"raft.run_wall_time_us":256750,"spinlock_wait_cycles":6418688,"thread_start_us":326522,"threads_started":2,"wal-append.queue_time_us":360903}
W20260709 12:24:53.974985  2365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.715s	user 0.009s	sys 0.021s
W20260709 12:24:53.724753  2414 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.003s	sys 0.006s
I20260709 12:24:53.978746  2213 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:53.979535  2419 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:53.481799 32084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 571) took 2245 ms. Trace:
I20260709 12:24:54.071696 32081 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:54.042371  2363 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.953999  2364 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:53.968168  2387 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 2.086s	user 0.000s	sys 0.017s
W20260709 12:24:54.069090  2414 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.005s	sys 0.010s
I20260709 12:24:53.983398  2474 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.086328  2474 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.088527  2213 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:54.088639  2474 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:54.089071  2213 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.089532  2213 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.089823 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:54.090441 32081 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:54.083132  2363 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:54.092185  2254 consensus_meta.cc:287] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.019s	user 0.004s	sys 0.008s
I20260709 12:24:54.092609  2254 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.093343  2363 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:54.094575  2254 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:54.095216  2364 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:54.095958 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.095729  2364 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.097625  2364 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:53.971578  2409 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.099052 31393 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:53.984361  2371 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:53.355082  2479 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:53.986191  2442 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:54.071867 32084 rpcz_store.cc:276] 0709 12:24:51.236309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.290544 (+ 54235us) service_pool.cc:224] Handling call
0709 12:24:51.333759 (+ 43215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.334101 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.334128 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.339189 (+  5061us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.607577 (+268388us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:51.607619 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.607706 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.218781 (+1611075us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b240031a888. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0559c4 00007f6e8e053acb 00007f6e8e20edc9 00007f6e8e20ea55 00007f6e8e20e09d 00007f6e90e4010e 00007f6e90e5788c 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221
0709 12:24:53.481452 (+262671us) raft_consensus.cc:1685] finished
0709 12:24:53.481474 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.481730 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":26629,"spinlock_wait_cycles":10065152,"thread_start_us":182728,"threads_started":1,"wal-append.queue_time_us":325930}
W20260709 12:24:53.986455 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.963914  2342 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:54.009950 32083 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.000s
W20260709 12:24:54.037514 31386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.009s	sys 0.016s
I20260709 12:24:54.117686 32083 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 12.
W20260709 12:24:54.043318 31394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.000s	sys 0.029s
W20260709 12:24:54.118589 31394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.000s	sys 0.029s
I20260709 12:24:54.043998 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:24:54.048188  2432 raft_consensus.cc:3055] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:53.969552 32079 rpcz_store.cc:276] 0709 12:24:51.190355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.190479 (+   124us) service_pool.cc:224] Handling call
0709 12:24:51.201800 (+ 11321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.202162 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.202198 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.202698 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.357708 (+155010us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:51.357771 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.357870 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.386591 (+2028721us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b240031a888. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0559c4 00007f6e8e053acb 00007f6e8e20edc9 00007f6e8e20ea55 00007f6e8e20dfb0 00007f6e90e84488 00007f6e90e84be8 00007f6e90e5c398 00007f6e90e5776a 00007f6e90e56bb6
0709 12:24:53.387092 (+   501us) raft_consensus.cc:1685] finished
0709 12:24:53.387121 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.416412 (+ 29291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":521,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"spinlock_wait_cycles":23231872,"thread_start_us":103763,"threads_started":1,"wal-append.queue_time_us":402925}
I20260709 12:24:54.049225 32076 raft_consensus.cc:1240] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:53.509557  2418 raft_consensus.cc:3055] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:54.023125  2018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.011s	sys 0.011s
I20260709 12:24:54.064834 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:54.069298 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.038762  2415 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.667755  2463 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.317s
I20260709 12:24:54.073822 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:54.074798 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1927) took 1837 ms. Trace:
I20260709 12:24:54.134022 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:54.134333 31388 rpcz_store.cc:276] 0709 12:24:52.237848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.491525 (+253677us) service_pool.cc:224] Handling call
0709 12:24:53.127360 (+635835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.151914 (+ 24554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.074611 (+922697us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54000a3f50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:54.074743 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456919424}
I20260709 12:24:54.083997  2365 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:54.044523  2420 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:53.982448  2366 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:54.132164  2442 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.131644  2432 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:54.142382  2366 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.143972  2442 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:54.144459  2366 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:54.069205  2203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.021s	sys 0.028s
W20260709 12:24:54.145114  2203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.021s	sys 0.029s
I20260709 12:24:54.145391  2442 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:54.100391 31538 raft_consensus.cc:1217] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Deduplicated request from leader. Original: 5.3->[7.4-9.5]   Dedup: 9.5->[]
I20260709 12:24:54.146477 31538 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:24:54.101181 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:54.103296 31387 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:54.104859  2437 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.121518 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:54.120440 32075 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:54.125168 31359 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:54.079977 31389 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:54.067764  2462 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.140103 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:54.141130 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:54.160360 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:54.148471 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:54.161022 31389 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:54.161279 31387 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:54.120946  2364 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:54.104642  2142 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.128374  2254 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:54.117723 31386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.010s	sys 0.016s
W20260709 12:24:54.132612  2018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.011s	sys 0.011s
I20260709 12:24:54.131726  2418 raft_consensus.cc:740] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:54.160974  2437 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.159618  2442 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.132467  2213 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:54.160624 31388 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 10: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:54.170902 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:54.179826 31543 raft_consensus.cc:2410] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:54.162703 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:54.180450 31387 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:24:54.181517 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:54.182184 31387 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:24:54.173003 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:54.183885 31544 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:54.080592  2419 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.184989 31359 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:54.184978  2254 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.186964  2437 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:54.189335  2442 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:54.189946  2340 consensus_meta.cc:287] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.992s	user 0.011s	sys 0.000s
I20260709 12:24:54.190160  2418 consensus_queue.cc:260] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.215139 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:54.193087 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56522 (request call id 1864) took 1229 ms. Trace:
I20260709 12:24:54.158701  2420 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.215801 31393 rpcz_store.cc:276] 0709 12:24:52.963982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.984614 (+ 20632us) service_pool.cc:224] Handling call
0709 12:24:54.192901 (+1208287us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003f3254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:54.193027 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498122624}
I20260709 12:24:54.193612 31536 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:54.194095 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:54.200002 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:54.221177 31537 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:54.200786 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:54.222168 31542 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:54.223574  2409 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:54.171881  2412 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:24:54.120816  2479 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.228260 31392 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:54.176199  2142 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.233057 31542 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:54.233857  2142 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:54.234038 31359 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:54.234679 31540 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:24:54.235160 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:54.235956  2434 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:54.236302  2434 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.236652  2434 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:54.237650  2436 consensus_meta.cc:287] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.000s
I20260709 12:24:54.238873  2363 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:54.239482 31389 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:54.239578  2363 raft_consensus.cc:697] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:54.240362  2254 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:54.240832  2254 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:54.240764  2363 consensus_queue.cc:237] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.241519  2254 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.243475  2418 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.243539 32080 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
W20260709 12:24:54.245999  2465 consensus_meta.cc:287] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.065s	user 0.010s	sys 0.000s
I20260709 12:24:54.246173 31389 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:24:54.176110  2364 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.247969 31538 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:54.183176 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:54.173617  2366 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:54.156559  2365 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:54.211215 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 256562us
I20260709 12:24:54.250265 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:54.249732 31359 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:54.252283 32075 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:54.207350  2484 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:54.255590 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.256670 32047 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:24:54.253052 31507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.028s	sys 0.050s
W20260709 12:24:54.258831 31507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.028s	sys 0.050s
W20260709 12:24:54.259449 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 1.00059e+06us
I20260709 12:24:54.262292 32047 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:54.271292 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 307679us
I20260709 12:24:54.271945 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:24:54.223106  2420 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:54.288450 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 312096us
I20260709 12:24:54.255103  2484 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:54.258350  2366 raft_consensus.cc:697] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:54.270797  2438 raft_consensus.cc:2804] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:54.312721 31507 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:54.313760 31433 leader_election.cc:400] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8.
I20260709 12:24:54.314973 31510 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:54.319955 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:54.284420  2213 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.287854  2254 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:54.311261  2474 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.312918  2484 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:54.357041 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44396.8us
W20260709 12:24:54.410152 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 138289us
I20260709 12:24:54.362877  2463 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:54.311117  2342 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.319597  1873 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:24:54.319604  2203 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.291237  2442 consensus_queue.cc:1059] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:24:54.329998  2333 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.289480  2420 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:54.393744 31433 leader_election.cc:403] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:54.394163 32078 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:54.400380 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1865) took 1436 ms. Trace:
I20260709 12:24:54.364971  2499 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:54.414242 31395 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:54.391244  2371 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:54.413861 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1868) took 1447 ms. Trace:
I20260709 12:24:54.411042  2254 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:54.502941 31394 rpcz_store.cc:276] 0709 12:24:52.965080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.247089 (+282009us) service_pool.cc:224] Handling call
0709 12:24:53.247445 (+   356us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:53.319224 (+ 71779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.319276 (+    52us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:53.320110 (+   834us) log.cc:844] Serialized 78 byte log entry
0709 12:24:54.119187 (+799077us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:54.406729 (+287542us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.412379 (+  5650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.412525 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.412622 (+    97us) raft_consensus.cc:1685] finished
0709 12:24:54.412634 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.412879 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18914,"raft.queue_time_us":31859,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":32400,"thread_start_us":1021237,"threads_started":2,"wal-append.queue_time_us":827380}
I20260709 12:24:54.415205  2463 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:54.365918  2432 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.425814 32047 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:54.539290 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 113553us
W20260709 12:24:54.520337 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 205426us
W20260709 12:24:54.501585  2495 log.cc:927] Time spent T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:54.502291 31390 rpcz_store.cc:276] 0709 12:24:52.964252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.012500 (+ 48248us) service_pool.cc:224] Handling call
0709 12:24:53.012871 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:53.087905 (+ 75034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.087955 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:53.088870 (+   915us) log.cc:844] Serialized 52 byte log entry
0709 12:24:53.344314 (+255444us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:53.384181 (+ 39867us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.399567 (+1015386us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.399926 (+   359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.400027 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.400081 (+    54us) raft_consensus.cc:1685] finished
0709 12:24:54.400099 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.400305 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":603443,"prepare.queue_time_us":39779,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":633357,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":4157,"thread_start_us":739162,"threads_started":3,"wal-append.queue_time_us":388330}
I20260709 12:24:54.505857  2499 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.549984 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:54.551975 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1871) took 1188 ms. Trace:
I20260709 12:24:54.552671 31388 rpcz_store.cc:276] 0709 12:24:53.363528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.213939 (+850411us) service_pool.cc:224] Handling call
0709 12:24:54.220782 (+  6843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.220986 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:54.408143 (+187157us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.551603 (+143460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.551655 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.551705 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.551795 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.551918 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":329508,"threads_started":2}
I20260709 12:24:54.424422  2342 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.408824  2474 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.410586  2213 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.404031  2366 consensus_queue.cc:237] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:54.537696  2487 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:24:54.539613  2463 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.536389 31394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:24:54.546386  2502 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.431753  2203 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.580363 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:54.523080  2494 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:54.543627  2414 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:54.522653  2272 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:54.623380 31394 raft_consensus.cc:606] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:24:54.545509  2238 consensus_queue.cc:1059] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:24:54.690620 31394 raft_consensus.cc:614] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:54.549633  2488 log.cc:927] Time spent T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 12:24:54.625315 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 183571us
I20260709 12:24:54.504154  2333 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.507848  2420 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:54.678745  2496 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
I20260709 12:24:54.539438  2254 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.552407  2500 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:54.524717  2371 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.549239  2419 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:54.558657  2142 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:54.688346 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 128425us
I20260709 12:24:54.552845  2499 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:54.562625  2461 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.543438  2476 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:24:54.596877  2438 raft_consensus.cc:697] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:54.624238  2364 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:54.629248  2432 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:54.556128  2465 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:54.679870  2502 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.796638 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:54.817358 31394 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:54.689265  2414 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.727667 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1869) took 1762 ms. Trace:
I20260709 12:24:54.836885 31386 rpcz_store.cc:276] 0709 12:24:52.965386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.261374 (+295988us) service_pool.cc:224] Handling call
0709 12:24:53.261742 (+   368us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:53.320472 (+ 58730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.320515 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:53.344192 (+ 23677us) log.cc:844] Serialized 52 byte log entry
0709 12:24:54.175472 (+831280us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.414104 (+238632us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.414305 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.415287 (+   982us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.727328 (+312041us) raft_consensus.cc:1685] finished
0709 12:24:54.727359 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.727586 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62308,"prepare.queue_time_us":555530,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":2867,"raft.queue_time_us":59431,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":15669,"thread_start_us":973766,"threads_started":2,"wal-append.queue_time_us":854776}
I20260709 12:24:54.627871  2450 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:54.700980  2498 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
W20260709 12:24:54.777098 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 83605.9us
I20260709 12:24:54.646697  2525 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:54.725507  2518 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:24:54.739830  2512 log.cc:927] Time spent T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:24:54.848210 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 555166us
W20260709 12:24:54.726137  2503 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:24:54.695931  2272 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.787564  2531 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:54.831478  2364 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.842753  2414 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.852977 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1877) took 1425 ms. Trace:
I20260709 12:24:54.909166 31386 rpcz_store.cc:276] 0709 12:24:53.427442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.851853 (+1424411us) service_pool.cc:224] Handling call
0709 12:24:54.852223 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.852549 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.852586 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.852640 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:54.852693 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.852763 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.852909 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.911355 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1878) took 1481 ms. Trace:
I20260709 12:24:54.911818 31386 rpcz_store.cc:276] 0709 12:24:53.430326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.910256 (+1479930us) service_pool.cc:224] Handling call
0709 12:24:54.910634 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.910916 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.910955 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.911012 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:54.911062 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.911134 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.911287 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:54.868018 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 156651us
I20260709 12:24:54.844754  2517 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.836424  2419 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:54.700004  2521 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:54.836128  2461 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:54.920032 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.860544  2525 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.841570  2142 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:54.931980 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 114153us
W20260709 12:24:54.933684 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.708654  2500 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.859382  2522 consensus_queue.cc:1059] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:24:54.935547  2525 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.918365  2364 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.953290  2364 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:54.953827  2364 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:54.954281  2364 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:54.956548  2142 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:54.946075  2476 raft_consensus.cc:3055] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:54.957379  2476 raft_consensus.cc:740] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:24:54.958266  2476 consensus_queue.cc:260] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.959575  2476 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.961186  2420 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:54.961452  2465 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:54.942974  2526 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.859906  2450 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.963989  2254 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:54.935292  2521 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.881705  2238 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:54.907367  2531 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:55.159162 31387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.049s	sys 0.042s
W20260709 12:24:55.580494 31387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.060s	sys 0.102s
W20260709 12:24:55.510533 31509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.014s	sys 0.009s
I20260709 12:24:55.581305 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1873) took 2217 ms. Trace:
W20260709 12:24:55.428076 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.006s	sys 0.014s
W20260709 12:24:55.581370 31509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.015s	sys 0.010s
I20260709 12:24:55.326455  2541 raft_consensus.cc:3055] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:55.582309 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.007s	sys 0.018s
W20260709 12:24:55.026577  2415 consensus_meta.cc:287] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.874s	user 0.012s	sys 0.000s
I20260709 12:24:55.235986  2203 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:55.582762  2541 raft_consensus.cc:740] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:55.583967  2415 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.581759 31387 rpcz_store.cc:276] 0709 12:24:53.364127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.249667 (+885540us) service_pool.cc:224] Handling call
0709 12:24:54.250098 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:54.256318 (+  6220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.256366 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:54.257510 (+  1144us) log.cc:844] Serialized 52 byte log entry
0709 12:24:54.521587 (+264077us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:54.638846 (+117259us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.580941 (+942095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.581030 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.581079 (+    49us) raft_consensus.cc:1685] finished
0709 12:24:55.581096 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.581250 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":271721,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"raft.queue_time_us":228309,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":19232,"thread_start_us":1237092,"threads_started":3,"wal-append.queue_time_us":274160}
I20260709 12:24:55.063926  2528 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.586827 31387 raft_consensus.cc:3055] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:54.943485  2438 consensus_queue.cc:237] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.587533 31387 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:24:55.511148 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 76033.4us
W20260709 12:24:55.588806 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.587550  2528 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.213634 32077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49878 (request call id 592) took 1775 ms. Trace:
I20260709 12:24:55.024032  2142 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.588588 31387 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.026211  2522 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:55.592396 31387 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:54.930877  2517 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.592875  2522 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.594126  2521 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:55.292948 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 359636us
I20260709 12:24:55.595332  2522 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:55.591774  2528 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:55.449865  2463 consensus_meta.cc:287] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.003s
I20260709 12:24:55.596238  2528 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.596536  2522 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.596714  2463 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.597110  2522 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:54.936074  2520 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:55.417912 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1930) took 3179 ms. Trace:
I20260709 12:24:55.081130  2333 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:55.599429  2463 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:55.599119  2520 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.173808  2479 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:55.417092 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1934) took 3170 ms. Trace:
I20260709 12:24:54.934340  2419 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.601291 31395 rpcz_store.cc:276] 0709 12:24:52.246597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.573774 (+327177us) service_pool.cc:224] Handling call
0709 12:24:52.574026 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.502434 (+1928408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.416748 (+914314us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b540028d554. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:55.417006 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4231257856}
I20260709 12:24:55.596699  2528 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.600117  2463 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:55.603814  2419 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:55.297794  2346 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:55.062345  2509 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:55.185844  2539 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:55.605195  2346 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.606225  2539 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.586505  2415 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:55.608081  2522 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:55.608654  2539 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:55.061820  2530 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:24:55.583472  2502 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:55.370468 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 559) took 1291 ms. Trace:
I20260709 12:24:55.613790 31389 rpcz_store.cc:276] 0709 12:24:54.079396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.174611 (+ 95215us) service_pool.cc:224] Handling call
0709 12:24:55.370269 (+1195658us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5400094cd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:55.370395 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42548608}
W20260709 12:24:55.492200 31433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.005s	sys 0.004s
W20260709 12:24:55.615688 31433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.005s	sys 0.006s
W20260709 12:24:55.616145 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 735897us
I20260709 12:24:55.617641 31433 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:24:55.381112 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.057991  2361 consensus_meta.cc:287] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.998s	user 0.011s	sys 0.000s
I20260709 12:24:55.603641  2463 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.657050 31387 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:24:55.662400 31387 pending_rounds.cc:85] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 7
W20260709 12:24:55.662305 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 1.33812e+06us
I20260709 12:24:55.662747 31387 pending_rounds.cc:107] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:24:55.663022 31387 raft_consensus.cc:2889] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:55.663733 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1883) took 2229 ms. Trace:
I20260709 12:24:55.663705 31436 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:55.664237 31387 rpcz_store.cc:276] 0709 12:24:53.434482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.586383 (+2151901us) service_pool.cc:224] Handling call
0709 12:24:55.586709 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.663502 (+ 76793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.663678 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.419288  2507 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.290831  2363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.007s	sys 0.010s
I20260709 12:24:55.063601  2533 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.591208  2142 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.610249  2465 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.025987  2342 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:55.586608  2461 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:54.967310  2474 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:55.631539 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 558) took 1558 ms. Trace:
I20260709 12:24:55.641274 31433 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:24:55.721315 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 80174.9us
I20260709 12:24:55.721974 31433 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:24:55.210420  2434 consensus_meta.cc:287] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.973s	user 0.010s	sys 0.001s
I20260709 12:24:55.599488 31392 rpcz_store.cc:276] 0709 12:24:52.238563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.495863 (+257300us) service_pool.cc:224] Handling call
0709 12:24:52.503216 (+  7353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.228718 (+1725502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.417624 (+1188906us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540027ea54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:55.417842 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3966140160}
I20260709 12:24:55.672371  2366 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.590906 32077 rpcz_store.cc:276] 0709 12:24:53.438373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.438560 (+   187us) service_pool.cc:224] Handling call
0709 12:24:53.452219 (+ 13659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.462397 (+ 10178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.462440 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.952602 (+490162us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.111528 (+158926us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:54.111578 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.111667 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.213338 (+1101671us) raft_consensus.cc:1685] finished
0709 12:24:55.213368 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.213558 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10017,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":114,"thread_start_us":152442,"threads_started":1,"wal-append.queue_time_us":335293}
I20260709 12:24:55.601687  2520 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:55.668490  2340 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.716007 31289 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45406 (request call id 162) took 24535 ms (client timeout 15000 ms). Trace:
I20260709 12:24:55.716543  2517 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:55.717442  2346 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:55.635337  2476 consensus_meta.cc:287] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.001s
I20260709 12:24:54.965106  2213 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:55.366737  2505 log.cc:927] Time spent T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.526s	user 0.000s	sys 0.003s
W20260709 12:24:55.702652  2537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.005s	sys 0.009s
W20260709 12:24:55.719344 31360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.005s	sys 0.004s
W20260709 12:24:55.759395 31360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.005s	sys 0.004s
W20260709 12:24:55.759974 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.760480 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.668080  2173 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.720829 31389 rpcz_store.cc:276] 0709 12:24:54.073645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.630457 (+1556812us) service_pool.cc:224] Handling call
0709 12:24:55.630844 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.631073 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.631112 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.631166 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:55.631209 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.631328 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.631469 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.640791 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 557) took 1580 ms. Trace:
I20260709 12:24:55.763473 31395 rpcz_store.cc:276] 0709 12:24:54.060535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.603417 (+1542882us) service_pool.cc:224] Handling call
0709 12:24:55.603913 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.604261 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.604330 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.604416 (+    86us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:55.604527 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.640565 (+ 36038us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.640726 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:55.702327  2363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.032s	sys 0.041s
I20260709 12:24:55.061012  2525 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:55.740623 31393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.034s	sys 0.027s
W20260709 12:24:55.783396 31393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.035s	sys 0.027s
I20260709 12:24:55.619180  2238 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.745148 31392 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:55.656422  2543 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 12:24:55.713311  2364 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:55.738247  2434 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.744899 31290 catalog_manager.cc:5697] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 4, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 4 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:24:55.763084  2537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.005s	sys 0.009s
I20260709 12:24:55.788830 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 564) took 1535 ms. Trace:
I20260709 12:24:55.786902  2173 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.794353 31389 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.605538  2509 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.728140  2342 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:55.757381  2424 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.797842 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:55.797308 31290 catalog_manager.cc:5697] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:24:55.800040 31392 rpcz_store.cc:276] 0709 12:24:54.253416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.724376 (+1470960us) service_pool.cc:224] Handling call
0709 12:24:55.742725 (+ 18349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.787293 (+ 44568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.788750 (+  1457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.808924 31388 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:55.739404  2366 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.781478  2213 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:55.620863  2541 consensus_queue.cc:260] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:55.705931  2507 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:24:55.800293  2484 consensus_meta.cc:287] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.385s	user 0.017s	sys 0.000s
I20260709 12:24:55.711822  2533 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.812692 31390 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:55.749603  2340 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:55.814265  2494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.007s	sys 0.049s
I20260709 12:24:55.849186  2538 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:24:55.858760 31388 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 12.
W20260709 12:24:55.865622 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 201963us
I20260709 12:24:55.811801  2500 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:55.860473 31392 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:55.869071 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 565) took 1324 ms. Trace:
I20260709 12:24:55.869556 31388 rpcz_store.cc:276] 0709 12:24:54.545122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.866242 (+1321120us) service_pool.cc:224] Handling call
0709 12:24:55.868454 (+  2212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.868668 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.868720 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.868779 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:55.868828 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.868903 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.869020 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.819828  2551 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:55.858520 31434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 2.248s (SENT) [suppressed 12 similar messages]
I20260709 12:24:55.858822 31290 catalog_manager.cc:5697] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 5 to 6, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 6 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.867470 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1870) took 2901 ms. Trace:
I20260709 12:24:55.871811 31391 rpcz_store.cc:276] 0709 12:24:52.966514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.346393 (+379879us) service_pool.cc:224] Handling call
0709 12:24:53.346730 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.355524 (+  8794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.355563 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.361930 (+  6367us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.090903 (+728973us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b18001cf780. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:24:54.324013 (+233110us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:54.324066 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.324155 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.366003 (+1041848us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:24:55.867291 (+501288us) raft_consensus.cc:1685] finished
0709 12:24:55.867311 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.867419 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604144,"raft.queue_time_us":12439,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":3041,"spinlock_wait_cycles":64591104,"thread_start_us":232932,"threads_started":1,"wal-append.queue_time_us":1407358}
W20260709 12:24:55.863596  2494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.008s	sys 0.055s
I20260709 12:24:55.887333  2541 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.895764 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1939) took 1381 ms. Trace:
I20260709 12:24:55.896634 31436 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:55.903012 31392 rpcz_store.cc:276] 0709 12:24:54.514024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.810982 (+1296958us) service_pool.cc:224] Handling call
0709 12:24:55.855705 (+ 44723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.877285 (+ 21580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.895698 (+ 18413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.899524 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 561) took 1813 ms. Trace:
I20260709 12:24:55.855783  2546 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:55.904536 31387 rpcz_store.cc:276] 0709 12:24:54.086390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.676582 (+1590192us) service_pool.cc:224] Handling call
0709 12:24:55.677034 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.899002 (+221968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.899050 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.899122 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:55.899173 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.899292 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.899451 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27307,"raft.queue_time_us":82387,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":23983,"thread_start_us":202110,"threads_started":1}
I20260709 12:24:55.876801  2551 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:55.818634  2553 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 12:24:55.878623  2213 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:55.930052 31389 raft_consensus.cc:1275] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:55.876726  2552 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:55.860373  2484 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.819298  2424 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:55.879400  2528 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:55.898485  2500 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:55.930794 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1937) took 1417 ms. Trace:
I20260709 12:24:55.918103  2543 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:55.947067 31389 rpcz_store.cc:276] 0709 12:24:54.513448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.763278 (+1249830us) service_pool.cc:224] Handling call
0709 12:24:55.794202 (+ 30924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.930546 (+136344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.930739 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:55.742532 31289 rpcz_store.cc:269] 0709 12:24:30.839617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.865820 (+ 26203us) service_pool.cc:224] Handling call
0709 12:24:31.637968 (+772148us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b540014e454. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91226090 00007f6e912c4f3a 00007f6e9707ae9c 00007f6e9717904e 00007f6e9563a2a4 00007f6e9563a232 00007f6e9563a161 00007f6e9563a0dc 00007f6e95639392 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:55.375136 (+23737168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:48.172533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:48.173278 (+   745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:48.173334 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:24:48.173349 (+    15us) tablet.cc:662] Decoding operations
0709 12:24:48.176518 (+  3169us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:48.176628 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:48.176659 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:24:48.177924 (+  1265us) tablet.cc:701] Row locks acquired
0709 12:24:48.177977 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:24:48.178165 (+   188us) write_op.cc:270] Start()
0709 12:24:48.178322 (+   157us) write_op.cc:276] Timestamp: P: 1783599888178094 usec, L: 0
0709 12:24:48.178347 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:24:48.179214 (+   867us) log.cc:844] Serialized 5614 byte log entry
0709 12:24:48.702836 (+523622us) op_driver.cc:464] REPLICATION: finished
0709 12:24:48.710226 (+  7390us) write_op.cc:301] APPLY: starting
0709 12:24:48.710348 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:48.710851 (+   503us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:48.710983 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:49.014110 (+303127us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:49.014532 (+   422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:24:49.014580 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:49.015062 (+   482us) log.cc:844] Serialized 101 byte log entry
0709 12:24:49.025091 (+ 10029us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:49.043885 (+ 18794us) write_op.cc:454] Released schema lock
0709 12:24:49.043989 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:49.119319 (+ 75330us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:49.119355 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5619887,"reported_tablets":27,"spinlock_wait_cycles":63579904,"child_traces":[["op",{"apply.queue_time_us":7037,"apply.run_cpu_time_us":9692,"apply.run_wall_time_us":346513,"num_ops":14,"prepare.queue_time_us":576495,"prepare.run_cpu_time_us":20666,"prepare.run_wall_time_us":115981,"raft.queue_time_us":146464,"raft.run_cpu_time_us":2404,"raft.run_wall_time_us":12006,"replication_time_us":519758,"spinlock_wait_cycles":1408,"thread_start_us":763115,"threads_started":4,"wal-append.queue_time_us":97676,"wal-append.run_cpu_time_us":33108,"wal-append.run_wall_time_us":1791966}]]}
W20260709 12:24:55.942619 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 220699us
W20260709 12:24:55.948887 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.000s	sys 0.011s
W20260709 12:24:55.951738 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.000s	sys 0.011s
I20260709 12:24:55.920945  2450 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:55.921656  2463 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:55.930287  2532 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.922495  2364 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.925066  2142 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:55.992148 31507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.005s	sys 0.011s
I20260709 12:24:55.935705  2018 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.988466 31290 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 6 to 7, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 7 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:24:55.932480  2476 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.999972 31394 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:55.931857  2363 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:56.002880 31507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.005s	sys 0.011s
W20260709 12:24:56.004812 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 141885us
I20260709 12:24:55.931535  2551 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.978399  2528 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:55.977074  2543 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.017452 31290 catalog_manager.cc:5697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 7 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.015921 31536 raft_consensus.cc:1275] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:55.928552  2438 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.008572  2501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.385s	user 0.015s	sys 0.014s
I20260709 12:24:55.917428  2546 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:55.989658  2437 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:55.997642  2500 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:56.025764 31290 catalog_manager.cc:5697] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 6 to 7, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 7 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.947646  2552 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:56.012651  2346 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:24:56.586514  2346 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:56.588192 32047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.021401  2543 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.435350  2434 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.455152  2366 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.013055  2142 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.234406  2238 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.063872  2560 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.591565  2142 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:56.002677  2531 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:56.078907 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.227210  2565 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:24:56.178128 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.594275  2565 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:56.596971  2565 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:56.015201  2018 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:56.097496 31510 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:24:56.065268  2213 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:56.221118 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.603837 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.605386 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:56.605572 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:56.606149 31389 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:56.606346 31387 raft_consensus.cc:2376] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11. Re-sending same reply.
I20260709 12:24:56.052309  2438 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:56.608227 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:56.611109 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:56.028842 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:56.612020 31389 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:56.612229 31538 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.615459  2437 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:56.610375  2438 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.178519  2173 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:24:56.618227  2437 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:56.668954  2437 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.013885  2476 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:56.619822  2501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.003s	user 0.033s	sys 0.027s
I20260709 12:24:56.670833  2501 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.671430  2501 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:56.673404  2501 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:56.673913  2432 consensus_meta.cc:287] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.842s	user 0.013s	sys 0.000s
I20260709 12:24:56.674333  2501 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.674784  2501 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.622272  2552 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.625185  2546 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.174433  2365 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:56.626338  2500 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:56.678159  2526 consensus_meta.cc:287] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.013s	user 0.005s	sys 0.002s
I20260709 12:24:56.164199  2525 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:56.678610  2526 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521) with higher term. Message: Invalid argument: T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8.
I20260709 12:24:56.629112 31290 catalog_manager.cc:5697] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 3, term changed from 3 to 5, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 5 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:56.253103 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.029341 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:56.680341 31537 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:56.682410  2541 consensus_meta.cc:287] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.000s
I20260709 12:24:56.003682  2558 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:56.588892  2346 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:56.008322  2364 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:56.683873  2365 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.684473  2365 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:56.684880 31387 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:24:56.163897  2547 log.cc:927] Time spent T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 12:24:56.021073  2528 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:56.686581  2365 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:24:56.687718  2499 consensus_meta.cc:287] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.846s	user 0.017s	sys 0.000s
I20260709 12:24:56.007604  2532 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:56.688567  2528 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:24:56.092386 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 90000us
W20260709 12:24:56.144198 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 229924us
I20260709 12:24:56.690490  2532 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.153925  2561 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.005262  1873 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.644358 31390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1936) took 2136 ms (client timeout 2032 ms). Trace:
I20260709 12:24:56.691830  2484 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.690397 31436 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:56.691885 31390 rpcz_store.cc:269] 0709 12:24:54.508138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.549621 (+ 41483us) service_pool.cc:224] Handling call
0709 12:24:56.644102 (+2094481us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001a13d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:56.644277 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2901576576}
W20260709 12:24:56.074163  2554 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:24:56.652284 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:56.648556 31536 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:56.585171 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1872) took 3221 ms. Trace:
W20260709 12:24:56.699559 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 56914.4us
W20260709 12:24:56.724377 31391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.004s	sys 0.012s
W20260709 12:24:56.724843 31391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.005s	sys 0.012s
W20260709 12:24:56.412937  2550 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.552s	user 0.000s	sys 0.001s
W20260709 12:24:56.535347  2414 consensus_meta.cc:287] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.542s	user 0.008s	sys 0.004s
I20260709 12:24:56.664194  2018 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.163669  2494 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:56.018502  2363 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:56.695432 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 106618us
I20260709 12:24:56.727120 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:56.728611 31535 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:56.739614 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 49841.7us
I20260709 12:24:56.653097  2566 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.693486  2465 consensus_meta.cc:287] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.969s	user 0.000s	sys 0.006s
I20260709 12:24:56.741544  2432 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.723011 31393 rpcz_store.cc:276] 0709 12:24:53.363855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.229935 (+866080us) service_pool.cc:224] Handling call
0709 12:24:54.230273 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.230628 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:54.417621 (+186993us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.947431 (+1529810us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.980130 (+ 32699us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.980745 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.980898 (+   153us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:55.980935 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.981003 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.584920 (+603917us) raft_consensus.cc:1685] finished
0709 12:24:56.584942 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.585100 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49694,"prepare.queue_time_us":855273,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":71,"raft.queue_time_us":301364,"raft.run_cpu_time_us":603,"raft.run_wall_time_us":28031,"thread_start_us":1596340,"threads_started":4,"wal-append.queue_time_us":435458}
I20260709 12:24:56.652792  2142 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:56.657485  2462 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.326320  2424 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:56.738932 31536 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:56.740394 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:56.743908 31388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.041s	sys 0.081s
I20260709 12:24:56.740281 31290 catalog_manager.cc:5697] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:24:56.688158  2499 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:56.661379  2507 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:56.730885 31537 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:56.675174  2501 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.687217  2365 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.691591  1873 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:56.691481  2561 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:56.592394  2560 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:57.208051 31507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.015s	sys 0.058s
I20260709 12:24:57.225924 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:57.319912 31507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.019s	sys 0.060s
W20260709 12:24:57.320782 31388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.215s	user 0.059s	sys 0.097s
I20260709 12:24:57.320187 31290 catalog_manager.cc:5697] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 4, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 4 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:24:57.314079 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:56.873975 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 149944us
I20260709 12:24:57.323002 32078 raft_consensus.cc:2393] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 12: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:56.851577 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 161272us
I20260709 12:24:57.325218 31436 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:57.203969 31395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.012s	sys 0.010s
W20260709 12:24:57.326419 31395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.013s	sys 0.012s
I20260709 12:24:57.327243 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1840) took 1298 ms. Trace:
I20260709 12:24:57.283622 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:57.327845 31537 rpcz_store.cc:276] 0709 12:24:56.028662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.029034 (+   372us) service_pool.cc:224] Handling call
0709 12:24:57.327158 (+1298124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.329474 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1861) took 1166 ms. Trace:
I20260709 12:24:56.949589 32077 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 11. Current term is 12. Ops: []
W20260709 12:24:57.188432 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.987375 32082 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:56.892848 31538 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:57.334247 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1839) took 1305 ms. Trace:
I20260709 12:24:56.968420 32075 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEARNER]: Advancing to term 7
I20260709 12:24:57.162628 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:57.076550 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.338788 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.339850 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:56.986650 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:57.342550 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 591749us
W20260709 12:24:57.344763 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.345409 31507 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:24:57.349998 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.006s	sys 0.031s
I20260709 12:24:57.350270 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1864) took 1142 ms. Trace:
W20260709 12:24:57.350427 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.006s	sys 0.031s
W20260709 12:24:57.351469 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 1.25396e+06us
I20260709 12:24:57.334721 31538 rpcz_store.cc:276] 0709 12:24:56.028372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.028517 (+   145us) service_pool.cc:224] Handling call
0709 12:24:57.334172 (+1305655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.329897 31536 rpcz_store.cc:276] 0709 12:24:56.162658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.726778 (+564120us) service_pool.cc:224] Handling call
0709 12:24:57.329391 (+602613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.350914 31535 rpcz_store.cc:276] 0709 12:24:56.207567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.740149 (+532582us) service_pool.cc:224] Handling call
0709 12:24:57.350211 (+610062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.355382 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:56.726749  2438 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:57.356091 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:57.378050 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1859) took 1216 ms. Trace:
I20260709 12:24:57.378700 31537 rpcz_store.cc:276] 0709 12:24:56.162078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.355862 (+1193784us) service_pool.cc:224] Handling call
0709 12:24:57.377966 (+ 22104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.380054 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:57.381074 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1858) took 1219 ms. Trace:
I20260709 12:24:57.381470 31537 rpcz_store.cc:276] 0709 12:24:56.161801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.379592 (+1217791us) service_pool.cc:224] Handling call
0709 12:24:57.381002 (+  1410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.382483 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:56.736374  2558 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 12 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:57.385236 31462 raft_consensus.cc:1240] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:57.385473 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.386117 31464 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:24:57.386766 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.387068 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:57.387470 31466 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
W20260709 12:24:57.387923 32047 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.004s	sys 0.027s
W20260709 12:24:57.388340 32047 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.004s	sys 0.027s
I20260709 12:24:57.385356 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.359368 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:57.384110 31537 raft_consensus.cc:2410] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:57.383828 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:57.390375 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1860) took 1228 ms. Trace:
I20260709 12:24:57.357065 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.390799 31537 rpcz_store.cc:276] 0709 12:24:56.162364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.382193 (+1219829us) service_pool.cc:224] Handling call
0709 12:24:57.390308 (+  8115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.392349 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:57.392414 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 68134.7us
W20260709 12:24:57.388880 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 648828us
I20260709 12:24:57.394058 32047 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:56.950181  2554 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 12:24:57.247910  2504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.144s	user 0.006s	sys 0.026s
W20260709 12:24:57.225235  2213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.003s
I20260709 12:24:57.404999 31537 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:24:57.430136 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1849) took 1326 ms. Trace:
I20260709 12:24:57.430601 31537 rpcz_store.cc:276] 0709 12:24:56.103621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.392052 (+1288431us) service_pool.cc:224] Handling call
0709 12:24:57.430081 (+ 38029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.405149 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:57.406570 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 81452.1us
I20260709 12:24:57.406560 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:57.390669 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1856) took 1229 ms. Trace:
I20260709 12:24:57.441092 31535 rpcz_store.cc:276] 0709 12:24:56.161188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.383525 (+1222337us) service_pool.cc:224] Handling call
0709 12:24:57.390606 (+  7081us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.358248 32079 raft_consensus.cc:2393] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:24:57.414047 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.414920  2526 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:57.415047  1873 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:57.356385  2562 consensus_queue.cc:1048] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:24:56.765363  2494 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:57.417197 31468 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:57.417265 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.461217 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.462069 31466 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:24:56.986006  2396 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:56.872649  2173 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.419965 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.474139 31469 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:24:57.420763 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:57.421060 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:57.434173  2500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.022s	sys 0.026s
I20260709 12:24:57.426313 31536 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:57.477669 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1846) took 1402 ms. Trace:
I20260709 12:24:57.478097 31536 rpcz_store.cc:276] 0709 12:24:56.075347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.359124 (+1283777us) service_pool.cc:224] Handling call
0709 12:24:57.477594 (+118470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:56.763520  2553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.017s
I20260709 12:24:56.851583  2340 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:56.872900  2380 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.726831  2437 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:57.355449  2567 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.354668  2462 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:24:57.451829 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 56808.4us
I20260709 12:24:57.431816 31461 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:57.458464 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.460119 31393 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:57.533408 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:57.534281 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:57.467808 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:57.468652 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:56.873152  2018 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.554s
I20260709 12:24:56.874565  2538 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.588s
I20260709 12:24:56.741046  2414 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:57.420133  2504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.396s	user 0.008s	sys 0.026s
I20260709 12:24:57.556437 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1880) took 4122 ms. Trace:
I20260709 12:24:57.556998 31386 rpcz_store.cc:276] 0709 12:24:53.433730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.912916 (+1479186us) service_pool.cc:224] Handling call
0709 12:24:54.913250 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.923715 (+ 10465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.923744 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.923785 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.923822 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.556134 (+2632312us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b54000947d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:57.556196 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.556365 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23597952}
W20260709 12:24:57.429924  2213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.008s	sys 0.004s
I20260709 12:24:57.475003 31465 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:24:57.475623 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:57.561075 31390 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 6.
I20260709 12:24:57.561924 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:57.562458 31390 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:57.429068  2463 raft_consensus.cc:2804] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:57.384356 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:57.479351 32050 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.001s	sys 0.013s
I20260709 12:24:57.485323 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:57.565140 32050 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.001s	sys 0.014s
W20260709 12:24:57.565454 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 728054us
I20260709 12:24:57.485344 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:57.486353 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:57.566798 31469 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.565446 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1854) took 1405 ms. Trace:
I20260709 12:24:57.567760 31538 rpcz_store.cc:276] 0709 12:24:56.160553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.384090 (+1223537us) service_pool.cc:224] Handling call
0709 12:24:57.565376 (+181286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:56.800594  2465 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:56.815819  2432 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:57.491971 32075 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:57.492993 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:57.570853 31536 raft_consensus.cc:2410] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:57.571041 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1862) took 1408 ms. Trace:
I20260709 12:24:57.571300 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1855) took 1410 ms. Trace:
I20260709 12:24:57.571682 31536 rpcz_store.cc:276] 0709 12:24:56.160873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.492672 (+1331799us) service_pool.cc:224] Handling call
0709 12:24:57.571246 (+ 78574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.571408 31535 rpcz_store.cc:276] 0709 12:24:56.162983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.442022 (+1279039us) service_pool.cc:224] Handling call
0709 12:24:57.570982 (+128960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432}
I20260709 12:24:57.493129 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.370190  2365 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:57.575814  2365 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:57.451508  2526 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:57.576383  2526 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.576650  2432 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:57.578492  2465 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:57.527482 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.579511 31464 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
W20260709 12:24:57.579938  2543 consensus_meta.cc:287] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.990s	user 0.010s	sys 0.000s
I20260709 12:24:57.580395 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.580358  2543 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:57.581041  2494 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:57.581691 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.582628  2437 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:57.526408  2340 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:57.583295 31393 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
I20260709 12:24:57.583897  2561 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:57.584143  2363 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:57.585382 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:57.586108  2414 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:57.586457 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:57.536201 31389 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 5.
I20260709 12:24:57.587513 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:57.484810  2500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.023s	sys 0.026s
I20260709 12:24:57.467883  1873 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:57.539115 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:57.408145  2438 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:57.553866 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:24:57.490614  2396 raft_consensus.cc:697] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:57.563477 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:57.498661  2579 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:57.566738 31537 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:57.487187 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.488246 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:57.573030 31535 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:57.582746 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:56.800534  2566 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:57.483858  2553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.010s	sys 0.029s
I20260709 12:24:57.588970 31393 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:24:57.525730  2380 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:57.490034  2173 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:57.538260  2462 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:57.560326  2580 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:24:57.537047  2567 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:57.559803  2558 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:57.740509 31469 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:58.140707 31536 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:24:58.122763 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.972254 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:58.059878 32047 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.009s	sys 0.035s
I20260709 12:24:57.591830 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:58.161749 32047 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.011s	sys 0.041s
W20260709 12:24:58.162251 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 756467us
W20260709 12:24:58.130050 31542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.000s	sys 0.010s
I20260709 12:24:58.162838 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:58.163189 31542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.000s	sys 0.012s
I20260709 12:24:58.158138 31390 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
W20260709 12:24:57.671787 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 324688us
I20260709 12:24:58.164134 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1831) took 2154 ms. Trace:
I20260709 12:24:58.133664 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:58.157042 31468 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:57.962040 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 59426.3us
I20260709 12:24:58.165354 31541 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:58.165612 31393 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: []
W20260709 12:24:58.165849 31541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1844) took 2091 ms (client timeout 2131 ms). Trace:
W20260709 12:24:58.166255 31541 rpcz_store.cc:269] 0709 12:24:56.074675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.079643 (+  4968us) service_pool.cc:224] Handling call
0709 12:24:58.133457 (+2053814us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:24:58.165795 (+ 32338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109789056}
W20260709 12:24:57.598690 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 881056us
W20260709 12:24:58.157712 31537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1857) took 1996 ms (client timeout 2218 ms). Trace:
I20260709 12:24:57.613103 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:24:58.167311 31537 rpcz_store.cc:269] 0709 12:24:56.161493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.431323 (+1269830us) service_pool.cc:224] Handling call
0709 12:24:58.157658 (+726335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25728}
I20260709 12:24:58.167871 32075 raft_consensus.cc:2410] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:24:58.160018 31464 raft_consensus.cc:2393] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 6: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:57.604650 31538 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:58.169167 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1847) took 2093 ms. Trace:
I20260709 12:24:58.157099 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1850) took 2002 ms. Trace:
I20260709 12:24:58.169906 31535 rpcz_store.cc:276] 0709 12:24:56.154307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.572430 (+1418123us) service_pool.cc:224] Handling call
0709 12:24:57.572720 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.156831 (+584111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.157041 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:57.723596 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.169704 31538 rpcz_store.cc:276] 0709 12:24:56.075692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.590317 (+1514625us) service_pool.cc:224] Handling call
0709 12:24:57.590702 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.168915 (+578213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.169110 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:58.171198 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.150697 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 245530us
W20260709 12:24:57.923903 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.168901 32047 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:24:57.974603  2574 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.339s	user 0.000s	sys 0.000s
I20260709 12:24:58.177488 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:58.178746 31392 raft_consensus.cc:2393] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:24:58.177067 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.157570 31461 raft_consensus.cc:2393] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:58.172360 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.182595 31469 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:57.878849 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.000s
W20260709 12:24:58.183708 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.009s	sys 0.004s
W20260709 12:24:58.184051 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 831551us
W20260709 12:24:57.901320  2442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.339s	user 0.018s	sys 0.043s
W20260709 12:24:58.185710 31507 connection.cc:256] RPC call timeout handler was delayed by -1.9413210300003811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 12:24:57.679795  2575 log.cc:927] Time spent T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
W20260709 12:24:57.878940  2551 consensus_meta.cc:287] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.853s	user 0.009s	sys 0.004s
W20260709 12:24:57.973646  2576 log.cc:927] Time spent T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.293s	user 0.000s	sys 0.000s
I20260709 12:24:57.600108 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:58.192435 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1851) took 2033 ms. Trace:
I20260709 12:24:58.243366 31464 raft_consensus.cc:1217] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 12:24:58.243805 31463 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 10: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:57.753093 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 566) took 1989 ms. Trace:
W20260709 12:24:58.246064 31361 connection.cc:256] RPC call timeout handler was delayed by -1.0502372890000515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3004s for a response
W20260709 12:24:58.235111 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 62815.7us
W20260709 12:24:58.233539  2442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.710s	user 0.020s	sys 0.047s
I20260709 12:24:58.236622 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1853) took 2076 ms. Trace:
I20260709 12:24:58.157846 32079 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:24:58.236676 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.193624 32076 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
W20260709 12:24:57.976629  2577 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:24:58.243606 31537 rpcz_store.cc:276] 0709 12:24:56.159551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.191652 (+2032101us) service_pool.cc:224] Handling call
0709 12:24:58.191957 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.192138 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.192161 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:58.192198 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:58.192226 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.192277 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.192384 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:57.976917  2499 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:58.246245 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:58.273144 31393 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:58.273277 31466 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:58.267908 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.274906 31538 rpcz_store.cc:276] 0709 12:24:56.160218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.218570 (+2058352us) service_pool.cc:224] Handling call
0709 12:24:58.236102 (+ 17532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.236302 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.236338 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:58.236382 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:58.236418 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.236477 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.236571 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:58.278213  2396 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:58.278817 31541 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:58.279433 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1863) took 2116 ms. Trace:
I20260709 12:24:58.279717 31541 rpcz_store.cc:276] 0709 12:24:56.192284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.247474 (+2055190us) service_pool.cc:224] Handling call
0709 12:24:58.278649 (+ 31175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.279177 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.279382 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:58.267920 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.237879  2426 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.164640 31542 rpcz_store.cc:276] 0709 12:24:56.009937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.010086 (+   149us) service_pool.cc:224] Handling call
0709 12:24:56.647786 (+637700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.013406 (+365620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.013451 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.227869 (+214418us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.163816 (+935947us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:58.163858 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.163924 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.163961 (+    37us) raft_consensus.cc:1685] finished
0709 12:24:58.163972 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.164084 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24978,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":30080,"thread_start_us":1280078,"threads_started":2,"wal-append.queue_time_us":792449}
I20260709 12:24:58.178843 32047 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:58.247722 32083 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:58.248486 31464 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:58.252502 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:58.141604  2579 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.582587  2543 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:58.250959 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:57.873744  2333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.000s	sys 0.016s
I20260709 12:24:58.171350  1873 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:58.244782 31388 rpcz_store.cc:276] 0709 12:24:55.763986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.876707 (+112721us) service_pool.cc:224] Handling call
0709 12:24:55.877015 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.877200 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:56.105324 (+228124us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.752551 (+1647227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:57.752633 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:57.752714 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.752812 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.753010 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":199620,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":28707,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":41123,"thread_start_us":1834135,"threads_started":3,"wal-append.queue_time_us":1455148}
I20260709 12:24:57.598675  2463 raft_consensus.cc:697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:58.193645 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1852) took 2033 ms. Trace:
I20260709 12:24:58.235401  2594 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.248942  2551 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:58.242614  2590 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:24:58.240550  2589 consensus_queue.cc:1059] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 12:24:58.249190  2500 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 12:24:58.316258 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.890722 31466 raft_consensus.cc:2410] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:58.462978 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:58.892205 31537 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.892786 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:58.893600 31393 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:24:58.310209 31392 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
W20260709 12:24:58.799731 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.895363 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.380194 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 133036us
I20260709 12:24:58.896617 31433 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:58.898057  2610 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.900104  2599 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:58.422492 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 243676us
I20260709 12:24:58.901430 32047 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:24:58.904075 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:58.908825 31388 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:24:58.404258 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 222487us
I20260709 12:24:58.904517 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.912554 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:24:58.321462 31535 rpcz_store.cc:276] 0709 12:24:56.159901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.192871 (+2032970us) service_pool.cc:224] Handling call
0709 12:24:58.193161 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.193343 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.193385 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:58.193428 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:58.193461 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.193509 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.193596 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:58.404737 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.914063 31461 raft_consensus.cc:2410] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:24:58.898088 31433 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:58.917570  2610 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:58.920333  2610 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:58.923357  2599 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:58.945931 31468 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.002s
I20260709 12:24:58.930474  2581 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.958261 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:59.043803 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:24:58.657779  2593 log.cc:927] Time spent T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 12:24:58.967017  2442 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:59.044521 31535 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:58.252919  2538 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.715s
I20260709 12:24:58.967422  2462 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:58.968335  2438 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:59.080327  2590 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:59.080860  2590 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:58.969094  2463 consensus_queue.cc:237] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:58.970316  2526 consensus_meta.cc:287] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.393s	user 0.008s	sys 0.000s
I20260709 12:24:59.102031  2526 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:59.103067  2590 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:58.970532  2500 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:58.901602  2380 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:58.327868  2272 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:58.905124  2333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.914s	user 0.012s	sys 0.042s
I20260709 12:24:58.971527  2611 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.321482  2579 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.895411  2594 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.972936  2589 raft_consensus.cc:3055] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:58.973085  2501 consensus_meta.cc:287] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.574s	user 0.010s	sys 0.002s
I20260709 12:24:58.900712  2551 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:58.996006 31537 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:24:59.115994  2611 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.445725  2499 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:24:58.936142  2340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.001s	sys 0.013s
I20260709 12:24:58.445391  2580 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.001008 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:59.071630  2599 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:24:58.889225  2592 log.cc:927] Time spent T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.439s	user 0.000s	sys 0.000s
I20260709 12:24:58.970710  1873 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:58.307682  2537 consensus_queue.cc:1059] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.691s
I20260709 12:24:58.989475  2536 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.321182  2426 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:58.996035  2521 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.068121  2603 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.079628  2600 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:59.079722  2601 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:24:59.115293  2526 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:59.046485  2607 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.077333  2566 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:59.114101  2500 consensus_queue.cc:1243] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:58.511332  2560 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:58.890482  2173 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:59.119333  2589 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:24:59.119427  2594 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:58.883052 31358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.011s
W20260709 12:24:58.435699 31359 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.838s (SENT)
I20260709 12:24:58.973784 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:58.974743 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1889) took 1546 ms. Trace:
I20260709 12:24:58.972270 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:58.918000 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:58.985018 31463 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:24:59.015149 31468 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:24:58.981175 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.041597 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:58.970561 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:59.117800 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:59.121624 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:59.323154 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:59.300100 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 372336us
I20260709 12:24:59.324193 31535 raft_consensus.cc:2376] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10. Re-sending same reply.
I20260709 12:24:59.324659 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 572) took 2714 ms. Trace:
I20260709 12:24:58.462627 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:24:59.289498 31358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.008s	sys 0.012s
I20260709 12:24:59.303437 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:59.298038 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:24:59.320482 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.000s	sys 0.005s
I20260709 12:24:59.305137 31467 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:24:59.308084 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:59.431052 31390 raft_consensus.cc:2393] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 10: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:24:59.432088 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.290809 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 854918us
I20260709 12:24:59.434805 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:59.435536 31434 connection.cc:256] RPC call timeout handler was delayed by -1.2144681770005263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 12:24:59.436132 31434 connection.cc:256] RPC call timeout handler was delayed by -1.1892681770004856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 12:24:59.436560 31434 connection.cc:256] RPC call timeout handler was delayed by -1.1667681770004492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 12:24:59.308074 31470 raft_consensus.cc:3055] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:59.437469 31470 raft_consensus.cc:740] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:24:59.308069 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:24:59.306025 31468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1711) took 1871 ms (client timeout 1842 ms). Trace:
W20260709 12:24:59.439738 31468 rpcz_store.cc:269] 0709 12:24:57.434878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.461600 (+ 26722us) service_pool.cc:224] Handling call
0709 12:24:59.305700 (+1844100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.441668 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.431973 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1949) took 1262 ms. Trace:
I20260709 12:24:59.300179 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1885) took 1880 ms. Trace:
I20260709 12:24:59.443404 31390 rpcz_store.cc:276] 0709 12:24:58.169318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.304091 (+1134773us) service_pool.cc:224] Handling call
0709 12:24:59.431828 (+127737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.445748 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:59.444322 31391 rpcz_store.cc:276] 0709 12:24:57.420003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.435395 (+ 15392us) service_pool.cc:224] Handling call
0709 12:24:57.473832 (+ 38437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:57.474184 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.474213 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:57.485591 (+ 11378us) log.cc:844] Serialized 52 byte log entry
0709 12:24:57.902118 (+416527us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:57.902189 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.902292 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.299480 (+1397188us) raft_consensus.cc:1685] finished
0709 12:24:59.299534 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.299961 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100585,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":345694,"threads_started":1,"wal-append.queue_time_us":618334}
W20260709 12:24:59.299512 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 401280us
I20260709 12:24:59.449065 31433 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:59.323339 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:59.451200 31386 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:24:59.447065 31390 raft_consensus.cc:2393] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:59.454888 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.325145 31387 rpcz_store.cc:276] 0709 12:24:56.609745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.609871 (+   126us) service_pool.cc:224] Handling call
0709 12:24:56.610192 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.685395 (+ 75203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.324029 (+2638634us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b540027f954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:59.324424 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170734848}
I20260709 12:24:59.309010 31466 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.296310 31388 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:59.136269 31542 raft_consensus.cc:2376] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9. Re-sending same reply.
W20260709 12:24:59.162525 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 260065us
I20260709 12:24:59.460036 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:59.460464 31538 raft_consensus.cc:2376] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10. Re-sending same reply.
I20260709 12:24:59.461036 31542 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:24:59.306053 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.462364 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:59.463353 31538 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:24:59.463574 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.464607 31465 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:24:59.298154 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1876) took 5878 ms. Trace:
I20260709 12:24:59.465078 31394 rpcz_store.cc:276] 0709 12:24:53.420072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.834681 (+1414609us) service_pool.cc:224] Handling call
0709 12:24:54.879331 (+ 44650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.008767 (+1129436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.297374 (+3288607us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400231c54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:59.297875 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576771968}
I20260709 12:24:59.466030 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:59.466835 31465 raft_consensus.cc:2376] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8. Re-sending same reply.
I20260709 12:24:59.464454 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:59.467599 31538 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.467833 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:24:59.307401 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 416412us
W20260709 12:24:59.471534 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.002s	sys 0.007s
W20260709 12:24:59.472004 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.002s	sys 0.007s
I20260709 12:24:59.297727 31392 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.475485 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1954) took 1305 ms. Trace:
W20260709 12:24:59.451678 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.003s	sys 0.015s
I20260709 12:24:59.478605 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1944) took 1289 ms. Trace:
I20260709 12:24:59.479046 31390 rpcz_store.cc:276] 0709 12:24:58.168076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.445198 (+1277122us) service_pool.cc:224] Handling call
0709 12:24:59.457645 (+ 12447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.479508  2396 consensus_queue.cc:1059] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:59.480230 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:59.481156 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1945) took 1312 ms. Trace:
I20260709 12:24:59.481524 31390 rpcz_store.cc:276] 0709 12:24:58.168323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.479799 (+1311476us) service_pool.cc:224] Handling call
0709 12:24:59.481056 (+  1257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.482595 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:59.151595  2580 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:59.162515  2521 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:59.486145  2578 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:24:59.141516  2499 raft_consensus.cc:697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 11 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:24:59.168149  2536 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:59.136137  2501 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:59.476877 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1953) took 1285 ms. Trace:
I20260709 12:24:59.135799  2611 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.162756  2603 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:59.494208  2603 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.164086  2607 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:24:59.496997 32076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 555) took 2517 ms (client timeout 2089 ms). Trace:
W20260709 12:24:59.497486 32076 rpcz_store.cc:269] 0709 12:24:56.979683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.980302 (+   619us) service_pool.cc:224] Handling call
0709 12:24:59.496456 (+2516154us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54000daf54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:59.496667 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957673216}
I20260709 12:24:59.215221  2594 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:59.499248  2333 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:59.219378  2537 consensus_queue.cc:1243] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:59.500121  2333 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.500735  2333 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.502020  2594 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:24:59.222597  2426 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:24:59.500833 31393 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:24:59.504385  2499 consensus_queue.cc:237] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:59.163307  2601 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:59.494971  2536 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:24:59.163020  2600 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:24:59.510921 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.511595  2581 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:24:59.487048  2578 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:59.182869  2579 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:24:59.515736 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:59.304391 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.516556 31543 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.516719 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:59.167944  2589 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:24:59.516398 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:24:59.519300 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:24:59.512190  2581 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.518749 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:24:59.517603 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.490789 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:59.466773 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:59.296725 31389 rpcz_store.cc:276] 0709 12:24:57.428204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.628611 (+200407us) service_pool.cc:224] Handling call
0709 12:24:57.684717 (+ 56106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.037318 (+352601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.037367 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.058060 (+ 20693us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.541037 (+482977us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:58.541093 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.541197 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.974500 (+433303us) raft_consensus.cc:1685] finished
0709 12:24:58.974526 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.974678 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":337683,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9325,"thread_start_us":292355,"threads_started":1,"wal-append.queue_time_us":771851}
I20260709 12:24:59.491971 31386 rpcz_store.cc:276] 0709 12:24:58.170278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.297121 (+1126843us) service_pool.cc:224] Handling call
0709 12:24:59.455379 (+158258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.570142 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:24:59.784433 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:24:59.843108 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.476009 31388 rpcz_store.cc:276] 0709 12:24:58.170498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.911328 (+740830us) service_pool.cc:224] Handling call
0709 12:24:59.475363 (+564035us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:59.899127 31508 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54126 dropped due to backpressure: service queue is full with 50 items
W20260709 12:24:59.957670 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.809595 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.827845 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:24:59.813572 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:00.116953 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.638195 31537 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.594892 31387 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:59.599455 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 80417us
I20260709 12:25:00.002689 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1848) took 3926 ms. Trace:
I20260709 12:24:59.584239 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.921198 31391 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:24:59.574059 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.723260 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:24:59.889999 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1938) took 5376 ms. Trace:
W20260709 12:25:00.624439 31543 consensus_meta.cc:287] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.107s	user 0.014s	sys 0.000s
I20260709 12:24:59.573213 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:00.627553  2420 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 5.035s	user 0.025s	sys 0.053s
W20260709 12:25:00.627959  2420 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 5.036s	user 0.025s	sys 0.053s
I20260709 12:25:00.624017 31536 rpcz_store.cc:276] 0709 12:24:56.075973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.595463 (+1519490us) service_pool.cc:224] Handling call
0709 12:24:57.595850 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.141394 (+545544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.002103 (+1860709us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400031bd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:25:00.002481 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252183296}
I20260709 12:25:00.629856  2589 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.834460 31394 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:25:00.626827 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1742) took 1310 ms. Trace:
W20260709 12:24:59.622605 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 130277us
W20260709 12:24:59.647635 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.792470 31393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1950) took 1622 ms (client timeout 1737 ms). Trace:
I20260709 12:24:59.963163 32083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49870 (request call id 553) took 3032 ms. Trace:
I20260709 12:25:00.635959 31543 raft_consensus.cc:2410] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:00.631328 31465 rpcz_store.cc:276] 0709 12:24:59.316508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.468860 (+152352us) service_pool.cc:224] Handling call
0709 12:25:00.626779 (+1157919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.830948 31390 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:25:00.637912 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1932) took 1144 ms. Trace:
I20260709 12:24:59.790750  2371 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:00.085206 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1866) took 1623 ms. Trace:
W20260709 12:25:00.639609 31543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1842) took 4582 ms (client timeout 4934 ms). Trace:
W20260709 12:25:00.640044 31543 rpcz_store.cc:269] 0709 12:24:56.057969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.058135 (+   166us) service_pool.cc:224] Handling call
0709 12:24:59.515334 (+3457199us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:25:00.639530 (+1124196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116684032}
I20260709 12:24:59.891206 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.639891 31541 rpcz_store.cc:276] 0709 12:24:58.461895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.462009 (+   114us) service_pool.cc:224] Handling call
0709 12:24:58.896384 (+434375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.968959 (+ 72575us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:59.104178 (+135219us) log.cc:844] Serialized 14 byte log entry
0709 12:24:59.322302 (+218124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:59.322455 (+   153us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:59.322632 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.974990 (+652358us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54003cffd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:59.975058 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.084976 (+109918us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107522,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":163655,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"spinlock_wait_cycles":166323072,"thread_start_us":352172,"threads_started":2,"wal-append.queue_time_us":122946,"wal-append.run_cpu_time_us":1394,"wal-append.run_wall_time_us":1026100}
I20260709 12:25:00.641901 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1737) took 1337 ms. Trace:
I20260709 12:25:00.642287 31469 rpcz_store.cc:276] 0709 12:24:59.304765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.307490 (+  2725us) service_pool.cc:224] Handling call
0709 12:24:59.890848 (+583358us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:25:00.641845 (+750997us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25297664}
W20260709 12:25:00.643005 31391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1952) took 2455 ms (client timeout 2200 ms). Trace:
I20260709 12:25:00.643417 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.643751  2579 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:00.644068 31469 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:00.644613 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1938) took 1048 ms. Trace:
I20260709 12:25:00.644958 31469 rpcz_store.cc:276] 0709 12:24:59.596012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.643113 (+1047101us) service_pool.cc:224] Handling call
0709 12:25:00.644558 (+  1445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.645864 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.646368  2607 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:00.646500 31469 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
W20260709 12:25:00.643425 31391 rpcz_store.cc:269] 0709 12:24:58.170034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.447088 (+1277054us) service_pool.cc:224] Handling call
0709 12:25:00.625119 (+1178031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.625720 31395 rpcz_store.cc:276] 0709 12:24:54.513737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.766628 (+1252891us) service_pool.cc:224] Handling call
0709 12:24:55.767082 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:56.020026 (+252944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.020061 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:56.631159 (+611098us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.326832 (+695673us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:57.326886 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.889188 (+2562302us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54001a27d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:59.889280 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.889381 (+   101us) raft_consensus.cc:1685] finished
0709 12:24:59.889401 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.889798 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15552,"raft.queue_time_us":16128,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":18251,"spinlock_wait_cycles":545021312,"thread_start_us":695203,"threads_started":1,"wal-append.queue_time_us":1015896,"wal-append.run_cpu_time_us":22992,"wal-append.run_wall_time_us":1827161}
I20260709 12:25:00.648010 31386 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:00.648566 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:00.649202 31391 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:00.649919 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.650478 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1925) took 1209 ms. Trace:
I20260709 12:25:00.650698 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1749) took 1281 ms. Trace:
I20260709 12:24:59.573735 31539 raft_consensus.cc:2376] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9. Re-sending same reply.
I20260709 12:25:00.647104 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1939) took 1050 ms. Trace:
W20260709 12:25:00.651551 31539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1843) took 4577 ms (client timeout 1743 ms). Trace:
W20260709 12:24:59.892194 31467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 448) took 2475 ms (client timeout 1637 ms). Trace:
I20260709 12:24:59.645083 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:00.643577 31394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1942) took 2463 ms (client timeout 2254 ms). Trace:
W20260709 12:25:00.653513 31394 rpcz_store.cc:269] 0709 12:24:58.167530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.466285 (+1298755us) service_pool.cc:224] Handling call
0709 12:25:00.631124 (+1164839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.654798 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 580) took 1167 ms. Trace:
I20260709 12:25:00.655329 31390 rpcz_store.cc:276] 0709 12:24:59.470275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.482286 (+ 12011us) service_pool.cc:224] Handling call
0709 12:25:00.638004 (+1155718us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.633944 31393 rpcz_store.cc:269] 0709 12:24:58.169565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.894532 (+724967us) service_pool.cc:224] Handling call
0709 12:24:59.792184 (+897652us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54000d3254. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:59.792381 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434137856}
I20260709 12:25:00.652555 31469 rpcz_store.cc:276] 0709 12:24:59.596588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.645557 (+1048969us) service_pool.cc:224] Handling call
0709 12:25:00.647052 (+  1495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.647601 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 581) took 1177 ms. Trace:
W20260709 12:25:00.558880  2333 consensus_meta.cc:287] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.057s	user 0.013s	sys 0.004s
I20260709 12:25:00.651125 31464 rpcz_store.cc:276] 0709 12:24:59.369278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.649566 (+1280288us) service_pool.cc:224] Handling call
0709 12:25:00.650628 (+  1062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.660161 31389 rpcz_store.cc:276] 0709 12:24:59.470745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.600250 (+129505us) service_pool.cc:224] Handling call
0709 12:25:00.647541 (+1047291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.634655 32083 rpcz_store.cc:276] 0709 12:24:56.930124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.930352 (+   228us) service_pool.cc:224] Handling call
0709 12:24:56.967715 (+ 37363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.306695 (+1338980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.962385 (+1655690us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400690354. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:24:59.962895 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2935819136}
I20260709 12:25:00.638425 31463 rpcz_store.cc:276] 0709 12:24:59.481301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.600492 (+119191us) service_pool.cc:224] Handling call
0709 12:25:00.625817 (+1025325us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.652027 31539 rpcz_store.cc:269] 0709 12:24:56.074330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.079359 (+  5029us) service_pool.cc:224] Handling call
0709 12:24:59.516043 (+3436684us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:25:00.651463 (+1135420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109660032}
I20260709 12:24:59.894914 31470 consensus_queue.cc:260] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:00.650866 31461 rpcz_store.cc:276] 0709 12:24:59.440907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.476629 (+ 35722us) service_pool.cc:224] Handling call
0709 12:25:00.650419 (+1173790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.667577 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1923) took 1227 ms. Trace:
I20260709 12:25:00.671327 31391 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:00.671648 31468 rpcz_store.cc:276] 0709 12:24:59.439976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.443025 (+  3049us) service_pool.cc:224] Handling call
0709 12:25:00.667514 (+1224489us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.088516  2582 log.cc:927] Time spent T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 2.442s	user 0.016s	sys 0.024s
I20260709 12:24:59.801090  2342 raft_consensus.cc:3055] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:25:00.673882 31466 consensus_meta.cc:287] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.100s	user 0.012s	sys 0.000s
I20260709 12:25:00.679015 31466 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:00.676389 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.537920  2476 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:00.652742 31467 rpcz_store.cc:269] 0709 12:24:57.417194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.458185 (+ 40991us) service_pool.cc:224] Handling call
0709 12:24:59.891882 (+2433697us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001306d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:24:59.892064 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4073330432}
W20260709 12:25:00.679636 31535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1878) took 2202 ms (client timeout 2089 ms). Trace:
W20260709 12:25:00.681679  2611 consensus_meta.cc:287] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.143s	user 0.008s	sys 0.005s
I20260709 12:25:00.681592 32047 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:00.682052 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1845) took 3761 ms. Trace:
I20260709 12:25:00.682242 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1901) took 2973 ms. Trace:
I20260709 12:25:00.683048 31470 raft_consensus.cc:3060] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.699654 31387 raft_consensus.cc:2410] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:00.687017 31469 raft_consensus.cc:2393] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:00.700176 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 579) took 1232 ms. Trace:
I20260709 12:25:00.679979  2594 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.687569 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.663992  2521 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:00.672644  2333 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:24:59.599887  2585 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:00.708010 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1931) took 1221 ms. Trace:
I20260709 12:25:00.708493 31469 rpcz_store.cc:276] 0709 12:24:59.480857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.658761 (+1177904us) service_pool.cc:224] Handling call
0709 12:25:00.702306 (+ 43545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.710526 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:24:59.646375  2538 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:00.697681 31466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1731) took 1764 ms (client timeout 1739 ms). Trace:
I20260709 12:25:00.698137 31394 rpcz_store.cc:276] 0709 12:24:57.709065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.667371 (+2958306us) service_pool.cc:224] Handling call
0709 12:25:00.681620 (+ 14249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.681865 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.681888 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.681937 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:00.681975 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.682057 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.682163 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.972148  2533 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:00.680105 31540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1838) took 4652 ms (client timeout 2077 ms). Trace:
I20260709 12:25:00.709592 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1746) took 1384 ms. Trace:
W20260709 12:25:00.711872 31466 rpcz_store.cc:269] 0709 12:24:58.933050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.933968 (+   918us) service_pool.cc:224] Handling call
0709 12:25:00.679547 (+1745579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.714836 31468 rpcz_store.cc:276] 0709 12:24:59.368156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.680681 (+1312525us) service_pool.cc:224] Handling call
0709 12:25:00.702928 (+ 22247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.700680 31387 rpcz_store.cc:276] 0709 12:24:59.467832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.518369 (+ 50537us) service_pool.cc:224] Handling call
0709 12:25:00.700104 (+1181735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.901369  2364 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:00.692553 31535 rpcz_store.cc:269] 0709 12:24:58.469088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.325330 (+856242us) service_pool.cc:224] Handling call
0709 12:24:59.887569 (+562239us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:25:00.671057 (+783488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33374464}
I20260709 12:25:00.702967 31542 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:00.704031 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.705197 31537 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 12.
I20260709 12:24:59.893517  2414 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.805s
I20260709 12:25:00.271562  2595 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.718708 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.680927  2342 raft_consensus.cc:740] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:25:00.717373 31537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1869) took 2253 ms (client timeout 2077 ms). Trace:
I20260709 12:25:00.713629 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.716790 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1941) took 1119 ms. Trace:
I20260709 12:25:00.733987 31461 rpcz_store.cc:276] 0709 12:24:59.597377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.668796 (+1071419us) service_pool.cc:224] Handling call
0709 12:25:00.716701 (+ 47905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.735008 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.736644 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1928) took 1294 ms. Trace:
I20260709 12:25:00.737722 31386 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 12.
I20260709 12:25:00.738727 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1936) took 1255 ms. Trace:
I20260709 12:25:00.741469 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47056 (request call id 578) took 1274 ms. Trace:
W20260709 12:25:00.713624 31540 rpcz_store.cc:269] 0709 12:24:56.027762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.028068 (+   306us) service_pool.cc:224] Handling call
0709 12:24:59.630164 (+3602096us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e962820a0 00007f6e96281984 00007f6e8f7fc6d4 00007f6e8f7fc662
0709 12:25:00.680014 (+1049850us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111967616}
W20260709 12:25:00.733258 31537 rpcz_store.cc:269] 0709 12:24:58.463974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.322717 (+858743us) service_pool.cc:224] Handling call
0709 12:25:00.717289 (+1394572us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920}
I20260709 12:25:00.741969 31386 rpcz_store.cc:276] 0709 12:24:59.467428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.583644 (+116216us) service_pool.cc:224] Handling call
0709 12:25:00.741410 (+1157766us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.732308 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 52803.8us
I20260709 12:25:00.741513 31464 rpcz_store.cc:276] 0709 12:24:59.482938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.660799 (+1177861us) service_pool.cc:224] Handling call
0709 12:25:00.738649 (+ 77850us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.751526 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 70199us
I20260709 12:25:00.751829 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.752730 32047 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:00.753829  2618 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:00.754045 32047 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:00.754426  2618 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.755569  2578 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:00.755713  2463 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:00.755427  2594 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:00.738242  2603 consensus_meta.cc:287] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.243s	user 0.010s	sys 0.006s
I20260709 12:25:00.759469 31463 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:00.760135 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1934) took 1278 ms. Trace:
I20260709 12:25:00.760035  2603 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:00.760613 31463 rpcz_store.cc:276] 0709 12:24:59.482163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.661924 (+1179761us) service_pool.cc:224] Handling call
0709 12:25:00.760082 (+ 98158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.752995 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1920) took 1315 ms. Trace:
I20260709 12:25:00.754953  2618 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.750854  2567 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:00.743068 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.702190  2611 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:00.580595 31508 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54126 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1862)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1887)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1870)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1888)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 442)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1880)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1878)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1877)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1869)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1893)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1896)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1873)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1897)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1895)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1882)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1865)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1894)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1876)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1861)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1864)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1867)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1868)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1871)
I20260709 12:25:00.698050 31544 rpcz_store.cc:276] 0709 12:24:56.075001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.075647 (+   646us) service_pool.cc:224] Handling call
0709 12:24:59.366928 (+3291281us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b5800003c98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:24:59.452108 (+ 85180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.452753 (+   645us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:59.453351 (+   598us) log.cc:844] Serialized 14 byte log entry
0709 12:24:59.746601 (+293250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:59.746676 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:59.746747 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.746847 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.836639 (+ 89792us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96164,"prepare.queue_time_us":46925,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":125636,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":215,"spinlock_wait_cycles":68623744,"thread_start_us":168788,"threads_started":1,"wal-append.queue_time_us":1175176}
I20260709 12:25:00.921075 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:00.724350 31542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1873) took 2256 ms (client timeout 2248 ms). Trace:
I20260709 12:25:00.927464 31387 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:00.972239 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1906) took 3024 ms. Trace:
W20260709 12:25:00.933785 32048 connection.cc:256] RPC call timeout handler was delayed by -1.9493959679998625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 12:25:00.970342 31464 rpcz_store.cc:276] 0709 12:24:59.438151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.751428 (+1313277us) service_pool.cc:224] Handling call
0709 12:25:00.752920 (+  1492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.972860 31387 rpcz_store.cc:276] 0709 12:24:57.948249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.737120 (+2788871us) service_pool.cc:224] Handling call
0709 12:25:00.885941 (+148821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.971979 (+ 86038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.972177 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.743441 31467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1744) took 1426 ms. Trace:
W20260709 12:25:00.887753 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 97500.2us
W20260709 12:25:00.919857 31392 consensus_meta.cc:287] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 1.447s	user 0.011s	sys 0.000s
I20260709 12:25:00.974193 31467 rpcz_store.cc:276] 0709 12:24:59.317562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.699536 (+1381974us) service_pool.cc:224] Handling call
0709 12:25:00.743376 (+ 43840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.975123 31392 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:25:00.901072 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1904) took 2990 ms. Trace:
I20260709 12:25:00.975935 31391 rpcz_store.cc:276] 0709 12:24:57.874203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.734097 (+2859894us) service_pool.cc:224] Handling call
0709 12:25:00.847956 (+113859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.863812 (+ 15856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.863855 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.863918 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:00.863968 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.864062 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.864209 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.887817 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:00.972818 31466 rpcz_store.cc:276] 0709 12:24:59.442212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.734672 (+1292460us) service_pool.cc:224] Handling call
0709 12:25:00.736575 (+  1903us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.973169 32048 connection.cc:256] RPC call timeout handler was delayed by -1.9124959679998028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 12:25:00.744845 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 2.43852e+06us
I20260709 12:25:00.979818 31393 raft_consensus.cc:1240] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:00.853012 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:00.971706 31542 rpcz_store.cc:269] 0709 12:24:58.467715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.461819 (+994104us) service_pool.cc:224] Handling call
0709 12:25:00.724279 (+1262460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7424}
I20260709 12:25:00.750187 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:25:00.916419 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:00.984555 31538 consensus_meta.cc:287] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 1.516s	user 0.013s	sys 0.018s
I20260709 12:25:00.984928 31538 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
W20260709 12:25:00.985462 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1881) took 2515 ms (client timeout 2343 ms). Trace:
W20260709 12:25:00.984334 31469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1933) took 1502 ms (client timeout 1959 ms). Trace:
W20260709 12:25:00.987246 31469 rpcz_store.cc:269] 0709 12:24:59.481735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.709281 (+1227546us) service_pool.cc:224] Handling call
0709 12:25:00.984277 (+274996us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.985927 31538 rpcz_store.cc:269] 0709 12:24:58.469947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.464091 (+994144us) service_pool.cc:224] Handling call
0709 12:25:00.985396 (+1521305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.919783 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:00.990029 31392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56518 (request call id 1946) took 2821 ms (client timeout 1800 ms). Trace:
I20260709 12:25:00.990191 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.990442 31461 raft_consensus.cc:2393] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:25:00.970992  2581 consensus_meta.cc:287] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.213s	user 0.009s	sys 0.003s
W20260709 12:25:00.990445 31392 rpcz_store.cc:269] 0709 12:24:58.168582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.895219 (+726637us) service_pool.cc:224] Handling call
0709 12:25:00.983807 (+2088588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.990972 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1745) took 1673 ms. Trace:
I20260709 12:25:00.991195 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:00.932296 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:00.990973 31468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1930) took 1548 ms (client timeout 2009 ms). Trace:
I20260709 12:25:00.759095  2594 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:00.996162 31463 rpcz_store.cc:276] 0709 12:24:59.318083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.970278 (+1652195us) service_pool.cc:224] Handling call
0709 12:25:00.990919 (+ 20641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.797770  2591 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:00.996717 31468 rpcz_store.cc:269] 0709 12:24:59.443024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.715841 (+1272817us) service_pool.cc:224] Handling call
0709 12:25:00.990911 (+275070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.998180 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:00.714859  2538 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.998418 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1748) took 1629 ms. Trace:
I20260709 12:25:01.032274  2591 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:01.035533  2553 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.035557 31464 rpcz_store.cc:276] 0709 12:24:59.368918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.973926 (+1605008us) service_pool.cc:224] Handling call
0709 12:25:00.998322 (+ 24396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.036425  2553 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.037017  2553 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.036669  2591 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.037884  2538 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.998947 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:00.997382 32076 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:25:01.034675 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:00.929049  2333 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:00.999683 31461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1738) took 1694 ms (client timeout 2208 ms). Trace:
I20260709 12:25:00.936559  2603 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:01.001174 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:01.000607 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:01.004590 31470 raft_consensus.cc:1275] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:25:00.855947  2600 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:01.006421 31465 raft_consensus.cc:2393] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 10: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:01.008719 31387 raft_consensus.cc:1240] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:01.009305 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:01.010272 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.856204  2595 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.012149 32078 raft_consensus.cc:1240] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:01.013419 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 576) took 1548 ms. Trace:
I20260709 12:25:01.051795 31392 rpcz_store.cc:276] 0709 12:24:59.465238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.004481 (+1539243us) service_pool.cc:224] Handling call
0709 12:25:01.012671 (+  8190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.012989 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.013028 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.013088 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:01.013132 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.013203 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.013332 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.015565  2342 consensus_queue.cc:260] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:01.016044  2580 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:01.062254 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1942) took 1464 ms. Trace:
I20260709 12:25:01.016518 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:01.000777  2581 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:00.930707 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:01.020241 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.062752 31463 rpcz_store.cc:276] 0709 12:24:59.597759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.998183 (+1400424us) service_pool.cc:224] Handling call
0709 12:25:01.062167 (+ 63984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.859709  2601 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:00.797914  2509 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:01.025831 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.026444 31537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1863) took 1706 ms (client timeout 1597 ms). Trace:
W20260709 12:25:01.071168 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1874) took 1729 ms (client timeout 1819 ms). Trace:
I20260709 12:25:01.027174 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:01.031663 31535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 439) took 1714 ms (client timeout 1637 ms). Trace:
I20260709 12:25:01.037186 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:01.071465 31537 rpcz_store.cc:269] 0709 12:24:59.313666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.019675 (+1706009us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:01.019823 (+   148us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:01.072399 31464 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 12: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:01.027058 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:01.073645 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 82000.5us
I20260709 12:25:01.073994 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1747) took 1705 ms. Trace:
I20260709 12:25:01.074541 31464 rpcz_store.cc:276] 0709 12:24:59.368555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.036883 (+1668328us) service_pool.cc:224] Handling call
0709 12:25:01.073939 (+ 37056us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.074887 31536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1860) took 1752 ms (client timeout 1666 ms). Trace:
W20260709 12:25:01.075579 31535 rpcz_store.cc:269] 0709 12:24:59.310330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.024087 (+1713757us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:01.024247 (+   160us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:25:01.072768 31538 rpcz_store.cc:269] 0709 12:24:59.317649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.988412 (+1670763us) service_pool.cc:224] Handling call
0709 12:25:01.047097 (+ 58685us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.044215 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1929) took 1601 ms. Trace:
W20260709 12:25:01.077163 31543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1870) took 1747 ms (client timeout 1686 ms). Trace:
I20260709 12:25:01.077271 31466 rpcz_store.cc:276] 0709 12:24:59.442612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.986503 (+1543891us) service_pool.cc:224] Handling call
0709 12:25:01.044142 (+ 57639us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.077757 31543 rpcz_store.cc:269] 0709 12:24:59.316325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.063835 (+1747510us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:01.063978 (+   143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:01.047119 31470 pending_rounds.cc:85] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 7
I20260709 12:25:01.048450 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1919) took 1611 ms. Trace:
I20260709 12:25:00.745162  2585 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.093951  2585 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:01.060334 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1943) took 2880 ms. Trace:
W20260709 12:25:01.064558 31540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1888) took 1626 ms (client timeout 1587 ms). Trace:
W20260709 12:25:01.095722 31540 rpcz_store.cc:269] 0709 12:24:59.426709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.052939 (+1626230us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:01.053080 (+   141us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:01.096709  2595 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:01.096808 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.097719 31540 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:25:01.098364 31540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1859) took 1786 ms (client timeout 1956 ms). Trace:
I20260709 12:25:01.098584  2342 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.099488  2580 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:01.100119  2580 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:01.101244  2501 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:01.101854 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:01.102173  2580 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:01.102599 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:01.061971 31465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1739) took 1756 ms (client timeout 2226 ms). Trace:
W20260709 12:25:01.103482 31465 rpcz_store.cc:269] 0709 12:24:59.305737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.920767 (+1615030us) service_pool.cc:224] Handling call
0709 12:25:01.061887 (+141120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.071311 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1902) took 3280 ms. Trace:
I20260709 12:25:01.104414 31393 rpcz_store.cc:276] 0709 12:24:57.775971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.670722 (+2894751us) service_pool.cc:224] Handling call
0709 12:25:00.977716 (+306994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.980664 (+  2948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.056410 (+ 75746us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400406350. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:01.056583 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693918976}
I20260709 12:25:01.095019 31387 rpcz_store.cc:276] 0709 12:24:58.167805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.984860 (+2817055us) service_pool.cc:224] Handling call
0709 12:25:01.008469 (+ 23609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.048328 (+ 39859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.048558 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.045677 31461 rpcz_store.cc:269] 0709 12:24:59.305264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.735814 (+1430550us) service_pool.cc:224] Handling call
0709 12:25:00.999607 (+263793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.079468 31469 rpcz_store.cc:276] 0709 12:24:59.437581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.987899 (+1550318us) service_pool.cc:224] Handling call
0709 12:25:01.048381 (+ 60482us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.075438 31536 rpcz_store.cc:269] 0709 12:24:59.312605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.064327 (+1751722us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:01.064442 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:00.990991 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:01.081236 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:01.081563 31462 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.022s	sys 0.036s
W20260709 12:25:01.098810 31540 rpcz_store.cc:269] 0709 12:24:59.312203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.096510 (+1784307us) service_pool.cc:224] Handling call
0709 12:25:01.098279 (+  1769us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.108687 31462 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.022s	sys 0.036s
I20260709 12:25:01.081722  2611 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:25:01.103152 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1921) took 1664 ms. Trace:
I20260709 12:25:01.109383 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.109537 31468 rpcz_store.cc:276] 0709 12:24:59.438734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.002907 (+1564173us) service_pool.cc:224] Handling call
0709 12:25:01.103093 (+100186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.082767 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:01.083385 31542 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:25:01.083567 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 333527us
W20260709 12:25:01.085410 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.200s (SENT) [suppressed 52 similar messages]
W20260709 12:25:01.062464  2499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.037s	sys 0.027s
I20260709 12:25:01.091586 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.112323 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.112854 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:01.114521 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:01.116766 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:01.117332 32077 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.079130 31470 pending_rounds.cc:107] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:25:01.119445 31470 raft_consensus.cc:2889] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:01.120265 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 438) took 3767 ms. Trace:
I20260709 12:25:01.120584 31470 rpcz_store.cc:276] 0709 12:24:57.352960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.353099 (+   139us) service_pool.cc:224] Handling call
0709 12:24:57.417874 (+ 64775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.307751 (+1889877us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b5400363420. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e91233dc0 00007f6e912be1c0 00007f6e912bf231 00007f6e912bbd8f 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c
0709 12:24:59.894210 (+586459us) spinlock_profiling.cc:243] Waited 84.8 ms on lock 0x7b5400363420. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e9123a06f 00007f6e912b2f60 00007f6e912b47de 00007f6e912beb49 00007f6e912bf416 00007f6e912bbd8f 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62
0709 12:25:01.119956 (+1225746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.120188 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228385280}
I20260709 12:25:01.122785 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:01.123905 31464 raft_consensus.cc:2410] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:25:01.124358 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1733) took 2154 ms. Trace:
I20260709 12:25:01.125620 31543 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:25:01.126020 31543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1878) took 1702 ms (client timeout 1838 ms). Trace:
W20260709 12:25:01.126374 31543 rpcz_store.cc:269] 0709 12:24:59.424043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.078709 (+1654666us) service_pool.cc:224] Handling call
0709 12:25:01.125968 (+ 47259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.126945 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.127844 31536 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:25:01.128746 31536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1889) took 1405 ms (client timeout 1597 ms). Trace:
W20260709 12:25:01.129227 31536 rpcz_store.cc:269] 0709 12:24:59.828186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.112524 (+1284338us) service_pool.cc:224] Handling call
0709 12:25:01.128680 (+ 16156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.129367 31542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1875) took 1793 ms (client timeout 1739 ms). Trace:
W20260709 12:25:01.130111 31542 rpcz_store.cc:269] 0709 12:24:59.317987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.986647 (+1668660us) service_pool.cc:224] Handling call
0709 12:25:01.110839 (+124192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.127787  2534 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:25:01.131083 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:01.132632 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1721) took 2891 ms. Trace:
I20260709 12:25:01.132601 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:01.134027 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.135741  2597 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:01.137162 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63535.8us
I20260709 12:25:01.137416  2611 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:01.138180 32050 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:01.112914 31537 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:01.139663 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.140565 31538 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:25:01.141129 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1880) took 1716 ms (client timeout 1785 ms). Trace:
W20260709 12:25:01.141543 31538 rpcz_store.cc:269] 0709 12:24:59.424626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.076998 (+1652372us) service_pool.cc:224] Handling call
0709 12:25:01.141063 (+ 64065us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.139667 31537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1879) took 1715 ms (client timeout 1715 ms). Trace:
W20260709 12:25:01.142379 31537 rpcz_store.cc:269] 0709 12:24:59.424356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.072429 (+1648073us) service_pool.cc:224] Handling call
0709 12:25:01.139607 (+ 67178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.145862 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:01.124732 31464 rpcz_store.cc:276] 0709 12:24:58.975772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.109753 (+2133981us) service_pool.cc:224] Handling call
0709 12:25:01.124297 (+ 14544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.145915 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.133658 32076 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:01.115592 31467 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
W20260709 12:25:01.147693 31543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1866) took 1833 ms (client timeout 2068 ms). Trace:
W20260709 12:25:01.148162 31543 rpcz_store.cc:269] 0709 12:24:59.314822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.127084 (+1812262us) service_pool.cc:224] Handling call
0709 12:25:01.147641 (+ 20557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.150105 31465 raft_consensus.cc:1240] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.150679 31463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1918) took 1713 ms. Trace:
W20260709 12:25:01.147732 31467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42116 (request call id 1940) took 1550 ms (client timeout 2044 ms). Trace:
I20260709 12:25:01.133158 31462 rpcz_store.cc:276] 0709 12:24:58.240937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.247953 (+  7016us) service_pool.cc:224] Handling call
0709 12:24:58.268506 (+ 20553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:58.268968 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.269008 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:58.269727 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 12:24:59.318155 (+1048428us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b180011f320. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1b1e07 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c0d1 00007f6e91277a0f
0709 12:25:00.090573 (+772418us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54003a7620. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91226090 00007f6e912336b8 00007f6e912bc92b 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c
0709 12:25:00.090682 (+   109us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:01.131651 (+1040969us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.132099 (+   448us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.132288 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.132386 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.132421 (+    35us) raft_consensus.cc:1685] finished
0709 12:25:01.132431 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.132582 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":536959,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":63020,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":32233,"spinlock_wait_cycles":1181409152,"thread_start_us":1155729,"threads_started":2,"wal-append.queue_time_us":1122829}
I20260709 12:25:01.151103 31463 rpcz_store.cc:276] 0709 12:24:59.437045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.063581 (+1626536us) service_pool.cc:224] Handling call
0709 12:25:01.150607 (+ 87026us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.151491 31467 rpcz_store.cc:269] 0709 12:24:59.597000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.975509 (+1378509us) service_pool.cc:224] Handling call
0709 12:25:01.147683 (+172174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.153319 32075 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:01.154304 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.154496 31539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1862) took 1841 ms (client timeout 1545 ms). Trace:
W20260709 12:25:01.154836 31539 rpcz_store.cc:269] 0709 12:24:59.313303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.154302 (+1840999us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:01.154431 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:01.155047 31538 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:25:01.155416 31544 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:01.155808 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.156131 31544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 442) took 1844 ms (client timeout 1731 ms). Trace:
I20260709 12:25:01.156030  2553 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:01.156613 31539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1869) took 1840 ms (client timeout 2245 ms). Trace:
W20260709 12:25:01.157006 31539 rpcz_store.cc:269] 0709 12:24:59.315946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.155571 (+1839625us) service_pool.cc:224] Handling call
0709 12:25:01.156542 (+   971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.157861 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.158108  2553 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:01.158404 31539 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 3.
I20260709 12:25:01.158777 31470 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:01.159269 31541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1887) took 1732 ms (client timeout 1545 ms). Trace:
I20260709 12:25:01.159447 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1917) took 1723 ms. Trace:
W20260709 12:25:01.159662 31541 rpcz_store.cc:269] 0709 12:24:59.426441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.159075 (+1732634us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:01.159188 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:01.159783 31470 rpcz_store.cc:276] 0709 12:24:59.436220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.145609 (+1709389us) service_pool.cc:224] Handling call
0709 12:25:01.149540 (+  3931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.159125 (+  9585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.159315 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3200}
I20260709 12:25:01.160957 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.161527 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 76153.6us
W20260709 12:25:01.156629 31544 rpcz_store.cc:269] 0709 12:24:59.311726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.985408 (+1673682us) service_pool.cc:224] Handling call
0709 12:25:01.156056 (+170648us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.155660 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 437) took 1846 ms (client timeout 2155 ms). Trace:
W20260709 12:25:01.163151 31539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1893) took 1267 ms (client timeout 1666 ms). Trace:
W20260709 12:25:01.164158 31539 rpcz_store.cc:269] 0709 12:24:59.895542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.157603 (+1262061us) service_pool.cc:224] Handling call
0709 12:25:01.163081 (+  5478us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.163271 31538 rpcz_store.cc:269] 0709 12:24:59.309518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.142409 (+1832891us) service_pool.cc:224] Handling call
0709 12:25:01.155607 (+ 13198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.115993  2499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.353s	user 0.037s	sys 0.027s
I20260709 12:25:01.187669 31464 raft_consensus.cc:1240] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:01.188557 32081 raft_consensus.cc:1240] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 11 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:01.168696 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.191134 31540 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
W20260709 12:25:01.191601 31540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1885) took 1765 ms (client timeout 1945 ms). Trace:
W20260709 12:25:01.191979 31540 rpcz_store.cc:269] 0709 12:24:59.425952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.108921 (+1682969us) service_pool.cc:224] Handling call
0709 12:25:01.191545 (+ 82624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.192987 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.193776 31540 raft_consensus.cc:2410] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 12:25:01.194123 31540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1881) took 1769 ms (client timeout 2273 ms). Trace:
W20260709 12:25:01.194420 31540 rpcz_store.cc:269] 0709 12:24:59.424905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.192741 (+1767836us) service_pool.cc:224] Handling call
0709 12:25:01.194078 (+  1337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.194913  2581 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:01.196359 31433 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:01.168517 31542 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:25:01.197885 31542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1877) took 1783 ms (client timeout 2042 ms). Trace:
W20260709 12:25:01.198290 31542 rpcz_store.cc:269] 0709 12:24:59.423648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.130745 (+1707097us) service_pool.cc:224] Handling call
0709 12:25:01.197828 (+ 67083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.199399 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.199561 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:01.200066 31507 connection.cc:256] RPC call timeout handler was delayed by -1.6320532019999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 12:25:01.175453  2580 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.200829  2603 consensus_queue.cc:1059] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:01.201778  2603 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:01.176453 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:01.202119  2603 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:01.202556  2603 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:01.202687 31537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 436) took 1893 ms (client timeout 2196 ms). Trace:
I20260709 12:25:01.203385  2595 raft_consensus.cc:3055] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:25:01.203317 31537 rpcz_store.cc:269] 0709 12:24:59.309117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.143128 (+1834011us) service_pool.cc:224] Handling call
0709 12:25:01.202618 (+ 59490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.166545  2601 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:01.177685 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.204625  2601 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:01.204815 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.205296 31544 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:01.205753 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1897) took 1308 ms. Trace:
I20260709 12:25:01.206271 31537 rpcz_store.cc:276] 0709 12:24:59.897100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.204490 (+1307390us) service_pool.cc:224] Handling call
0709 12:25:01.205691 (+  1201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.206681  2601 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:01.180402 32084 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:01.182097 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.207945 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1913) took 1837 ms. Trace:
I20260709 12:25:01.208673 31536 raft_consensus.cc:2410] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:01.208766 32077 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
W20260709 12:25:01.209362 31536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1883) took 1784 ms (client timeout 2000 ms). Trace:
I20260709 12:25:01.209729 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.209846 31536 rpcz_store.cc:269] 0709 12:24:59.425407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.130191 (+1704784us) service_pool.cc:224] Handling call
0709 12:25:01.209284 (+ 79093us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.210464 31540 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:25:01.210968 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1892) took 1316 ms. Trace:
I20260709 12:25:01.181257 31468 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:01.211310 31540 rpcz_store.cc:276] 0709 12:24:59.895101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.195083 (+1299982us) service_pool.cc:224] Handling call
0709 12:25:01.210914 (+ 15831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.211894 31468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1916) took 1840 ms. Trace:
I20260709 12:25:01.212218 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:01.212337 31468 rpcz_store.cc:276] 0709 12:24:59.390368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.115469 (+1725101us) service_pool.cc:224] Handling call
0709 12:25:01.181016 (+ 65547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.211602 (+ 30586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.211829 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.182773  2630 log.cc:927] Time spent T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.538s	user 0.005s	sys 0.001s
I20260709 12:25:01.213398 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:01.183184 31461 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:01.213959 31539 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.214346 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1914) took 1843 ms. Trace:
I20260709 12:25:01.214802 31461 rpcz_store.cc:276] 0709 12:24:59.370670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.112665 (+1741995us) service_pool.cc:224] Handling call
0709 12:25:01.158818 (+ 46153us) spinlock_profiling.cc:243] Waited 977 us on lock 0x7b5800016b98. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:25:01.159049 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.214041 (+ 54992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.214272 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246016}
I20260709 12:25:01.177275 31535 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 5.
W20260709 12:25:01.216063 31535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1872) took 1899 ms (client timeout 1889 ms). Trace:
I20260709 12:25:01.208312 31465 rpcz_store.cc:276] 0709 12:24:59.370351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.112368 (+1742017us) service_pool.cc:224] Handling call
0709 12:25:01.126445 (+ 14077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.166840 (+ 40395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.207721 (+ 40881us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5400271854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:25:01.207867 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44906752}
W20260709 12:25:01.216534 31535 rpcz_store.cc:269] 0709 12:24:59.316975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.076542 (+1759567us) service_pool.cc:224] Handling call
0709 12:25:01.216003 (+139461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.188524 31464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1926) took 1747 ms. Trace:
I20260709 12:25:01.183482 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.217224 31464 rpcz_store.cc:276] 0709 12:24:59.441358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.147256 (+1705898us) service_pool.cc:224] Handling call
0709 12:25:01.187427 (+ 40171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.188226 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.188459 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.185143  2618 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.170221 32050 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:25:01.200958 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:01.201016  2580 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:25:01.205816 31544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1899) took 1308 ms (client timeout 1715 ms). Trace:
I20260709 12:25:01.224814 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.224566 31544 rpcz_store.cc:269] 0709 12:24:59.897890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.162749 (+1264859us) service_pool.cc:224] Handling call
0709 12:25:01.205763 (+ 43014us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.199599 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.226439 32079 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:01.226573 31543 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:25:01.227167 31543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1886) took 1801 ms (client timeout 2097 ms). Trace:
I20260709 12:25:01.212852 31540 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.170648 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1915) took 1799 ms. Trace:
I20260709 12:25:01.228195 31469 rpcz_store.cc:276] 0709 12:24:59.370977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.114012 (+1743035us) service_pool.cc:224] Handling call
0709 12:25:01.162973 (+ 48961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.170318 (+  7345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.170343 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.170384 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:01.170413 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.170466 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.170574 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.181756 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.229018 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.229764 31538 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
W20260709 12:25:01.230388 31538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1873) took 1913 ms (client timeout 2310 ms). Trace:
I20260709 12:25:01.182639 31462 raft_consensus.cc:1240] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:01.232057 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42116 (request call id 1937) took 1748 ms. Trace:
I20260709 12:25:01.203969  2595 raft_consensus.cc:740] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:01.211076 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.233938 31536 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:01.234539 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1895) took 1338 ms. Trace:
I20260709 12:25:01.234910 31536 rpcz_store.cc:276] 0709 12:24:59.896315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.210782 (+1314467us) service_pool.cc:224] Handling call
0709 12:25:01.234469 (+ 23687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.220464 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.237490 31537 raft_consensus.cc:2393] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:25:01.221005 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5033532019997438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 12:25:01.223351 32078 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
W20260709 12:25:01.227541 31543 rpcz_store.cc:269] 0709 12:24:59.426194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.148909 (+1722715us) service_pool.cc:224] Handling call
0709 12:25:01.227111 (+ 78202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.232468 31462 rpcz_store.cc:276] 0709 12:24:59.491963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.151709 (+1659746us) service_pool.cc:224] Handling call
0709 12:25:01.182428 (+ 30719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.231760 (+ 49332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.231999 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.200410 31542 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:25:01.230785 31538 rpcz_store.cc:269] 0709 12:24:59.317278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.165202 (+1847924us) service_pool.cc:224] Handling call
0709 12:25:01.230309 (+ 65107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.239084 31535 raft_consensus.cc:2410] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:01.241230 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:01.240775 31541 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
W20260709 12:25:01.248739 31541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1896) took 1352 ms (client timeout 1686 ms). Trace:
I20260709 12:25:01.247928 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.249485 31541 rpcz_store.cc:269] 0709 12:24:59.896696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.160373 (+1263677us) service_pool.cc:224] Handling call
0709 12:25:01.248660 (+ 88287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.248764 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 441) took 1937 ms. Trace:
I20260709 12:25:01.250672 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.250962 31535 rpcz_store.cc:276] 0709 12:24:59.311208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.217134 (+1905926us) service_pool.cc:224] Handling call
0709 12:25:01.248687 (+ 31553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.251823 31543 raft_consensus.cc:2393] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:25:01.251982 31434 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.074s	sys 0.171s
W20260709 12:25:01.242588 31542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54134 (request call id 1875) took 2774 ms (client timeout 3286 ms). Trace:
W20260709 12:25:01.252621 31434 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.075s	sys 0.171s
W20260709 12:25:01.252929 31542 rpcz_store.cc:269] 0709 12:24:58.468266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.199061 (+2730795us) service_pool.cc:224] Handling call
0709 12:25:01.242522 (+ 43461us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.253201 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 1.62978e+06us
I20260709 12:25:01.253911 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1891) took 1359 ms. Trace:
I20260709 12:25:01.254367 31537 rpcz_store.cc:276] 0709 12:24:59.894682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.207062 (+1312380us) service_pool.cc:224] Handling call
0709 12:25:01.253858 (+ 46796us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.241892 32083 raft_consensus.cc:2393] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:01.249787 31544 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:01.260121 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1890) took 1366 ms. Trace:
I20260709 12:25:01.260427 31544 rpcz_store.cc:276] 0709 12:24:59.894202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.234047 (+1339845us) service_pool.cc:224] Handling call
0709 12:25:01.260070 (+ 26023us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.255259 31507 connection.cc:256] RPC call timeout handler was delayed by -1.478153201999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 12:25:01.235582  2611 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:01.238605  2499 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.281306 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.282013 31542 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:01.286862 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.283269 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 113110us
W20260709 12:25:01.295456 31507 connection.cc:256] RPC call timeout handler was delayed by -1.3593532019999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 12:25:01.295882 31507 connection.cc:256] RPC call timeout handler was delayed by -1.2288532019997547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 12:25:01.296161 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1523532020000857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
I20260709 12:25:01.277012  2611 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:01.298161 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.300555 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.280947  2499 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:01.301693 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.305176 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.306015 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.306509 31536 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 12.
I20260709 12:25:01.308312 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.314482 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1876) took 1996 ms. Trace:
I20260709 12:25:01.315026 31542 rpcz_store.cc:276] 0709 12:24:59.318337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.292161 (+1973824us) service_pool.cc:224] Handling call
0709 12:25:01.314402 (+ 22241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.318043 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.319077 31535 raft_consensus.cc:2393] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:01.301131  2611 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.321316 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:01.285881  2538 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.300382  2601 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.305032  2499 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.343894 31538 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.344626 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1864) took 2030 ms. Trace:
I20260709 12:25:01.344956 31538 rpcz_store.cc:276] 0709 12:24:59.314089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.343323 (+2029234us) service_pool.cc:224] Handling call
0709 12:25:01.343672 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.344342 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.344547 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.346438 31538 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:25:01.349632 32050 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:01.350711  2585 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:01.276492 31387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078"
dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
mode: GRACEFUL
new_leader_uuid: "842fbe33f4144fa69f1fd428652b6998"
 from {username='slave'} at 127.0.0.1:58738
I20260709 12:25:01.342866  2534 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:01.351270  2173 consensus_queue.cc:1048] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:01.351632 31387 raft_consensus.cc:606] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Received request to transfer leadership to TS 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:01.352171 31387 raft_consensus.cc:614] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:01.334230 31543 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:01.355640 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1865) took 2041 ms. Trace:
I20260709 12:25:01.356098 31543 rpcz_store.cc:276] 0709 12:24:59.314434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.307145 (+1992711us) service_pool.cc:224] Handling call
0709 12:25:01.355566 (+ 48421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.358027 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1868) took 2042 ms. Trace:
W20260709 12:25:01.355662 31361 connection.cc:256] RPC call timeout handler was delayed by -3.0002323269995941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 12:25:01.360262 31361 connection.cc:256] RPC call timeout handler was delayed by -2.9786323270000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:25:01.360663 31361 connection.cc:256] RPC call timeout handler was delayed by -2.937232326999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 12:25:01.334645  2601 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:01.351128  2585 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.351799  2534 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.335215 31541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1876) took 2866 ms. Trace:
I20260709 12:25:01.369656 31541 rpcz_store.cc:276] 0709 12:24:58.468531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.307171 (+2838640us) service_pool.cc:224] Handling call
0709 12:25:01.334591 (+ 27420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.334810 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.334858 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.334913 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:01.334964 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.335033 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.335151 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.333633 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 435) took 2025 ms. Trace:
I20260709 12:25:01.370633 31537 rpcz_store.cc:276] 0709 12:24:59.308553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.307814 (+1999261us) service_pool.cc:224] Handling call
0709 12:25:01.332850 (+ 25036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.333136 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.333174 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.333252 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:01.333322 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.333393 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.333534 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.358433 31543 rpcz_store.cc:276] 0709 12:24:59.315596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.356953 (+2041357us) service_pool.cc:224] Handling call
0709 12:25:01.357314 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.357576 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.357613 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.357684 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:01.357763 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.357834 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.357963 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.373806 31536 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:01.375734 31542 raft_consensus.cc:1275] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:25:01.376750 31536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1894) took 1480 ms. Trace:
I20260709 12:25:01.377261 31536 rpcz_store.cc:276] 0709 12:24:59.895909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.307158 (+1411249us) service_pool.cc:224] Handling call
0709 12:25:01.376669 (+ 69511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.378484 31537 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:01.347141 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1867) took 2032 ms. Trace:
I20260709 12:25:01.381036 31538 rpcz_store.cc:276] 0709 12:24:59.315214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.345713 (+2030499us) service_pool.cc:224] Handling call
0709 12:25:01.346023 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.346861 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.347079 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.369289  2585 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.383823  2534 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:01.367012 31540 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
W20260709 12:25:01.384912 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 55487.5us
W20260709 12:25:01.386456 31361 connection.cc:256] RPC call timeout handler was delayed by -2.8436323269997956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 12:25:01.401086 31361 connection.cc:256] RPC call timeout handler was delayed by -2.7860323269997025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 12:25:01.388605 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1871) took 2062 ms. Trace:
I20260709 12:25:01.401733 31537 rpcz_store.cc:276] 0709 12:24:59.316645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.371571 (+2054926us) service_pool.cc:224] Handling call
0709 12:25:01.371861 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.378951 (+  7090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.379187 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.389086 31535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1861) took 2065 ms. Trace:
I20260709 12:25:01.392112 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:01.403525 31462 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 12: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:01.393148  2538 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:01.394323 31544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 438) took 2074 ms. Trace:
W20260709 12:25:01.404057 31540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1882) took 1978 ms (client timeout 2535 ms). Trace:
W20260709 12:25:01.404536 31540 rpcz_store.cc:269] 0709 12:24:59.425159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.211981 (+1786822us) service_pool.cc:224] Handling call
0709 12:25:01.403978 (+191997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.404444 31544 rpcz_store.cc:276] 0709 12:24:59.309940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.309439 (+1999499us) service_pool.cc:224] Handling call
0709 12:25:01.330087 (+ 20648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.384340 (+ 54253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.384383 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.384438 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:01.384494 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.384563 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.384657 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.376235 31542 pending_rounds.cc:85] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 9
I20260709 12:25:01.406173 31542 pending_rounds.cc:107] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:25:01.406522 31542 raft_consensus.cc:2889] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:01.402936 31535 rpcz_store.cc:276] 0709 12:24:59.312952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.325008 (+2012056us) service_pool.cc:224] Handling call
0709 12:25:01.363716 (+ 38708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.378351 (+ 14635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.378393 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.378451 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:01.378506 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.378583 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.378719 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.427203 31436 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:01.379313  2553 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:01.432597 31434 connection.cc:256] RPC call timeout handler was delayed by -1.6706319109998731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
I20260709 12:25:01.313149  2595 consensus_queue.cc:260] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.445075 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:01.448410 31361 connection.cc:256] RPC call timeout handler was delayed by -2.7059323270000277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:25:01.448952 31361 connection.cc:256] RPC call timeout handler was delayed by -2.68253232699999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 12:25:01.411217  2618 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:01.452682 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 51805.5us
W20260709 12:25:01.456386 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.464375 31434 leader_election.cc:336] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.734s (SENT)
I20260709 12:25:01.455210 31543 raft_consensus.cc:3055] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:01.466254 31543 raft_consensus.cc:740] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:01.467721 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:01.465890 31434 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:01.469048 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 440) took 2153 ms. Trace:
I20260709 12:25:01.470952 31542 rpcz_store.cc:276] 0709 12:24:59.310795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.315845 (+2005050us) service_pool.cc:224] Handling call
0709 12:25:01.360780 (+ 44935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.451856 (+ 91076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.464522 (+ 12666us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.473126 31361 connection.cc:256] RPC call timeout handler was delayed by -2.5610323269997934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 12:25:01.473657 31361 connection.cc:256] RPC call timeout handler was delayed by -2.5232323269997323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
W20260709 12:25:01.474056 31361 connection.cc:256] RPC call timeout handler was delayed by -2.4647323269996377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.231s for a response
W20260709 12:25:01.474402 31361 connection.cc:256] RPC call timeout handler was delayed by -2.2622323269997651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2535s for a response
W20260709 12:25:01.474750 31361 connection.cc:256] RPC call timeout handler was delayed by -2.2577323269997578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.254s for a response
W20260709 12:25:01.475106 31361 connection.cc:256] RPC call timeout handler was delayed by -1.6164390560002175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:25:01.476027 31361 connection.cc:256] RPC call timeout handler was delayed by -1.5075390560000415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 12:25:01.476459 31361 connection.cc:256] RPC call timeout handler was delayed by -1.4895390560000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 12:25:01.476899 31361 connection.cc:256] RPC call timeout handler was delayed by -1.4697390559999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:25:01.477298 31361 connection.cc:256] RPC call timeout handler was delayed by -1.4697390559999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:25:01.477690 31361 connection.cc:256] RPC call timeout handler was delayed by -1.3527390560002459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 12:25:01.478103 31361 connection.cc:256] RPC call timeout handler was delayed by -1.34913905600024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 12:25:01.478495 31361 connection.cc:256] RPC call timeout handler was delayed by -1.2564390560000902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:25:01.478901 31361 connection.cc:256] RPC call timeout handler was delayed by -1.2474390560000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 12:25:01.479319 31361 connection.cc:256] RPC call timeout handler was delayed by -1.1196390560003238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 12:25:01.479729 31361 connection.cc:256] RPC call timeout handler was delayed by -1.1097390560003078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 12:25:01.480140 31361 connection.cc:256] RPC call timeout handler was delayed by -1.1097390560003078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 12:25:01.481019 31361 connection.cc:256] RPC call timeout handler was delayed by -1.0197390560001622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 12:25:01.481441 31361 connection.cc:256] RPC call timeout handler was delayed by -1.0184323270000277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3917s for a response
W20260709 12:25:01.481809 31361 connection.cc:256] RPC call timeout handler was delayed by -1.003539056000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 12:25:01.464422  2538 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.449653  2553 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.473160  2580 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:01.526021 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 60932.1us
I20260709 12:25:01.512511  2581 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:01.565171 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:01.560437 31464 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:01.565900 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:01.567999 31465 raft_consensus.cc:2393] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:25:01.566407 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.513422  2538 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:01.568920 31462 raft_consensus.cc:2393] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:01.571141 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:01.571468 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:01.575023 31395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.022s	sys 0.062s
W20260709 12:25:01.575464 31395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.023s	sys 0.062s
I20260709 12:25:01.567687 31543 consensus_queue.cc:260] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.584446 31539 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
W20260709 12:25:01.585299 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.586472 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 133443us
W20260709 12:25:01.586786 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.044s	sys 0.085s
W20260709 12:25:01.587266 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.044s	sys 0.085s
I20260709 12:25:01.588307 32050 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:01.593146 31539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1884) took 2160 ms (client timeout 2230 ms). Trace:
W20260709 12:25:01.594128 31539 rpcz_store.cc:269] 0709 12:24:59.425669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.165624 (+1739955us) service_pool.cc:224] Handling call
0709 12:25:01.585998 (+420374us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:01.588028 31510 connection.cc:256] RPC call timeout handler was delayed by -1.219932083999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22540000000000002s for a response
W20260709 12:25:01.592131 32047 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.008s	sys 0.017s
W20260709 12:25:01.600397 32047 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.008s	sys 0.017s
I20260709 12:25:01.579605  2538 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:01.603407 31389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.015s	sys 0.019s
I20260709 12:25:01.579452  2595 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:01.600896 31359 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.011s	sys 0.018s
W20260709 12:25:01.614943 31359 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.013s	sys 0.019s
W20260709 12:25:01.618235 31391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.001s	sys 0.014s
W20260709 12:25:01.620581 31391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.002s	sys 0.014s
I20260709 12:25:01.618278 31436 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:01.614694 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:01.597644  2420 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.014s	sys 0.017s
W20260709 12:25:01.619107 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 940578us
W20260709 12:25:01.613193 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 859188us
W20260709 12:25:01.614452 31389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.016s	sys 0.020s
W20260709 12:25:01.614289 31390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.012s	sys 0.020s
W20260709 12:25:01.624544 31390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.012s	sys 0.020s
W20260709 12:25:01.616768  2463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.006s	sys 0.018s
W20260709 12:25:01.601037 31388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.014s	sys 0.012s
W20260709 12:25:01.629258 31388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.014s	sys 0.012s
W20260709 12:25:01.621502 31386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.015s	sys 0.002s
I20260709 12:25:01.625777 31543 raft_consensus.cc:3060] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:01.626674 31434 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.743s (SENT)
W20260709 12:25:01.630524 31386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.015s	sys 0.002s
W20260709 12:25:01.628208 31510 connection.cc:256] RPC call timeout handler was delayed by -1.0785923989997173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.313s for a response
W20260709 12:25:01.632102 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 43910.3us
I20260709 12:25:01.586336  2597 consensus_queue.cc:1059] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 12:25:01.627280  2420 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.015s	sys 0.017s
W20260709 12:25:01.620108  2594 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.002s	sys 0.013s
W20260709 12:25:01.628958  2463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.006s	sys 0.018s
I20260709 12:25:01.637033  2533 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:01.625356  2618 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:01.654481 31543 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:01.648065 32048 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.010s
W20260709 12:25:01.655808 32048 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.009s	sys 0.010s
W20260709 12:25:01.656200 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 534291us
W20260709 12:25:01.662670 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 47119.2us
W20260709 12:25:01.663465 31434 leader_election.cc:336] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.771s (SENT)
W20260709 12:25:01.664497 31434 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.796s (SENT)
W20260709 12:25:01.665313 31434 leader_election.cc:336] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.891s (SENT)
W20260709 12:25:01.666144 31434 leader_election.cc:336] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.993s (SENT)
I20260709 12:25:01.667884 31539 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:01.671749  2553 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:01.672317  2553 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:01.672782  2553 raft_consensus.cc:697] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:01.673712  2553 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.674607 31291 catalog_manager.cc:5697] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 5, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 5 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:25:01.677726 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 44687.6us
W20260709 12:25:01.674265  2631 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:25:01.667032 31434 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 2.063s (SENT)
W20260709 12:25:01.655570  2594 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.003s	sys 0.014s
I20260709 12:25:01.687333 31434 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:01.652383  2463 raft_consensus.cc:697] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:01.652041  2601 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:01.690276 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.683521 31392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.011s	sys 0.009s
W20260709 12:25:01.659444  2591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.010s	sys 0.011s
W20260709 12:25:01.706629 31393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.005s	sys 0.016s
W20260709 12:25:01.710983 31393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.006s	sys 0.016s
W20260709 12:25:01.705757 31392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.011s	sys 0.009s
W20260709 12:25:01.706586 31466 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.014s	sys 0.007s
I20260709 12:25:01.707444  2533 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:25:01.707967  2591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.010s	sys 0.011s
W20260709 12:25:01.726102 31466 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.015s	sys 0.007s
I20260709 12:25:01.726702 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.739945 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 72938.7us
I20260709 12:25:01.772213 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.790149 31434 leader_election.cc:336] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 2.077s (SENT)
I20260709 12:25:01.724865  2533 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:01.819502 32082 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.010s	sys 0.013s
W20260709 12:25:01.819974 32082 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.010s	sys 0.013s
I20260709 12:25:01.739117  2509 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:01.841662 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 48303.7us
I20260709 12:25:01.842423 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:01.852589 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 224415us
W20260709 12:25:01.865046 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 208768us
I20260709 12:25:01.871809 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:01.873603 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 302228us
W20260709 12:25:01.874887 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 274261us
I20260709 12:25:01.876179 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:01.879307 31542 raft_consensus.cc:2410] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:25:01.874816 31359 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54126 dropped due to backpressure: service queue is full with 50 items
I20260709 12:25:01.883662 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:01.895305 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:01.896310 31469 raft_consensus.cc:2393] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:01.868348  2420 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:01.934508 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:01.935428 32048 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:01.905496 31436 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:01.940230 31291 catalog_manager.cc:5697] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 8, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 8 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:25:01.958823 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 177837us
I20260709 12:25:01.958981 32050 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:25:01.869627  2538 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:01.983794 31389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1908) took 3864 ms. Trace:
I20260709 12:25:01.986928 31389 rpcz_store.cc:276] 0709 12:24:58.119054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.921790 (+2802736us) service_pool.cc:224] Handling call
0709 12:25:00.922161 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.922468 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:01.625389 (+702921us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.983448 (+358059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.983500 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:01.983547 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.983609 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.983735 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28222,"prepare.queue_time_us":917623,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":992790,"threads_started":3}
I20260709 12:25:01.846750  2463 consensus_queue.cc:237] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:02.014393 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 111536us
I20260709 12:25:02.016523 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:02.017596 31542 raft_consensus.cc:2393] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:02.016959 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1905) took 4139 ms. Trace:
W20260709 12:25:02.033969 31434 leader_election.cc:336] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 2.131s (SENT)
I20260709 12:25:02.035279 31291 catalog_manager.cc:5697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:02.037007 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 81778.3us
I20260709 12:25:02.038012 31359 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:02.039585 31543 pending_rounds.cc:85] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 4
I20260709 12:25:02.039924 31543 pending_rounds.cc:107] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:25:02.040226 31543 raft_consensus.cc:2889] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:02.042670 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:02.042833 32048 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:02.043448 31389 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.060629 31390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1903) took 4203 ms. Trace:
I20260709 12:25:01.991762  2664 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:02.033736 31394 rpcz_store.cc:276] 0709 12:24:57.877556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.720858 (+2843302us) service_pool.cc:224] Handling call
0709 12:25:01.167606 (+446748us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b5800113498. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e197b71 00007f6e8e197a22 00007f6e970b08d9 00007f6e9620aee0 00007f6e962d40ab 00007f6e962d4131 00007f6e96295fc0 00007f6e96280929 00007f6e962803d2 00007f6e8f7f7bd4
0709 12:25:01.235381 (+ 67775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.302600 (+ 67219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:01.714531 (+411931us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.016221 (+301690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.016375 (+   154us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:02.016563 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.016707 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.016890 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22601,"prepare.queue_time_us":544972,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"spinlock_wait_cycles":8908672,"thread_start_us":521548,"threads_started":3}
I20260709 12:25:02.041301  2420 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:02.061335 31390 rpcz_store.cc:276] 0709 12:24:57.856899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.701593 (+2844694us) service_pool.cc:224] Handling call
0709 12:25:00.857097 (+155504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.857381 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:01.628795 (+771414us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.060169 (+431374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.060248 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:02.060320 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.060411 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.060558 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11957,"prepare.queue_time_us":935864,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"thread_start_us":1131895,"threads_started":3}
I20260709 12:25:02.057626  2591 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:02.090636 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:25:02.091238 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 216664us
W20260709 12:25:02.094390 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.096150  2650 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:25:02.099629 31386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1907) took 4052 ms. Trace:
I20260709 12:25:02.100154 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:02.100088 31386 rpcz_store.cc:276] 0709 12:24:58.047437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.802544 (+2755107us) service_pool.cc:224] Handling call
0709 12:25:00.973556 (+171012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.013951 (+ 40395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.014003 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.014736 (+   733us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.633749 (+619013us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:01.633793 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.634086 (+   293us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.099375 (+465289us) raft_consensus.cc:1685] finished
0709 12:25:02.099398 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.099563 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":615780,"threads_started":1,"wal-append.queue_time_us":875619}
W20260709 12:25:02.108952 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.110985 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.114087 31390 raft_consensus.cc:1275] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:02.115588  2637 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:25:02.116843  2603 consensus_meta.cc:287] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.914s	user 0.013s	sys 0.000s
I20260709 12:25:02.117282  2603 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:02.070745  2594 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.119426  2678 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.137432 31291 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 5 to 6, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 6 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:02.143548  2509 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:02.100795  2591 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.231503  2509 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.231628  2591 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.204994 31393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 582) took 2733 ms. Trace:
I20260709 12:25:02.206679 31394 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:25:02.087100  2663 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 12:25:02.206177 31510 connection.cc:256] RPC call timeout handler was delayed by -3.6523556709998957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2614s for a response
W20260709 12:25:02.208068 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 58330us
W20260709 12:25:02.217072 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 174316us
I20260709 12:25:02.121809 31536 raft_consensus.cc:1275] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:25:02.154131 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 143621us
I20260709 12:25:02.231815 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:02.256628 31389 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:25:02.250422 31393 rpcz_store.cc:276] 0709 12:24:59.471155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.105705 (+1634550us) service_pool.cc:224] Handling call
0709 12:25:01.135399 (+ 29694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.135818 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.135858 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.136432 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.725003 (+588571us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:01.725092 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.725282 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.166223 (+440941us) raft_consensus.cc:1685] finished
0709 12:25:02.166259 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.204789 (+ 38530us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":588003,"threads_started":1,"wal-append.queue_time_us":707440}
I20260709 12:25:02.262491 31466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42112 (request call id 1751) took 2869 ms. Trace:
I20260709 12:25:02.274597 32048 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:02.275497 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:02.265180 31466 rpcz_store.cc:276] 0709 12:24:59.369954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.112733 (+1742779us) service_pool.cc:224] Handling call
0709 12:25:01.176413 (+ 63680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.176647 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:01.738271 (+561624us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.239259 (+500988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.239328 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:02.239392 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.239479 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.239605 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34226,"prepare.queue_time_us":385049,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":103106,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":26227,"thread_start_us":911427,"threads_started":3,"wal-append.queue_time_us":292748}
W20260709 12:25:02.284236 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 403517us
I20260709 12:25:02.249639  2534 raft_consensus.cc:3055] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:25:02.258334  2499 consensus_meta.cc:287] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.922s	user 0.014s	sys 0.003s
I20260709 12:25:02.310299  2678 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:02.311277 31361 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:02.304795  2534 raft_consensus.cc:740] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:25:02.312413  2585 consensus_meta.cc:287] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.873s	user 0.007s	sys 0.006s
W20260709 12:25:02.341452 31434 leader_election.cc:336] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 2.248s (SENT)
I20260709 12:25:02.313319 32048 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:02.281389  2595 consensus_meta.cc:287] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.662s	user 0.002s	sys 0.016s
I20260709 12:25:02.319557 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:02.319645 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 416417us
I20260709 12:25:02.255653  2420 raft_consensus.cc:697] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:25:02.320945  2655 log.cc:927] Time spent T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:25:02.327625  2618 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:02.345779 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 44283.8us
I20260709 12:25:02.356729 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:02.330304 31291 catalog_manager.cc:5697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 2 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:02.361402 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 448) took 1192 ms. Trace:
W20260709 12:25:02.370692 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 59502.3us
I20260709 12:25:02.341276  2678 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:02.371217 31464 raft_consensus.cc:1275] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:02.349061  2603 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:02.370915 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 332949us
I20260709 12:25:02.284229  2594 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:25:02.355053  2618 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:02.386328 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 92062.5us
I20260709 12:25:02.387198 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:02.387987 32083 raft_consensus.cc:2393] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:02.364121 31538 rpcz_store.cc:276] 0709 12:25:01.168624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.395608 (+226984us) service_pool.cc:224] Handling call
0709 12:25:01.446542 (+ 50934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.506644 (+ 60102us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:01.893934 (+387290us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.147354 (+253420us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b48002001d8. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:25:02.360973 (+213619us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.361038 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:02.361100 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.361181 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.361320 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87632,"prepare.queue_time_us":601481,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":63987,"raft.run_cpu_time_us":1669,"raft.run_wall_time_us":57335,"spinlock_wait_cycles":8856960,"thread_start_us":670180,"threads_started":3,"wal-append.queue_time_us":165684}
I20260709 12:25:02.384778 31469 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:02.380318 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 76304.1us
I20260709 12:25:02.389211 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:02.392138 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:02.389694 31359 leader_election.cc:336] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Remote error: Timed out: Call waited in the queue past client deadline
W20260709 12:25:02.378419  2533 consensus_meta.cc:287] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.000s
I20260709 12:25:02.391433 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.352027  2585 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.391523 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.377079  2664 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.377288  2642 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:02.376065  2678 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.351469  2499 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:02.400049 31434 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 2.089s (SENT)
I20260709 12:25:02.404060 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.388127  2618 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:02.362191  2691 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:02.404145 31291 catalog_manager.cc:5697] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.407500 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:02.408951  2611 consensus_meta.cc:287] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.029s	user 0.009s	sys 0.007s
I20260709 12:25:02.434029 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:02.433151 31359 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:02.435427 31537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1882) took 1054 ms. Trace:
I20260709 12:25:02.409698 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:02.435894 31537 rpcz_store.cc:276] 0709 12:25:01.380939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.429021 (+ 48082us) service_pool.cc:224] Handling call
0709 12:25:01.440477 (+ 11456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.454565 (+ 14088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.454601 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.472040 (+ 17439us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.867975 (+395935us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:01.984914 (+116939us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.988010 (+  3096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.988088 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.435190 (+447102us) raft_consensus.cc:1685] finished
0709 12:25:02.435211 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.435367 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51581,"prepare.queue_time_us":248745,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":4020,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":26236,"thread_start_us":415713,"threads_started":2,"wal-append.queue_time_us":563206}
I20260709 12:25:02.391655  2690 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.410137  2658 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:02.410650  2585 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:02.452696 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.454069 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.454697 31461 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
W20260709 12:25:02.455005 31290 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38054 (request call id 254) took 34437 ms (client timeout 15000 ms). Trace:
I20260709 12:25:02.411983 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.456773 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.457695 31465 raft_consensus.cc:2393] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:02.458475 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.460319 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:02.461179 32079 raft_consensus.cc:2393] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 11: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:25:02.455446 31290 rpcz_store.cc:269] 0709 12:24:28.018096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.018428 (+   332us) service_pool.cc:224] Handling call
0709 12:25:02.454767 (+34436339us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:58.920988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:58.921806 (+   818us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:58.921869 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:24:58.921896 (+    27us) tablet.cc:662] Decoding operations
0709 12:24:58.923153 (+  1257us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:58.996115 (+ 72962us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:58.998015 (+  1900us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:24:59.082246 (+ 84231us) tablet.cc:701] Row locks acquired
0709 12:24:59.082309 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:24:59.082505 (+   196us) write_op.cc:270] Start()
0709 12:24:59.082707 (+   202us) write_op.cc:276] Timestamp: P: 1783599899082430 usec, L: 0
0709 12:24:59.082731 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:24:59.083586 (+   855us) log.cc:844] Serialized 3727 byte log entry
0709 12:24:59.240706 (+157120us) op_driver.cc:464] REPLICATION: finished
0709 12:24:59.243402 (+  2696us) write_op.cc:301] APPLY: starting
0709 12:24:59.243471 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:59.243646 (+   175us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:59.243794 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:00.099283 (+855489us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:00.099806 (+   523us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:25:00.099881 (+    75us) write_op.cc:312] APPLY: finished
0709 12:25:00.100498 (+   617us) log.cc:844] Serialized 71 byte log entry
0709 12:25:00.102573 (+  2075us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:00.102986 (+   413us) write_op.cc:454] Released schema lock
0709 12:25:00.103083 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:00.753613 (+650530us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b540017bca8. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e976789e1 00007f6e9767764c 00007f6e94d083fd 00007f6e94cf4389 00007f6e94cf3b53 00007f6e94cf7d61 00007f6e94cf7d19 00007f6e94cf7ca9 00007f6e94cf7c71 00007f6e94cf6e9d 0000000000388634
0709 12:25:00.754154 (+   541us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:00.754183 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":215464,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":2428,"apply.run_cpu_time_us":16162,"apply.run_wall_time_us":1510642,"num_ops":9,"prepare.queue_time_us":768379,"prepare.run_cpu_time_us":15531,"prepare.run_wall_time_us":294174,"raft.queue_time_us":12061,"raft.run_cpu_time_us":2159,"raft.run_wall_time_us":2601,"replication_time_us":157845,"spinlock_wait_cycles":123643264,"thread_start_us":377749,"threads_started":4,"wal-append.queue_time_us":131051,"wal-append.run_cpu_time_us":4762,"wal-append.run_wall_time_us":1894417}]]}
I20260709 12:25:02.464330 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.465054 31465 raft_consensus.cc:2376] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8. Re-sending same reply.
I20260709 12:25:02.413558 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.394723  2538 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:02.439806 32082 raft_consensus.cc:1240] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:02.410279 32047 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:25:02.469802 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 59612.5us
I20260709 12:25:02.471669 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.469477 31291 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 11, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 11 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:02.474023 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:02.477298 31466 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
W20260709 12:25:02.478711 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 78101.9us
I20260709 12:25:02.481120 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.481832 31467 raft_consensus.cc:2368] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7.
I20260709 12:25:02.481972  2585 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:02.482349  2585 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:02.482702  2585 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.484560 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.485267 31469 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:02.400410  2533 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.446511 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:02.449951 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 49918.4us
I20260709 12:25:02.448081 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.486718 31291 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.479926 31465 raft_consensus.cc:2376] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9. Re-sending same reply.
I20260709 12:25:02.455693 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.494891 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.496968 31464 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:02.496914 32047 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:02.498916 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 53160.3us
I20260709 12:25:02.439626  2611 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:02.503799 31434 connection.cc:256] RPC call timeout handler was delayed by -1.5581319109996912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2343s for a response
I20260709 12:25:02.443368 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:02.503849  2672 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:25:02.517514 31291 catalog_manager.cc:5697] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 5 to 8, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.521181  2611 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:02.522001 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:02.524608 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.527289 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 95010.5us
W20260709 12:25:02.539860 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 130223us
I20260709 12:25:02.536095 31291 catalog_manager.cc:5697] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 8, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 8 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:02.518728  2673 log.cc:927] Time spent T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
I20260709 12:25:02.547567 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:02.567572 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:02.529680 31434 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:25:02.604318 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 89723.4us
W20260709 12:25:02.605156 31507 leader_election.cc:336] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.577s (SENT)
I20260709 12:25:02.569716 31359 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:02.625479 31291 catalog_manager.cc:5697] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 3, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 3 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:02.432305  2420 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.517558  2677 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:25:02.636282 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 68501.2us
I20260709 12:25:02.530061  2690 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.476392  2534 consensus_queue.cc:260] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.663657  2595 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:02.663033  2611 consensus_queue.cc:1048] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:02.593230  2641 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:25:02.626719  2682 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
W20260709 12:25:02.624751  2656 log.cc:927] Time spent T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:25:02.691383  2687 log.cc:927] Time spent T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:25:02.695477  2641 raft_consensus.cc:697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:02.699515 31470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 453) took 1208 ms. Trace:
W20260709 12:25:02.696045  2695 log.cc:927] Time spent T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:25:02.700358  2641 consensus_queue.cc:237] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.695987  2704 consensus_queue.cc:1048] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:25:02.701619  2689 consensus_queue.cc:1048] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:02.697168 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 588) took 1073 ms. Trace:
I20260709 12:25:02.698951 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1955) took 4528 ms. Trace:
I20260709 12:25:02.703055 31391 rpcz_store.cc:276] 0709 12:24:58.170719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.977570 (+2806851us) service_pool.cc:224] Handling call
0709 12:25:01.006651 (+ 29081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.007162 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.007202 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.039594 (+ 32392us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.621980 (+582386us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:02.145753 (+523773us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b18001c9a20. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e90e644bc 00007f6e8e1b248b 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cc455 00007f6e94cb43c7 00007f6e912c69a7 00007f6e912d60bf
0709 12:25:02.145892 (+   139us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.250497 (+104605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.250619 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.698553 (+447934us) raft_consensus.cc:1685] finished
0709 12:25:02.698653 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.698894 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253555,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":8623,"raft.queue_time_us":62028,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":191,"spinlock_wait_cycles":4839808,"thread_start_us":807342,"threads_started":2,"wal-append.queue_time_us":1642389}
I20260709 12:25:02.706287  2683 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:02.593353  2538 consensus_queue.cc:1059] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:25:02.707742  2538 raft_consensus.cc:3055] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:02.706883  2683 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.707764 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:02.709156 31468 raft_consensus.cc:2393] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 11: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:02.699941 31470 rpcz_store.cc:276] 0709 12:25:01.491059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.491199 (+   140us) service_pool.cc:224] Handling call
0709 12:25:01.517215 (+ 26016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.525086 (+  7871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.525132 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.572547 (+ 47415us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.877245 (+304698us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:01.877385 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.877613 (+   228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.699307 (+821694us) raft_consensus.cc:1685] finished
0709 12:25:02.699326 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.699460 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":258233,"threads_started":1,"wal-append.queue_time_us":921834}
I20260709 12:25:02.710212  2683 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:02.711375 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:02.712113 32082 raft_consensus.cc:2393] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 7: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:02.714031  2585 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.659109  2677 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:02.707136 31361 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: b63f042a541248b88888cbd3049b38ca
I20260709 12:25:02.702567 31387 rpcz_store.cc:276] 0709 12:25:01.623936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.629090 (+  5154us) service_pool.cc:224] Handling call
0709 12:25:01.629484 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.854149 (+224665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.854193 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.871585 (+ 17392us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.000633 (+129048us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:02.000686 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.000763 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.218968 (+218205us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b18004898e0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:25:02.696854 (+477886us) raft_consensus.cc:1685] finished
0709 12:25:02.696877 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.697110 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":482004,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"spinlock_wait_cycles":10118016,"thread_start_us":247967,"threads_started":2,"wal-append.queue_time_us":157195}
I20260709 12:25:02.691999 31291 catalog_manager.cc:5697] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 1 to 10, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 10 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:02.721995 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 192371us
W20260709 12:25:02.727535 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 222577us
W20260709 12:25:02.735415 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 471477us
W20260709 12:25:02.734855 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 222845us
I20260709 12:25:02.688042  2595 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:25:02.741158 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 238683us
I20260709 12:25:02.708280  2538 raft_consensus.cc:740] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:25:02.748265 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.721732  2677 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.760953 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:02.765661 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:02.768782 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:02.741964  2595 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.770437 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:02.771068 31535 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:02.773859 31537 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:02.737324  2678 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.747196  2688 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.787245 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:02.764624  2664 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.796473 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:02.797040 31542 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.798079 31359 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:02.795019 31291 catalog_manager.cc:5697] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.764637  2509 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.791883  2688 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.806485 31393 raft_consensus.cc:1240] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:02.806655  2688 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:02.807030  2659 log.cc:927] Time spent T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:25:02.807524  2533 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:02.807921  2509 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:02.809532 31395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1898) took 5211 ms. Trace:
I20260709 12:25:02.809851  2585 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:02.811017 32080 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:02.805922  2678 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:02.812460 32080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 591) took 1823 ms. Trace:
I20260709 12:25:02.812808 32080 rpcz_store.cc:276] 0709 12:25:00.989612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.007614 (+ 18002us) service_pool.cc:224] Handling call
0709 12:25:01.008069 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.811492 (+1803423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.812181 (+   689us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54000da554. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:25:02.812380 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4004779904}
I20260709 12:25:02.809932 31395 rpcz_store.cc:276] 0709 12:24:57.624943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.648767 (+3023824us) service_pool.cc:224] Handling call
0709 12:25:00.649204 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:00.649829 (+   625us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:01.583385 (+933556us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.844321 (+260936us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.938770 (+ 94449us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:01.985804 (+ 47034us) log.cc:844] Serialized 52 byte log entry
0709 12:25:01.986024 (+   220us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:01.986265 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.088446 (+102181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.088554 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.809294 (+720740us) raft_consensus.cc:1685] finished
0709 12:25:02.809315 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.809476 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28064,"prepare.queue_time_us":1197309,"prepare.run_cpu_time_us":190,"prepare.run_wall_time_us":40260,"raft.queue_time_us":847343,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":40042,"thread_start_us":1330237,"threads_started":4,"wal-append.queue_time_us":1070765}
I20260709 12:25:02.819139 31391 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:02.839967 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:02.772395  2499 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:02.842741 31389 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.848322 32047 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:02.839512 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 147506us
W20260709 12:25:02.843592 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 80335.4us
I20260709 12:25:02.815219  2683 consensus_queue.cc:1059] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:25:02.868299 32080 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:02.779366  2597 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
W20260709 12:25:02.878018 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 79996us
W20260709 12:25:02.865037  2692 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:02.878639 31434 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:02.864254  2509 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:02.895828 31359 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:02.905370  2534 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.877130 31389 raft_consensus.cc:2468] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 12.
I20260709 12:25:02.906351  2533 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:02.887670  2703 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.917236  2603 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:02.919247 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 577) took 3452 ms. Trace:
I20260709 12:25:02.879563  2538 consensus_queue.cc:260] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:02.892143 31291 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:02.893039  2173 consensus_queue.cc:1059] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:02.893394  2683 consensus_queue.cc:1243] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:02.919683 31392 rpcz_store.cc:276] 0709 12:24:59.466952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.062647 (+1595695us) service_pool.cc:224] Handling call
0709 12:25:01.128914 (+ 66267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.146988 (+ 18074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.147017 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.169176 (+ 22159us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.725844 (+556668us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:01.725897 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.725982 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.918954 (+1192972us) raft_consensus.cc:1685] finished
0709 12:25:02.918983 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.919146 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18054,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2653,"thread_start_us":556182,"threads_started":1,"wal-append.queue_time_us":1673073}
I20260709 12:25:02.892426  2693 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:02.906865  2533 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:02.953960 31359 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:02.970928 31543 raft_consensus.cc:2468] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 12.
W20260709 12:25:02.973156 31507 leader_election.cc:336] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.626s (SENT)
I20260709 12:25:02.974573 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:02.962430 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 71669.5us
W20260709 12:25:02.966337 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 46934.9us
W20260709 12:25:02.967247 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 101942us
W20260709 12:25:02.978025 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.990711 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 202076us
I20260709 12:25:02.981168  2509 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.001783  2509 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:03.002326  2509 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.001847 31291 catalog_manager.cc:5697] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.003911 31434 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:02.981626  2683 raft_consensus.cc:2804] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:03.005650  2683 raft_consensus.cc:697] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:03.006647  2683 consensus_queue.cc:237] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:03.007429  2603 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:03.009290 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.016285 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 62447.9us
I20260709 12:25:03.028091 31291 catalog_manager.cc:5697] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 8, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:03.029907  2662 raft_consensus.cc:3055] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:03.029843 31291 catalog_manager.cc:5697] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:03.030431  2662 raft_consensus.cc:740] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:25:03.031454 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 58338.4us
I20260709 12:25:03.033098  2662 consensus_queue.cc:260] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.034175 31542 raft_consensus.cc:2468] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:03.034662  2662 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.036685 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:03.038652 31361 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:03.038164 31291 catalog_manager.cc:5697] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 5 to 6, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 6 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:03.008673  2696 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:03.016567  2538 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.040690 31291 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 8 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:03.042255 31291 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 7, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 7 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.044219  2703 raft_consensus.cc:3055] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:03.044715  2703 raft_consensus.cc:740] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:03.045575  2703 consensus_queue.cc:260] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.046069 31359 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:03.046146  2534 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:03.048007  2674 log.cc:927] Time spent T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:25:03.009033  2693 raft_consensus.cc:697] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:03.049531  2693 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:02.971776  2533 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:03.051429  2640 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:25:03.061221  2690 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.062026  2681 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:03.062988 31359 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:03.065793 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 86604.4us
W20260709 12:25:03.066100 31507 leader_election.cc:336] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.735s (SENT)
I20260709 12:25:03.044164 31291 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 5 to 8, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 8 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:03.060684 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:03.104555 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 235906us
I20260709 12:25:03.116626 31434 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:03.124926 31507 leader_election.cc:336] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.737s (SENT)
I20260709 12:25:03.089121  2658 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.104581  2603 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:25:03.127892 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 65035.9us
I20260709 12:25:03.130622 31393 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:25:03.132866 31507 leader_election.cc:336] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.800s (SENT)
W20260709 12:25:03.142541 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 81970.2us
I20260709 12:25:03.088685  2595 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:03.149566 31386 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:03.110452  2678 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.110085  2680 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:03.148393 31507 leader_election.cc:336] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.828s (SENT)
W20260709 12:25:03.157598 31507 leader_election.cc:336] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.871s (SENT)
I20260709 12:25:03.136397  2658 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:25:03.171069 31510 connection.cc:256] RPC call timeout handler was delayed by -2.4409454330002518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 12:25:03.171505 31510 connection.cc:256] RPC call timeout handler was delayed by -2.386045433000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:25:03.171869 31510 connection.cc:256] RPC call timeout handler was delayed by -2.386045433000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:25:03.172230 31510 connection.cc:256] RPC call timeout handler was delayed by -2.3122454330000437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 12:25:03.172578 31510 connection.cc:256] RPC call timeout handler was delayed by -2.287045433000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:25:03.172940 31510 connection.cc:256] RPC call timeout handler was delayed by -2.1682454330002656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 12:25:03.173287 31510 connection.cc:256] RPC call timeout handler was delayed by -2.1556454330002452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:25:03.173651 31510 connection.cc:256] RPC call timeout handler was delayed by -2.0863454330001332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:25:03.173938 31510 connection.cc:256] RPC call timeout handler was delayed by -2.0863454330001332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:25:03.174237 31510 connection.cc:256] RPC call timeout handler was delayed by -2.0656454330000997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:25:03.174587 31510 connection.cc:256] RPC call timeout handler was delayed by -2.0656454330000997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 12:25:03.170684 31359 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:03.174957 31510 connection.cc:256] RPC call timeout handler was delayed by -2.0377454330000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 12:25:03.179342 31510 connection.cc:256] RPC call timeout handler was delayed by -1.9612454330003857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:25:03.180298 31510 connection.cc:256] RPC call timeout handler was delayed by -1.7587454330000583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22690000000000002s for a response
W20260709 12:25:03.180878 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.195031 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.205829 32047 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:03.206804 32079 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:03.157320  2678 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:03.208751 32082 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:03.149060  2603 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:03.213145 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.212896 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.170644  2658 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.214509 32075 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:03.215811  2681 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:03.216924  2681 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:03.194516  2703 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:03.211504  2618 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.005s
I20260709 12:25:03.228621 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.230398 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:03.239655 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 102511us
I20260709 12:25:03.241231 32082 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:03.244084 31434 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:03.245429  2420 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.243963  2683 consensus_queue.cc:1059] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:03.246800 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.263911  2683 raft_consensus.cc:3055] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:03.264268  2683 raft_consensus.cc:740] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:03.265018  2683 consensus_queue.cc:260] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.266204  2683 raft_consensus.cc:3060] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.267833  2603 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:03.246850  2618 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.269948 32078 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:03.211117  2678 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.271814  2533 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:03.274225  2533 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:03.247977  2708 raft_consensus.cc:2804] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:03.233343  2690 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:03.275660  2690 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:03.276129  2690 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.277336 32077 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:03.223668  2597 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:03.280310  2721 consensus_queue.cc:1059] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:03.281168  2597 consensus_queue.cc:1059] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:03.249493 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 96697.6us
I20260709 12:25:03.282022  2721 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:03.282814 31359 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:03.283521  2594 raft_consensus.cc:3055] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.283763 31359 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:03.283918  2594 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:03.284783  2594 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.285409 31359 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:03.285956  2594 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.287985  2733 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:03.288412  2733 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.288746  2733 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.251155 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:25:03.291671 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63375.2us
W20260709 12:25:03.292420 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.293701 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.252148  2716 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:03.255475  2696 raft_consensus.cc:2764] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:03.255648 31510 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:03.295912  2717 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:03.261437 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.296384  2696 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.274263 32084 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:03.296770  2696 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:03.297263  2696 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.298760 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:03.299979 31470 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:03.295922 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 45273.4us
I20260709 12:25:03.301494  2595 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:03.302845  2718 log.cc:927] Time spent T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:03.302672  2463 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:03.305318  2708 raft_consensus.cc:697] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:03.306272  2708 consensus_queue.cc:237] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.282052  2597 raft_consensus.cc:3055] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:03.307695  2597 raft_consensus.cc:740] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:03.308547  2597 consensus_queue.cc:260] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.251050 31361 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:03.295760 31510 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:03.260802 31388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1899) took 5611 ms. Trace:
I20260709 12:25:03.278847 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.265954  2658 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:03.319872 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.270958  2618 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:03.309769  2597 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:03.327299 31507 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.009s (SENT)
W20260709 12:25:03.327404 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 81316.5us
I20260709 12:25:03.348887 32082 raft_consensus.cc:2468] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
W20260709 12:25:03.377581 31507 leader_election.cc:336] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.032s (SENT)
W20260709 12:25:03.328981  2688 consensus_meta.cc:287] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.522s	user 0.015s	sys 0.007s
I20260709 12:25:03.307179  2678 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:03.300639  2680 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.328709  2533 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.388855 31470 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:03.310124 31388 rpcz_store.cc:276] 0709 12:24:57.649301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.667641 (+3018340us) service_pool.cc:224] Handling call
0709 12:25:00.709640 (+ 41999us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:00.747608 (+ 37968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.747661 (+    53us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:00.748782 (+  1121us) log.cc:844] Serialized 78 byte log entry
0709 12:25:01.629799 (+881017us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:01.851150 (+221351us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.045788 (+194638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.045868 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.260587 (+1214719us) raft_consensus.cc:1685] finished
0709 12:25:03.260607 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.260745 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22663,"prepare.queue_time_us":259916,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2498,"raft.queue_time_us":279134,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":193,"thread_start_us":1214332,"threads_started":3,"wal-append.queue_time_us":2102978}
W20260709 12:25:03.418524 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.428515 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 116547us
W20260709 12:25:03.438968 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 153597us
W20260709 12:25:03.446699 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 93541.6us
W20260709 12:25:03.447582 31507 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.047s (SENT)
W20260709 12:25:03.448633 31507 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.089s (SENT)
I20260709 12:25:03.452248 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.452972 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.453245 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:03.453454 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:03.431282  2591 consensus_meta.cc:287] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 1.127s	user 0.017s	sys 0.001s
I20260709 12:25:03.458621 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:03.444305 31359 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:03.460124  2744 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:03.462750 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 213672us
W20260709 12:25:03.467262 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.431981  2533 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:03.432291  2680 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:25:03.478979 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 183298us
I20260709 12:25:03.488674 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:03.489341 31539 raft_consensus.cc:3060] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:03.490211 32048 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:03.477221  2509 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:03.495103  2509 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:03.442116  2721 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 12:25:03.497542 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 121506us
I20260709 12:25:03.439693  2688 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:03.471149  2680 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.476341  2533 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.503759 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:03.469169  2585 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:03.464473  2591 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.504720  2534 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 12:25:03.519651 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 75446.8us
I20260709 12:25:05.612710 31359 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:03.521922 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.521220 31507 leader_election.cc:336] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.200s (SENT)
I20260709 12:25:03.522293 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:03.539861 32081 raft_consensus.cc:2393] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 10: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:03.780556  2748 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:05.741709  2748 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:05.742110  2748 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:05.438036 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.454099  2750 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 1.692s	user 0.004s	sys 0.015s
W20260709 12:25:05.605584 31543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.117s	user 0.017s	sys 0.015s
W20260709 12:25:05.620508 31510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.079s	user 0.017s	sys 0.009s
W20260709 12:25:05.743824 31543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.255s	user 0.017s	sys 0.015s
W20260709 12:25:05.744035 31510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.202s	user 0.018s	sys 0.009s
W20260709 12:25:05.744405 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 2.2406e+06us
W20260709 12:25:05.743845 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.745554 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.746171 32081 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 603) took 3369 ms (client timeout 3617 ms). Trace:
I20260709 12:25:05.746243 31510 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:05.626298 32050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.626637 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.748127 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.627653 31508 connection.cc:256] RPC call timeout handler was delayed by -1.6472933979998743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:25:05.628171 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.748932  2737 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.749498  2737 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.750461  2603 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.750968  2603 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:05.751410  2764 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:05.646646  2761 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:05.752184  2764 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:05.753121  2603 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:05.753644  2603 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.754050  2603 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.647284 31359 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:03.515743  2690 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:05.581403  2704 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.760567  2690 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:05.760242  2704 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.761137  2690 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:05.761186  2730 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:05.761911  2420 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.761798  2730 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:03.539083  2591 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:03.551311  2642 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:05.764164 31292 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 9 to 10, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:05.765105  2642 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.765636  2642 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.765801 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:05.766036 31292 catalog_manager.cc:5697] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.520826  2658 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:03.557343  2662 consensus_meta.cc:287] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.010s
W20260709 12:25:03.560602  2677 consensus_meta.cc:287] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.789s	user 0.002s	sys 0.014s
I20260709 12:25:05.771572  2677 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.773726  2677 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:04.294109  2680 consensus_meta.cc:287] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.002s
I20260709 12:25:03.501936  2681 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:04.182196  2683 consensus_meta.cc:287] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.915s	user 0.010s	sys 0.000s
I20260709 12:25:03.534427  2688 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:03.563514  2689 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.779282  2762 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:05.779037  2689 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.780236 32079 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
I20260709 12:25:05.779897  2762 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.781391  2689 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:03.536594  2696 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:05.782617 31436 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:03.535961  2743 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:05.774966  2680 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.784271  2743 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:05.467758  2745 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 1.688s	user 0.007s	sys 0.006s
W20260709 12:25:05.654937 31539 consensus_meta.cc:287] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 2.165s	user 0.025s	sys 0.018s
I20260709 12:25:05.787460 31539 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 13.
W20260709 12:25:05.787972 31539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 462) took 2313 ms (client timeout 2564 ms). Trace:
W20260709 12:25:05.788290 31539 rpcz_store.cc:269] 0709 12:25:03.474082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.474427 (+   345us) service_pool.cc:224] Handling call
0709 12:25:05.787889 (+2313462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:05.655699  2759 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.677735  2757 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.789791  2757 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.677883  2678 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:05.696383 31392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.210s	user 0.033s	sys 0.048s
W20260709 12:25:05.619879 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 2.09839e+06us
I20260709 12:25:05.722632 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:25:05.730235 31391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.289s	user 0.022s	sys 0.066s
W20260709 12:25:05.738174 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 2.21676e+06us
W20260709 12:25:05.797730 31391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.356s	user 0.023s	sys 0.067s
W20260709 12:25:05.740304 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 2.21785e+06us
I20260709 12:25:05.740844  2763 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:05.799882  2696 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:05.746611 32081 rpcz_store.cc:269] 0709 12:25:02.376593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.376748 (+   155us) service_pool.cc:224] Handling call
0709 12:25:05.745957 (+3369209us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54004a10d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:05.746103 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2632716672}
I20260709 12:25:05.800248 32048 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:05.784646  2743 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.801362  2743 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.801961 32048 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:05.802578  2763 raft_consensus.cc:2804] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:05.803083  2763 raft_consensus.cc:697] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:25:05.803721 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 81155.2us
I20260709 12:25:05.804404 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:05.804118  2763 consensus_queue.cc:237] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.807000 31361 leader_election.cc:400] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7.
W20260709 12:25:04.433413  2533 consensus_meta.cc:287] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.876s	user 0.010s	sys 0.002s
I20260709 12:25:05.880646  2591 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.880790  2533 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:05.881251  2591 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.755209  2764 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:05.762387  2420 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.756466 31389 raft_consensus.cc:1275] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:05.767778 31292 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 9, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 9 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:05.756623  2737 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:05.767922  2704 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:25:05.770629 31462 raft_consensus.cc:1275] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:25:05.895355 31462 pending_rounds.cc:85] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 7
I20260709 12:25:05.895711 31462 pending_rounds.cc:107] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:25:05.896011 31462 raft_consensus.cc:2889] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:05.774420  2730 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:05.777501 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:05.897861 31390 raft_consensus.cc:2410] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:05.779876 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:03.560792  2733 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:05.911902 31462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 473) took 2614 ms. Trace:
I20260709 12:25:05.912326 31462 rpcz_store.cc:276] 0709 12:25:03.297537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.300755 (+  3218us) service_pool.cc:224] Handling call
0709 12:25:03.301021 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.902312 (+2601291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.910407 (+  8095us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b54001900d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:25:05.911832 (+  1425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5678619392}
I20260709 12:25:05.913388  2733 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:05.783488 31388 raft_consensus.cc:1240] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:05.784608  2762 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:05.785565 31387 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:05.906342  2737 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.915959 31291 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38064 (request call id 250) took 15365 ms (client timeout 15000 ms). Trace:
I20260709 12:25:05.915803  2737 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:05.918254  2737 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:05.792797  2683 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:05.918830  2683 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.919273  2683 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.807415  2759 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:05.752460  2761 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.807512  2688 raft_consensus.cc:3060] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.808053 31391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 611) took 2495 ms. Trace:
I20260709 12:25:05.810875 31361 leader_election.cc:403] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:05.929536 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 122685us
I20260709 12:25:05.928576 31391 rpcz_store.cc:276] 0709 12:25:03.312368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.312502 (+   134us) service_pool.cc:224] Handling call
0709 12:25:03.378689 (+ 66187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.440675 (+ 61986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.440704 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.441195 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.467061 (+2025866us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:25:05.798223 (+331162us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:05.798269 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.798340 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.798397 (+    57us) raft_consensus.cc:1685] finished
0709 12:25:05.798415 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.807990 (+  9575us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81817,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":90418432,"thread_start_us":2389956,"threads_started":2,"wal-append.queue_time_us":260255}
I20260709 12:25:05.932456  2761 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:05.927799  2759 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.933362  2759 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.933415 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:25:05.837895 31507 connection.cc:256] RPC call timeout handler was delayed by -2.2477389770001537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2643s for a response
I20260709 12:25:05.934964 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:05.935702 31388 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
W20260709 12:25:05.840778 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 193817us
I20260709 12:25:05.936296  2733 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7.
I20260709 12:25:05.937425 31359 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:05.938225  2733 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.938997 31359 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:05.939782  2733 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:05.844947 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 113274us
I20260709 12:25:05.939389  2688 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:05.940652 31433 connection.cc:256] RPC call timeout handler was delayed by -2.1457958840001083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24150000000000002s for a response
W20260709 12:25:05.916414 31291 rpcz_store.cc:269] 0709 12:24:50.553243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.563502 (+ 10259us) service_pool.cc:224] Handling call
0709 12:25:05.915875 (+15352373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:03.581155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:04.183656 (+602501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:04.186440 (+  2784us) write_op.cc:435] Acquired schema lock
0709 12:25:04.186481 (+    41us) tablet.cc:662] Decoding operations
0709 12:25:04.223925 (+ 37444us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:04.282395 (+ 58470us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:04.293881 (+ 11486us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:25:04.441814 (+147933us) tablet.cc:701] Row locks acquired
0709 12:25:04.441917 (+   103us) write_op.cc:260] PREPARE: finished
0709 12:25:04.442132 (+   215us) write_op.cc:270] Start()
0709 12:25:04.442327 (+   195us) write_op.cc:276] Timestamp: P: 1783599904442042 usec, L: 0
0709 12:25:04.442348 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:25:04.443729 (+  1381us) log.cc:844] Serialized 8379 byte log entry
0709 12:25:04.451711 (+  7982us) op_driver.cc:464] REPLICATION: finished
0709 12:25:04.459404 (+  7693us) write_op.cc:301] APPLY: starting
0709 12:25:04.459529 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:04.460091 (+   562us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:04.460250 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:04.462793 (+  2543us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:04.463260 (+   467us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:25:04.463327 (+    67us) write_op.cc:312] APPLY: finished
0709 12:25:04.463889 (+   562us) log.cc:844] Serialized 145 byte log entry
0709 12:25:04.465200 (+  1311us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:04.465448 (+   248us) write_op.cc:454] Released schema lock
0709 12:25:04.465528 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:04.465966 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:04.466014 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":743014,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":7341,"apply.run_cpu_time_us":5433,"apply.run_wall_time_us":6537,"num_ops":21,"prepare.queue_time_us":93307,"prepare.run_cpu_time_us":11577,"prepare.run_wall_time_us":878185,"raft.queue_time_us":2111,"raft.run_cpu_time_us":7021,"raft.run_wall_time_us":13831,"replication_time_us":8704,"thread_start_us":72955,"threads_started":4,"wal-append.queue_time_us":1518,"wal-append.run_cpu_time_us":5529,"wal-append.run_wall_time_us":1019637}]]}
W20260709 12:25:05.942389 31433 connection.cc:256] RPC call timeout handler was delayed by -1.6247531799999706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 12:25:05.842090  2766 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:25:05.811733  2757 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:05.945318 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34624 (request call id 461) took 2472 ms. Trace:
I20260709 12:25:05.945696 31543 rpcz_store.cc:276] 0709 12:25:03.472647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.472877 (+   230us) service_pool.cc:224] Handling call
0709 12:25:03.473244 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.744259 (+2271015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:05.744292 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.744806 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.779094 (+ 34288us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:05.779132 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.785103 (+  5971us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.945080 (+159977us) raft_consensus.cc:1685] finished
0709 12:25:05.945102 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.945258 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":302431,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":164,"thread_start_us":2289693,"threads_started":2,"wal-append.queue_time_us":33027}
W20260709 12:25:05.848465 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 102281us
I20260709 12:25:05.949080  2762 consensus_queue.cc:1059] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:05.848904 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 71544.7us
I20260709 12:25:05.849466  2642 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.849938  2763 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.877384  2603 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:05.878613 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:05.862772  2743 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:05.899686 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 58969.5us
W20260709 12:25:05.942996 31433 connection.cc:256] RPC call timeout handler was delayed by -1.1983379459998105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
I20260709 12:25:05.953269 32048 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:05.899943 31292 catalog_manager.cc:5697] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 10, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:05.907137  2591 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:05.907656  2662 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:05.879954  2748 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.908176  2420 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:05.794818 31392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.309s	user 0.034s	sys 0.048s
W20260709 12:25:05.935750 31507 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.254s (SENT)
I20260709 12:25:05.795941  2680 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:05.951217 32084 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:25:05.951699  2730 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.953522 31433 connection.cc:256] RPC call timeout handler was delayed by -1.0743431179998879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
I20260709 12:25:05.883080  2533 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:05.954937  2771 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:05.979591 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:05.979826  2743 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:05.955667  2696 consensus_queue.cc:1059] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:05.980669  2683 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:05.956303  2767 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:05.956440 31292 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 5 to 8, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:05.981735 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 46032us
I20260709 12:25:05.982410  2767 raft_consensus.cc:3055] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:05.958343  2603 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:05.963261 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:05.964655 31392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47056 (request call id 612) took 2541 ms. Trace:
W20260709 12:25:05.965962 32048 connection.cc:256] RPC call timeout handler was delayed by -2.4959262709999166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:25:05.970008 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:05.977742  2761 consensus_queue.cc:1059] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:05.978029  2730 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:05.978657 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:05.989500 31436 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:05.982270 31292 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 8, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 8 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:05.983063 31387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:05.985128 31392 rpcz_store.cc:276] 0709 12:25:03.423601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.427334 (+  3733us) service_pool.cc:224] Handling call
0709 12:25:03.430590 (+  3256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.480756 (+ 50166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.480791 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.485676 (+  4885us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.964260 (+2478584us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:05.964299 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.964374 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.964437 (+    63us) raft_consensus.cc:1685] finished
0709 12:25:05.964455 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.964601 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30151,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":2517225,"threads_started":2,"wal-append.queue_time_us":327794,"wal-append.run_cpu_time_us":2417,"wal-append.run_wall_time_us":1376438}
I20260709 12:25:05.991075 31387 raft_consensus.cc:2410] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:05.977634  2776 raft_consensus.cc:2804] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:05.988456 31542 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:05.989478 31359 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:05.962236  2737 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:05.984697 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:05.988220 31544 raft_consensus.cc:3055] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:05.988354 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:05.993224 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:05.978847  2768 consensus_queue.cc:1059] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:05.994283 31544 raft_consensus.cc:740] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:05.994547 31468 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.994561 32075 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.995178 31292 catalog_manager.cc:5697] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:05.999498 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 49708.6us
I20260709 12:25:05.999959 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.000622 31390 raft_consensus.cc:2410] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:05.982774  2683 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:05.982769  2767 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:05.961540  2757 consensus_queue.cc:1048] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:06.001224  2763 consensus_queue.cc:1059] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:25:06.006057 31292 catalog_manager.cc:5697] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 7, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 7 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:05.991798  2689 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.992811  2420 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:06.007699  2776 raft_consensus.cc:697] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 13 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:06.034974  2642 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:06.035630  2689 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:06.035521  2776 consensus_queue.cc:237] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:06.024387  2730 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:05.978847  2764 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:25:06.024995 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:05.976464  2662 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:06.032548 31292 catalog_manager.cc:5697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.007433  2533 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:06.025584 31544 consensus_queue.cc:260] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:06.034127  2743 raft_consensus.cc:3055] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:06.038316 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.047117 31543 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.988991  2603 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:06.027662  2783 raft_consensus.cc:3055] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:06.043212 31392 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:25:06.040484  2761 consensus_queue.cc:1059] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:25:06.044812  2762 consensus_queue.cc:1059] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:06.044134 31292 catalog_manager.cc:5697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 5, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.044943 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.045543 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.046231 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:25:06.041911 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 53292.3us
I20260709 12:25:06.053258 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.060212 31359 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:06.060829 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 78366.4us
I20260709 12:25:06.061571 31389 raft_consensus.cc:2393] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 6: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:25:06.055853 31544 raft_consensus.cc:3060] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.002669  2737 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:06.031826  2420 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:06.062427 31507 connection.cc:256] RPC call timeout handler was delayed by -1.8961181210001996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 12:25:06.063956 31391 raft_consensus.cc:2468] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
W20260709 12:25:06.068951 31507 connection.cc:256] RPC call timeout handler was delayed by -1.7527389770002628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31930000000000003s for a response
I20260709 12:25:06.062402 31388 raft_consensus.cc:2393] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:25:06.066422  2603 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:06.058549  2772 consensus_queue.cc:1059] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:25:06.057641  2533 raft_consensus.cc:697] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:25:06.069270 31507 connection.cc:256] RPC call timeout handler was delayed by -1.7023389770001813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3249s for a response
I20260709 12:25:06.070078 32075 raft_consensus.cc:2468] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 12.
I20260709 12:25:06.051370  2743 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:25:06.136817 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.095467 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.185024 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:06.185387 31507 connection.cc:256] RPC call timeout handler was delayed by -1.5019181210004717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
I20260709 12:25:06.185787 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.186475 31394 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:06.089210 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:06.070797 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.187578 31436 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
W20260709 12:25:06.185917 31507 connection.cc:256] RPC call timeout handler was delayed by -1.4774807310004689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 12:25:06.088721 31510 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:06.138895 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.190881 31463 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:25:06.185830 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.194145 31388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.194844 31388 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:25:06.194572  2533 consensus_queue.cc:237] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:06.196058 31392 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:06.185323 31467 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 12: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:06.198370 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.071137 31468 raft_consensus.cc:2468] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:06.078130  2420 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.110484 31543 raft_consensus.cc:2468] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:06.055889  2783 raft_consensus.cc:740] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:25:06.204198 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.206076 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 130187us
I20260709 12:25:06.197723 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:06.126688  2761 raft_consensus.cc:3055] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:06.223838 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:06.243261 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.245126 31462 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
I20260709 12:25:06.095772  2768 raft_consensus.cc:3055] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:25:06.232265 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.231747 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 171630us
I20260709 12:25:06.095134  2704 raft_consensus.cc:3055] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:06.254876 31391 raft_consensus.cc:2410] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:06.264083 31395 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:06.256412 32048 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:06.268525 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:06.088032  2733 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:06.103415  2737 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:06.276312 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.284135 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.284890 31394 raft_consensus.cc:2393] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 4: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:25:06.286290 31390 raft_consensus.cc:2393] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:25:06.292941 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.235302  2762 raft_consensus.cc:3055] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:06.255653  2768 raft_consensus.cc:740] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:06.265064  2704 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:06.271412  2683 raft_consensus.cc:2804] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:06.244784  2761 raft_consensus.cc:740] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:06.300421 31392 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:25:06.297709 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:06.312050 31543 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:25:06.271706  2748 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:06.303875 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.307428 31542 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:06.313910 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.315167  2794 raft_consensus.cc:3055] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:06.298802  2762 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:06.291896  2733 raft_consensus.cc:697] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:06.316373 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.316560 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.324489 31392 raft_consensus.cc:2468] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 5.
I20260709 12:25:06.104705  2767 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:06.327661 31394 raft_consensus.cc:2393] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 11: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:25:06.330475 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.327158 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:06.335146 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:06.316599  2781 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 12:25:06.337949 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 69519us
I20260709 12:25:06.338903 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.321620  2794 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:06.341719 31539 raft_consensus.cc:2393] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:06.386288 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:06.387301 31542 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:06.323921  2683 raft_consensus.cc:697] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 12 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:06.391333 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.391613 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.392401 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.395629 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:06.395571 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.392676 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.404956 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:06.406493 31463 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 7: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:06.406472 31544 raft_consensus.cc:1275] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:06.409778 32050 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.194:40963 timed out after 2.705s (SENT) [suppressed 45 similar messages]
I20260709 12:25:06.411482 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.414397 31462 raft_consensus.cc:2368] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 12. Current term is 13.
I20260709 12:25:06.334827  2748 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.417284 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:06.395653 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:06.301474  2743 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:06.319299  2759 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:06.418308 31394 raft_consensus.cc:2376] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8. Re-sending same reply.
I20260709 12:25:06.425082 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:06.425737 32075 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 6.
I20260709 12:25:06.426097 32047 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:06.341115  2785 raft_consensus.cc:2804] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:06.429678 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.437438 32047 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:06.443574 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.445758 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.447142 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:06.459368 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.564519 31468 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.566646 31390 raft_consensus.cc:2368] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 7. Current term is 8.
I20260709 12:25:06.574337 31392 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:25:06.575834 31394 raft_consensus.cc:2410] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:06.575953 31466 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:25:06.579623 31389 raft_consensus.cc:2368] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 10. Current term is 11.
I20260709 12:25:06.598169 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.596771 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:06.598683 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:06.599956 31466 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:06.596833 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:06.598932 31386 raft_consensus.cc:2368] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10.
I20260709 12:25:06.609822 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:06.610334 31507 connection.cc:256] RPC call timeout handler was delayed by -1.3487807310002609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 12:25:06.610515 31536 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:06.610738 31507 connection.cc:256] RPC call timeout handler was delayed by -1.3370807310002419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 12:25:06.613109 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:06.614395 31538 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:06.614662 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.615475 31535 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.430207  2799 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:06.421825  2748 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:06.620175 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 189856us
I20260709 12:25:06.622772 31539 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:25:06.622169 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.623965 31541 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.622392 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:25:06.619990 31509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.012s
I20260709 12:25:06.338131  2783 consensus_queue.cc:260] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:06.407339  2768 consensus_queue.cc:260] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:06.618889 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:06.625453 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 215713us
I20260709 12:25:06.628873 31540 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:06.611059 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1585092670002268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 12:25:06.620847 31389 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:06.621534 31387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.034s	sys 0.050s
W20260709 12:25:06.632400 31387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.034s	sys 0.050s
W20260709 12:25:06.630905 31509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.004s	sys 0.012s
W20260709 12:25:06.630841 31507 connection.cc:256] RPC call timeout handler was delayed by -1.1178660730001866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 12:25:06.632200 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.634697 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.633563 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:06.615644  2775 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:06.640108 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.640400 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.640892 31539 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.620339  2799 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.690157 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:25:06.650355 32105 debug-util.cc:398] Leaking SignalData structure 0x7b080022a860 after lost signal to thread 30223
W20260709 12:25:06.699186 32105 debug-util.cc:398] Leaking SignalData structure 0x7b080028eea0 after lost signal to thread 30226
W20260709 12:25:06.700416 32105 debug-util.cc:398] Leaking SignalData structure 0x7b0800287d80 after lost signal to thread 31327
W20260709 12:25:06.701946 32105 debug-util.cc:398] Leaking SignalData structure 0x7b0800377ba0 after lost signal to thread 31419
W20260709 12:25:06.702265 32105 debug-util.cc:398] Leaking SignalData structure 0x7b0800248ba0 after lost signal to thread 31420
I20260709 12:25:06.692438 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.703702 31538 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.692446 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.619936  2802 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:06.629878  2803 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:25:06.709895  2591 consensus_queue.cc:1048] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:06.595690  2762 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:06.713042  2762 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.588521  2794 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:06.715482 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 84132.9us
I20260709 12:25:06.715842  2794 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.715615 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:06.717340 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.718695 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.447162  2761 consensus_queue.cc:260] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:06.716090 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.722621 31536 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:06.727525 31389 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:25:06.727957 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.729403 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.729318 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:06.730140 31510 connection.cc:256] RPC call timeout handler was delayed by -2.9763622830000713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 12:25:06.730561 31536 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.731904 31386 raft_consensus.cc:2393] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
W20260709 12:25:06.730525 31510 connection.cc:256] RPC call timeout handler was delayed by -2.9007622829999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:25:06.732992 31510 connection.cc:256] RPC call timeout handler was delayed by -2.6946622830000706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 12:25:06.733397 31510 connection.cc:256] RPC call timeout handler was delayed by -2.4039622830000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 12:25:06.733780 31510 connection.cc:256] RPC call timeout handler was delayed by -2.0223622829998931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2643s for a response
W20260709 12:25:06.734148 31510 connection.cc:256] RPC call timeout handler was delayed by -1.5273622830000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31930000000000003s for a response
W20260709 12:25:06.723011 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 89320.8us
I20260709 12:25:06.588055  2733 consensus_queue.cc:237] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:06.745627 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:25:06.741994 32105 debug-util.cc:398] Leaking SignalData structure 0x7b0800321dc0 after lost signal to thread 31494
I20260709 12:25:06.644600  2775 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:06.747345 32105 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7ee0 after lost signal to thread 31495
W20260709 12:25:06.748713 32105 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd460 after lost signal to thread 31568
W20260709 12:25:06.749993 32105 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2740 after lost signal to thread 32108
I20260709 12:25:06.640843 31394 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
W20260709 12:25:06.753811 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.759804 31536 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:25:06.776187 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.763239 31540 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:25:06.776934 31386 raft_consensus.cc:2393] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:25:06.777422 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.777972 31540 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.776943 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.778906 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.777726 32050 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
W20260709 12:25:06.779884 32105 debug-util.cc:398] Leaking SignalData structure 0x7b08002c02e0 after lost signal to thread 32109
I20260709 12:25:06.720643  2802 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.782671 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.755842 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:25:06.634946 31507 connection.cc:256] RPC call timeout handler was delayed by -1.08906607300014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 12:25:06.787357 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0728660730001138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:25:06.787655 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0411181210001814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2614s for a response
W20260709 12:25:06.787894 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0047299840002779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:25:06.771136 31539 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:06.786309 31468 raft_consensus.cc:2468] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:06.720212  2799 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.793466 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:06.839812 31536 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
W20260709 12:25:06.794509 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.840643 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 63007us
I20260709 12:25:06.818104 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:06.720348  2809 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:06.822422 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:06.616192  2683 consensus_queue.cc:237] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:06.823556 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.845842 31540 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
W20260709 12:25:06.846168 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.825831 31507 leader_election.cc:336] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.511s (SENT)
W20260709 12:25:06.846767 31507 leader_election.cc:336] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.583s (SENT)
I20260709 12:25:06.823685 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:25:06.847390 31507 leader_election.cc:336] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.615s (SENT)
I20260709 12:25:06.746680  2783 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:06.780905  2797 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:25:06.818976 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:06.850255 31386 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 12: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:06.833808  2811 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Timed out: LeaderStepDown RPC to 127.29.131.193:43521 timed out after 10.000s (SENT)
I20260709 12:25:06.856650 30223 tablet_server.cc:179] TabletServer@127.29.131.193:0 shutting down...
I20260709 12:25:06.858665  2811 consensus_queue.cc:1059] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:06.843868 31466 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 12:25:06.754364  2808 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:06.827600 31392 raft_consensus.cc:2468] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:25:06.847759 31507 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:06.940642 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 93257us
I20260709 12:25:06.940827 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
W20260709 12:25:06.941494 31507 leader_election.cc:336] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.633s (SENT)
I20260709 12:25:06.941975 31507 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:06.846928 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:06.942912 31537 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.793877  2802 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.844892  2809 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.858923 31540 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:25:06.843070  2785 raft_consensus.cc:697] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:25:06.867982  2805 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:25:06.868577  2591 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:06.882472 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:07.003166 31538 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:06.883728  2748 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:06.887791 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
W20260709 12:25:06.845504  2791 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:25:06.903901  2759 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:06.842492 31282 maintenance_manager.cc:419] P 893a35e10f7f42ceb588211d8d9ba07f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033377
W20260709 12:25:06.851007  2792 log.cc:927] Time spent T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.439s	user 0.001s	sys 0.000s
W20260709 12:25:06.925093  2804 log.cc:927] Time spent T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:25:06.754949  2775 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:06.925976 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.060148 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.928267 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:07.061802 31394 raft_consensus.cc:1217] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 12:25:06.958606 31386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:06.994602 31392 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.999601 31390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:07.005069 31535 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 6.
I20260709 12:25:06.940099  2603 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.015985 31389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:07.001015  2761 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.023032 31537 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
W20260709 12:25:07.024643 31433 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.590s (SENT)
I20260709 12:25:06.995560  2808 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:07.145579 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 301126us
I20260709 12:25:07.002974  2591 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.028458 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29"
I20260709 12:25:07.041810 31541 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:07.058565 31391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:07.025238  2748 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.065953 31394 raft_consensus.cc:1240] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:07.067070 31386 raft_consensus.cc:2393] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 12: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:07.068112 31433 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:06.995229  2809 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:07.137075 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 195587us
I20260709 12:25:07.148530 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.146656 31510 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:07.151511 31461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48410 (request call id 482) took 1149 ms. Trace:
I20260709 12:25:07.152509 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "503bef451a2b424fa35e8e46b8c06f29" is_pre_election: true
I20260709 12:25:07.150928  2591 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.154757 31389 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:07.160660 31389 raft_consensus.cc:1240] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:07.164278 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.167057 32075 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
W20260709 12:25:07.168022 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.157178 31391 raft_consensus.cc:2410] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:07.157652 31386 raft_consensus.cc:1275] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:25:07.157910 31539 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.170425 31386 pending_rounds.cc:85] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Aborting all ops after (but not including) 3
I20260709 12:25:07.171742 31386 pending_rounds.cc:107] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:25:07.172029 31386 raft_consensus.cc:2889] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:07.155350 31461 rpcz_store.cc:276] 0709 12:25:06.001941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.002070 (+   129us) service_pool.cc:224] Handling call
0709 12:25:06.021890 (+ 19820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.026626 (+  4736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.026670 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:06.031539 (+  4869us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.288560 (+257021us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:06.288623 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.288729 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.151318 (+862589us) raft_consensus.cc:1685] finished
0709 12:25:07.151341 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.151460 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":639,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7195,"thread_start_us":228661,"threads_started":1,"wal-append.queue_time_us":367508}
W20260709 12:25:07.155298 31507 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.654s (SENT)
I20260709 12:25:07.173589 31507 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.174896 31395 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:07.191860 31542 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:07.193008 31390 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:07.194736 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:07.195446 31541 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 6.
I20260709 12:25:07.196624 31392 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:25:07.198185 31535 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:07.153038  2815 raft_consensus.cc:3055] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:07.200109 31393 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:07.202508 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:07.170643  2688 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.172298  2689 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:07.208213  2819 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.208877  2733 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.209501  2823 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:07.210198 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 54974.4us
W20260709 12:25:07.227819 31507 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.667s (SENT)
I20260709 12:25:07.228467 31507 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.148798  2603 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.207516 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:07.213696 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 189092us
W20260709 12:25:07.232919 31433 leader_election.cc:336] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.643s (SENT)
I20260709 12:25:07.191136  2821 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:07.230291 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 83759.1us
I20260709 12:25:07.230405 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:07.203863  2815 raft_consensus.cc:740] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:07.233425 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.153609  2759 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:25:07.237002 31542 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.254110 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.222896  2748 raft_consensus.cc:2764] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:07.154615  2785 consensus_queue.cc:237] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:07.258459 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 51034.1us
I20260709 12:25:07.271556 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:07.273614 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.281822 31539 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:07.282835 31387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56518 (request call id 1965) took 1285 ms. Trace:
I20260709 12:25:07.224886  2772 consensus_queue.cc:1059] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:07.258549  2688 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.283203 31387 rpcz_store.cc:276] 0709 12:25:05.997329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.997580 (+   251us) service_pool.cc:224] Handling call
0709 12:25:05.997872 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.003120 (+  5248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.003152 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:06.016036 (+ 12884us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.098392 (+ 82356us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b48002e02d8. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e961e5aa1 00007f6e961dcb37 00007f6e961dc9ca 00007f6e962d426f 00007f6e962d3f37 00007f6e962e855c 00007f6e962e8508 00007f6e962e8488 00007f6e962e8443 00007f6e962e76ec 00007f6e95211a96
0709 12:25:06.634222 (+535830us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:06.725823 (+ 91601us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.726047 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.726124 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.208170 (+482046us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b18000613c0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e19d2a6 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1
0709 12:25:07.208692 (+   522us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b18000613c0. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:25:07.282619 (+ 73927us) raft_consensus.cc:1685] finished
0709 12:25:07.282646 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.282773 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96398,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":3639,"raft.run_cpu_time_us":2282,"raft.run_wall_time_us":111703,"spinlock_wait_cycles":66673664,"thread_start_us":578626,"threads_started":1,"wal-append.queue_time_us":783092}
I20260709 12:25:07.258095  2813 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:07.228931  2817 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:25:07.273053  2733 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.307420  2825 raft_consensus.cc:493] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.308194  2825 raft_consensus.cc:515] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.231338  2819 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:07.295935  2762 consensus_meta.cc:287] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.001s
I20260709 12:25:07.305735  2696 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.306350  2763 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:07.280308  2748 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.316370 31542 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:25:07.321787 31434 leader_election.cc:336] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Timed out: RequestConsensusVote RPC to 127.29.131.195:37233 timed out after 1.510s (SENT)
I20260709 12:25:07.322945 31434 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:07.323800 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 96021us
W20260709 12:25:07.324506 31507 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.682s (SENT)
I20260709 12:25:07.235466  2823 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:25:07.327448 31507 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.814s (SENT)
I20260709 12:25:07.329658 31507 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.336833  2734 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.342046 31542 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.317287  2688 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 12:25:07.339146  2420 consensus_meta.cc:287] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 1.068s	user 0.003s	sys 0.008s
I20260709 12:25:07.357350  2824 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.309682  2813 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.362336 31543 raft_consensus.cc:2410] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:07.330327  2828 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.327049  2763 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.364135  2802 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:25:07.366355 31507 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.959s (SENT)
I20260709 12:25:07.380147 31507 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:07.383461 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 150584us
W20260709 12:25:07.384119 31433 leader_election.cc:336] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.853s (SENT)
I20260709 12:25:07.384502 31433 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.379379  2783 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:07.388491  2820 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:25:07.388417  2824 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.320309  2815 consensus_queue.cc:260] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.390672  2815 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.378973  2808 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:07.345947  2822 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.377014  2420 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.396176  2825 leader_election.cc:290] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:07.399565 31465 raft_consensus.cc:2393] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 11: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:07.398829  2420 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:07.431669 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 65342.6us
W20260709 12:25:07.443548 31507 leader_election.cc:336] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.044s (SENT)
W20260709 12:25:07.453675 31507 leader_election.cc:336] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.269s (SENT)
I20260709 12:25:07.461402 31507 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:07.463189 31507 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.614s (SENT)
I20260709 12:25:07.463977 31507 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:07.465934 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 211923us
W20260709 12:25:07.466322 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 144559us
I20260709 12:25:07.426076  2808 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.469733 31510 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.471154 31510 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:07.466675  2828 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:07.472090 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 84698us
I20260709 12:25:07.474829 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:07.477018 32109 heartbeater.cc:646] Failed to heartbeat to 127.29.131.254:36201 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.29.131.254:36201 timed out after 15.000s (SENT)
I20260709 12:25:07.479318 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:07.465979  2783 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:07.480185 31433 leader_election.cc:336] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.922s (SENT)
I20260709 12:25:07.468206  2813 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:07.453611  2809 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.489493  2809 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:07.490861  2802 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:07.484277  2759 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:07.491745  2759 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:07.493598  2759 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:07.493507  2591 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.495247  2763 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:07.484436  2808 raft_consensus.cc:2804] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:07.496047  2799 consensus_meta.cc:287] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 12:25:07.496263  2808 raft_consensus.cc:697] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:07.496524  2799 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:07.466429  2603 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:07.404902  2775 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.483986 31433 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.508952 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:07.509426 31433 leader_election.cc:336] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.155s (SENT)
I20260709 12:25:07.510025 31433 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:07.485026 31510 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:07.484835 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 184437us
W20260709 12:25:07.486250  2829 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:25:07.512140  2783 raft_consensus.cc:2764] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:07.497771 31536 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.512228 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:07.514081 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:07.514485 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.515075 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:07.499912 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:07.497159  2808 consensus_queue.cc:237] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.504145  2823 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:07.517184 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:07.516165 31462 raft_consensus.cc:2410] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:07.471204  2833 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.520573 31361 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:07.515877 31542 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:07.517839 32079 raft_consensus.cc:1240] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 12:25:07.516615 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:07.520089 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:07.523720 31470 raft_consensus.cc:1240] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:07.522891 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:07.525909 32077 raft_consensus.cc:2393] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:07.526799 31510 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.529407 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:07.530689 31542 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:07.507834  2759 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:07.528441  2783 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.532398 31462 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:07.522989  2832 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:25:07.533865 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.534623 31461 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.534823 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:07.535862 31465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48410 (request call id 484) took 1494 ms. Trace:
I20260709 12:25:07.536227 31465 rpcz_store.cc:276] 0709 12:25:06.041405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.041564 (+   159us) service_pool.cc:224] Handling call
0709 12:25:07.535710 (+1494146us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002a53d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:07.535812 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077752064}
I20260709 12:25:07.539558  2834 consensus_queue.cc:1059] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:07.541070  2834 raft_consensus.cc:3055] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:07.541532  2834 raft_consensus.cc:740] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:07.542097 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:07.531893  2733 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.544499 31535 raft_consensus.cc:1240] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:07.545862 31535 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.548617  2799 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:07.518251  2764 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:07.549379  2743 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.550123 31510 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.551259  2775 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:07.517078  2603 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.553673  2591 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:07.555950  2825 consensus_queue.cc:1059] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:25:07.556867 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.557149  2603 raft_consensus.cc:3055] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:07.557511  2603 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:07.558303  2603 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:07.544348  2835 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.560772  2783 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:07.563195 31543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54126 (request call id 1907) took 1243 ms. Trace:
I20260709 12:25:07.567857 31543 rpcz_store.cc:276] 0709 12:25:06.319905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.326814 (+  6909us) service_pool.cc:224] Handling call
0709 12:25:07.563003 (+1236189us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540021eb54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:07.563121 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367132928}
I20260709 12:25:07.569700  2763 consensus_queue.cc:1048] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:07.569829 32047 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.571736  2763 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.572460  2767 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:07.579092 31359 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:07.580578 31359 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.580868 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:07.585949 32078 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.586126  2764 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.586647  2764 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.587047  2764 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.589797  2835 consensus_queue.cc:1059] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:07.590871  2823 raft_consensus.cc:3055] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:07.581545 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:07.591216  2823 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:07.563483  2783 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:07.584322  2842 consensus_queue.cc:1059] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:07.585114  2733 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.593745 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:07.596274 31544 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:07.603506 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 53463.5us
I20260709 12:25:07.604158 31538 raft_consensus.cc:1240] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:25:07.597716 31433 leader_election.cc:336] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:07.547042 31535 raft_consensus.cc:1240] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:07.598075 31542 raft_consensus.cc:2468] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
W20260709 12:25:07.609490 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.629030 31433 leader_election.cc:336] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:07.532065  2761 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.617452 31543 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
W20260709 12:25:07.601591 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 70689.2us
I20260709 12:25:07.631532 32048 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:07.657356 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.633585 31541 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
W20260709 12:25:07.650192 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.653890 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:07.629659 31433 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:07.632617 32078 raft_consensus.cc:2468] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
W20260709 12:25:07.653623 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 48597.6us
I20260709 12:25:07.662227 31436 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:07.664346 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:07.664618 32048 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:07.676335 31535 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:07.611168  2696 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.531718  2759 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:07.684003 31510 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:07.685067 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.675040 31461 raft_consensus.cc:2468] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
W20260709 12:25:07.698522 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.542614  2834 consensus_queue.cc:260] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:07.700184 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.703758 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:07.703761 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:25:07.705753 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 129720us
I20260709 12:25:07.706720 32080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:07.707433 32080 raft_consensus.cc:2368] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 10. Current term is 11.
I20260709 12:25:07.711123 31510 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:07.711905 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.712769 32079 raft_consensus.cc:2368] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
I20260709 12:25:07.699328  2785 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:07.620728  2799 consensus_queue.cc:1059] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:25:07.620465  2733 consensus_queue.cc:1059] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:25:07.740304 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:07.713037 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 84043.7us
I20260709 12:25:07.592424  2823 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:07.741966  2823 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.714146 31394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56522 (request call id 1915) took 1082 ms. Trace:
I20260709 12:25:07.743347 31394 rpcz_store.cc:276] 0709 12:25:06.631384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.152155 (+520771us) service_pool.cc:224] Handling call
0709 12:25:07.152667 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.152954 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:07.377851 (+224897us) log.cc:844] Serialized 14 byte log entry
0709 12:25:07.713695 (+335844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.713780 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:07.713844 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.713930 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.714077 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55864,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":29,"spinlock_wait_cycles":17280,"thread_start_us":482032,"threads_started":3,"wal-append.queue_time_us":313767}
I20260709 12:25:07.745673  2420 consensus_queue.cc:1059] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:07.681432  2817 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:07.747457  2817 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:07.747840  2817 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.749015 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.749632 31467 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.700055  2824 raft_consensus.cc:2804] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:07.751194  2824 raft_consensus.cc:697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:07.752774 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.733575 31535 raft_consensus.cc:1240] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:07.733579 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:07.701583  2783 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.734714 31510 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.735909 31462 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.710786  2833 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.708956  2734 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.761050 31541 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:07.757622 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:07.788725 31465 raft_consensus.cc:1240] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
W20260709 12:25:07.790343 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 55708.5us
I20260709 12:25:07.791095 31510 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.782661 31467 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:07.734385  2696 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.796738 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:07.737349  2834 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.801652 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.803146 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:07.801483 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 57284.2us
I20260709 12:25:07.804571 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.738570  2785 raft_consensus.cc:697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:07.805281 31510 leader_election.cc:400] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 12. Current term is 13.
I20260709 12:25:07.746855  2420 consensus_queue.cc:1059] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:25:07.805604 31510 leader_election.cc:403] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:07.805584 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.807528 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:07.810971 31470 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.812414 31467 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:07.796909  2808 raft_consensus.cc:3055] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:07.817180 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.824962 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.818656 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:07.799222  2761 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.827340 31535 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:07.832350 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.833003 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:07.680729  2776 consensus_queue.cc:1059] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:25:07.832410 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:07.836089 31539 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.841445 31510 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:07.842056 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.816428  2799 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.826530  2783 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.872731 31510 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:07.855595 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.867839 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:25:07.868988 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.874306 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.874457 31539 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.876052  2704 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.827323  2808 raft_consensus.cc:740] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:07.880029  2808 consensus_queue.cc:260] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.881265  2808 raft_consensus.cc:3060] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.849923 31470 raft_consensus.cc:2468] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:07.850580 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.891759 32076 raft_consensus.cc:1240] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 8. Ops: []
I20260709 12:25:07.893302 32079 raft_consensus.cc:1240] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
W20260709 12:25:07.897367 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.852041 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.899451 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.876469  2688 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.752108  2824 consensus_queue.cc:237] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:07.841075  2842 raft_consensus.cc:3055] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:07.890868 32080 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEARNER]: Advancing to term 8
I20260709 12:25:07.903563 31468 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.904615 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:07.842013  2826 raft_consensus.cc:3055] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:07.902294  2776 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.907789  2688 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:07.907584  2853 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:25:07.877403  2704 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:07.908108 31466 raft_consensus.cc:1275] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:25:07.908169  2761 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.912976 31539 raft_consensus.cc:1275] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:25:07.891661  2844 log.cc:927] Time spent T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:07.843901  2696 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for earlier term 12. Current term is 13.
I20260709 12:25:07.916930 31535 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:07.815503  2734 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:25:07.883440  2833 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:07.906246  2842 raft_consensus.cc:740] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:07.918136 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.914746 31510 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:07.905459 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:07.955035 31465 raft_consensus.cc:2376] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10. Re-sending same reply.
W20260709 12:25:07.955255 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 49852.8us
I20260709 12:25:07.920032 31466 pending_rounds.cc:85] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 8
I20260709 12:25:07.957357 31466 pending_rounds.cc:107] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:25:07.957779 31466 raft_consensus.cc:2889] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:07.947330 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 355179us
I20260709 12:25:07.915400  2826 raft_consensus.cc:740] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:07.948388  2759 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:07.927299 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:07.964082 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.891541  2783 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:07.960217 31359 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.919375  2662 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:07.962499 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 47807.7us
I20260709 12:25:07.976055 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:07.966706 31535 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:07.968636 31468 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:25:07.973747 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:07.976588 31510 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.989431 31539 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.976619 31465 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.921084  2688 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:08.015951 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 55822.6us
I20260709 12:25:08.016944 31359 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.018031 31359 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.021688 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.021981 31359 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:07.962047  2833 raft_consensus.cc:697] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:07.973155  2853 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:08.022819 31535 raft_consensus.cc:2393] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 10: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:07.914070  2785 consensus_queue.cc:237] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:08.024245 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 47762.8us
I20260709 12:25:08.025441 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.027491 32050 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:25:08.011583  2533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.032s	sys 0.046s
I20260709 12:25:08.022873 31359 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.030916 31539 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 11: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:08.030666 31510 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.032902 31359 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.032919 31510 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:07.986331  2767 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.013953  2759 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:08.040875 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.026193  2849 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:08.022392  2761 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:08.037369  2533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.033s	sys 0.046s
I20260709 12:25:08.033479  2826 consensus_queue.cc:260] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:08.021100  2800 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.077289  2842 consensus_queue.cc:260] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.084493  2813 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.084962  2795 consensus_queue.cc:1048] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:25:08.030032  2853 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:25:08.086707 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53857.7us
W20260709 12:25:08.146126  2856 log.cc:927] Time spent T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:25:08.087846 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.040890  2757 raft_consensus.cc:2804] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:08.091776 31544 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:08.263096  2662 raft_consensus.cc:3055] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:08.244175 32075 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49878 (request call id 615) took 1612 ms (client timeout 2052 ms). Trace:
W20260709 12:25:08.255752 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.369107 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.255388 32082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49886 (request call id 619) took 2339 ms (client timeout 1614 ms). Trace:
I20260709 12:25:08.173028 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.258459 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.046509  2759 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:08.046284  2815 raft_consensus.cc:2804] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:08.229187 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.321722  2733 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:08.242055 31469 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:08.250267 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.253863 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:08.118669  2854 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:08.160576  2833 consensus_queue.cc:237] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:08.183862  2688 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:08.255796  2847 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 12:25:08.322549 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.188584 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.228442 31465 raft_consensus.cc:2468] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:08.087278  2767 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:08.261356  2743 consensus_meta.cc:287] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.001s
W20260709 12:25:08.246660  2858 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:25:08.246071  2860 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:25:08.119057  2846 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:25:08.356010 31510 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:08.029057  2776 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:08.251878  2603 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:08.365547 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 277747us
W20260709 12:25:08.367673 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 217025us
I20260709 12:25:08.371531 31536 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:25:08.370945 31542 raft_consensus.cc:2468] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 13.
W20260709 12:25:08.367547 32075 rpcz_store.cc:269] 0709 12:25:06.623566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.623680 (+   114us) service_pool.cc:224] Handling call
0709 12:25:08.235982 (+1612302us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000dbbd4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:08.236167 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182289792}
I20260709 12:25:08.246124  2819 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:08.410889 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 54922.5us
W20260709 12:25:08.370713 32082 rpcz_store.cc:269] 0709 12:25:05.915487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.928113 (+ 12626us) service_pool.cc:224] Handling call
0709 12:25:08.242490 (+2314377us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54005fd054. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:08.255317 (+ 12827us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3369284352}
I20260709 12:25:08.180658  2817 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.181718  2859 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:08.392575  2733 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:25:08.379477 32049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.380541  2853 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:08.381515  2768 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.379508 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.251358  2862 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:08.371608  2533 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.374928  2854 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:08.387848 32080 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:08.373255  2842 raft_consensus.cc:3060] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.372581  2826 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.445897 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:08.381868  2852 raft_consensus.cc:3055] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:08.373085  2662 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:08.401243 31537 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:08.338882  2800 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.403110 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.378875  2759 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.412848 31542 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:08.412212 31510 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.448096  2852 raft_consensus.cc:740] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:08.452219 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.445956  2849 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:08.452632  2852 consensus_queue.cc:260] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.453599  2767 raft_consensus.cc:2804] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:08.453990  2852 raft_consensus.cc:3060] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.454159  2767 raft_consensus.cc:697] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:25:08.455300  2704 consensus_meta.cc:287] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: Time spent flushing consensus metadata: real 0.531s	user 0.000s	sys 0.010s
I20260709 12:25:08.455410  2816 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.455894  2816 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.456218  2816 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.456478  2849 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:08.458976 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.374143 31361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.010s	sys 0.012s
W20260709 12:25:08.471298 31361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.011s	sys 0.012s
W20260709 12:25:08.471709 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.474076  2823 consensus_meta.cc:287] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.000s
I20260709 12:25:08.391422  2815 raft_consensus.cc:697] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
W20260709 12:25:08.475184  2864 log.cc:927] Time spent T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:08.476459  2816 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:08.420751 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 387882us
I20260709 12:25:08.478531  2876 consensus_queue.cc:1059] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:08.353477  2813 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.428330 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:08.398057  2783 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:08.431557 32081 raft_consensus.cc:1275] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:08.434963 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.481313 31536 raft_consensus.cc:2393] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 503bef451a2b424fa35e8e46b8c06f29 in this term.
I20260709 12:25:08.453073 31510 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.482045 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:08.482789 31465 raft_consensus.cc:2393] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 11: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:25:08.483354 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.412132 32050 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:08.484117 32080 raft_consensus.cc:1240] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:08.418690  2743 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:08.385314  2757 raft_consensus.cc:697] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:08.490062  2757 consensus_queue.cc:237] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.492389  2817 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:08.492867  2772 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.493204  2733 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:08.493556  2772 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.468199 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:08.497084 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.464708  2763 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.468961  2800 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:08.469236  2764 consensus_meta.cc:287] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.882s	user 0.013s	sys 0.001s
W20260709 12:25:08.469650  2865 log.cc:927] Time spent T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:25:08.469239  2767 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:08.472812  2759 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:08.480036 32077 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:08.524829 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:08.436365 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:08.525511 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 89189.8us
W20260709 12:25:08.485132 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.527316 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.527851 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.435271  2533 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:08.479933  2761 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.487485  2813 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:08.488797  2696 raft_consensus.cc:2804] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:08.468487  2862 raft_consensus.cc:697] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:08.479115 31359 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:08.536614 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 57612.3us
I20260709 12:25:08.537648 31359 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.504094 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:08.430377  2859 raft_consensus.cc:697] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:08.541352 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:08.510214 31434 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:08.541958 31465 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.538704 31359 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.512449 31464 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
W20260709 12:25:08.518983 31507 leader_election.cc:336] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.957s (SENT)
I20260709 12:25:08.520408 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:08.543146 31507 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:08.418702  2776 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:08.534359 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 122277us
I20260709 12:25:08.478571  2816 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:08.533854 32076 raft_consensus.cc:1275] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:08.539453 31462 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:08.559257 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:08.559746 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 49650.6us
I20260709 12:25:08.530862  2533 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.552521  2759 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:08.552768  2859 consensus_queue.cc:237] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:08.556125 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.530020 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.526533  2815 consensus_queue.cc:237] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:08.564117  2823 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.564380  2862 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.537184  2761 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.548038  2813 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:08.590334 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.572779 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:08.590725 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 60752.5us
W20260709 12:25:08.646889 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.647459 31507 connection.cc:256] RPC call timeout handler was delayed by -1.0765455340001608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 12:25:08.592018 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:08.648263 31461 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:25:08.524648  2764 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:08.520120  2763 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.555409  2696 raft_consensus.cc:697] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:08.586035 31467 pending_rounds.cc:85] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 9
I20260709 12:25:08.665740 31467 pending_rounds.cc:107] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:25:08.666116 31467 raft_consensus.cc:2889] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:08.554517  2743 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:08.660516 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 87829.9us
W20260709 12:25:08.650447 32047 leader_election.cc:336] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:08.684973 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:08.689617 31543 raft_consensus.cc:1275] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:08.704285 31535 raft_consensus.cc:1275] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:08.714218  2794 consensus_queue.cc:1048] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 12:25:08.713801 32047 leader_election.cc:336] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:08.724565 32047 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:08.725745 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 52029.8us
W20260709 12:25:08.726579 32047 leader_election.cc:336] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:08.727941 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:08.650048  2868 log.cc:927] Time spent T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:25:08.558241  2603 consensus_queue.cc:1059] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:25:08.730957  2849 raft_consensus.cc:2804] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:08.792461 31469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1766) took 1058 ms. Trace:
I20260709 12:25:08.793206 31469 rpcz_store.cc:276] 0709 12:25:07.733167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.733274 (+   107us) service_pool.cc:224] Handling call
0709 12:25:08.791057 (+1057783us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400190854. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:08.791186 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121376640}
I20260709 12:25:08.661662  2783 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.664901  2813 raft_consensus.cc:697] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:08.566119  2871 consensus_queue.cc:1048] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.181s
I20260709 12:25:08.736399  2809 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:08.776944 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.665307  2759 consensus_queue.cc:1059] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:25:08.783639 31465 raft_consensus.cc:2468] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
I20260709 12:25:08.776172  2833 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:08.787902 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 60028.6us
W20260709 12:25:08.789541 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 315212us
W20260709 12:25:08.808790 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.744388  2819 consensus_queue.cc:1048] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:25:08.809032 31361 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:08.809379 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.796578  2866 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:25:08.797343  2870 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:08.797784  2873 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:08.741588  2683 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:25:08.772791 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.745019  2823 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:25:08.810111  2808 consensus_meta.cc:287] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.928s	user 0.010s	sys 0.003s
I20260709 12:25:08.785394 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.832926 31535 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 11.
I20260709 12:25:08.805693  2849 raft_consensus.cc:697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:08.807601 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:08.812080  2603 raft_consensus.cc:3055] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:08.850986 31541 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.830720 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:08.837412 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 152590us
I20260709 12:25:08.852288 32048 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:08.816916 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 278277us
W20260709 12:25:08.848227 31507 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:08.853140 31359 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:08.895403 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:08.803531  2824 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:25:08.821121  2833 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:08.805995  2783 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:08.916041 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 67869us
I20260709 12:25:08.919332 32083 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
W20260709 12:25:08.919833 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 110896us
W20260709 12:25:08.938974 31507 leader_election.cc:336] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:08.940800 31507 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:08.923748 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 71523.8us
I20260709 12:25:08.833201  2873 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:25:08.937968 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 165857us
I20260709 12:25:08.932545 32084 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 4.
I20260709 12:25:08.837845  2733 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.856175  2759 raft_consensus.cc:3055] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:08.943971  2873 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:08.944711  2759 raft_consensus.cc:740] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:08.856858  2603 raft_consensus.cc:740] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:08.918253  2867 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.916405  2743 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.931955  2767 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.937333  2785 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.933353  2683 raft_consensus.cc:3055] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:08.968343 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:08.996387 31541 raft_consensus.cc:2468] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
W20260709 12:25:08.984138 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.965380 31507 leader_election.cc:336] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:08.998317 31507 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:08.919245  2808 consensus_queue.cc:1048] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:25:09.004349  2885 log.cc:927] Time spent T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 12:25:09.005059  2884 log.cc:927] Time spent T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:25:09.006085  2886 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:25:09.007557  2883 log.cc:927] Time spent T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:25:09.008901  2783 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:09.009290  2891 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:08.951987  2895 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.812299  2696 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:09.000588  2764 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:09.004462  2888 log.cc:927] Time spent T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 12:25:09.011806  2878 log.cc:927] Time spent T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:25:08.991757  2743 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.014389  2743 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:09.014647  2777 consensus_queue.cc:1048] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.203s
I20260709 12:25:09.017050  2824 consensus_queue.cc:1059] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:09.017431  2877 log.cc:927] Time spent T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:25:09.017304  2849 consensus_queue.cc:237] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:08.965065  2890 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.108922 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 170119us
I20260709 12:25:08.955933  2776 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:08.972836  2733 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:08.995177  2851 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 1.031s	user 0.007s	sys 0.000s
I20260709 12:25:08.991125  2785 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.995918  2683 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:25:09.177515  2826 consensus_meta.cc:287] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.697s	user 0.006s	sys 0.003s
W20260709 12:25:09.175729 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 62545.2us
I20260709 12:25:09.214908 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:09.011838  2764 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:25:09.178516  2881 log.cc:927] Time spent T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.405s	user 0.000s	sys 0.001s
I20260709 12:25:08.933962  2813 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:09.232685 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 288958us
I20260709 12:25:09.186786  2785 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.997478  2767 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.277310  2767 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:09.231082  2743 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:09.221228  2833 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.285065  2854 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.286293  2854 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.250248 31465 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:25:09.250504  2893 log.cc:927] Time spent T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 12:25:09.251444  2889 log.cc:927] Time spent T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 12:25:08.953379  2759 consensus_queue.cc:260] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.222501  2603 consensus_queue.cc:260] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.260190 31540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54126 (request call id 1926) took 2638 ms. Trace:
I20260709 12:25:09.308466 31540 rpcz_store.cc:276] 0709 12:25:06.621328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.015800 (+394472us) service_pool.cc:224] Handling call
0709 12:25:07.027979 (+ 12179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.052287 (+ 24308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.052337 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.582632 (+530295us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b2c0001f138. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8fbb5a11 00007f6e8fbc5372 00007f6e912f7a01 00007f6e912bc43a 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2
0709 12:25:07.583166 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.734438 (+151272us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:07.734475 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.734540 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.780059 (+1045519us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:25:09.259912 (+479853us) raft_consensus.cc:1685] finished
0709 12:25:09.259941 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.260111 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4458,"raft.queue_time_us":174936,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":2062,"spinlock_wait_cycles":86593152,"thread_start_us":111701,"threads_started":1,"wal-append.queue_time_us":281950}
I20260709 12:25:09.260900  2899 consensus_queue.cc:1059] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:09.121338  2890 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.241585  2764 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:09.290005 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.214860  2783 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.303797 32082 raft_consensus.cc:1275] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:09.220885  2733 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:09.245147  2895 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:09.270637  2683 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.335124  2683 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:09.337023  2533 consensus_meta.cc:287] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.000s
I20260709 12:25:09.337492  2533 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.340512  2903 raft_consensus.cc:2804] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:09.341081  2903 raft_consensus.cc:697] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:09.341326  2764 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.342022  2903 consensus_queue.cc:237] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.343320  2873 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.343868  2873 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.344547  2890 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.345271  2772 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.345852  2873 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.348605  2533 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.350059  2823 raft_consensus.cc:3055] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:25:09.349759  2862 consensus_queue.cc:1175] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "842fbe33f4144fa69f1fd428652b6998" responder_term: 10 status { last_received { term: 8 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.4-9.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:09.350515  2823 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:09.305442  2870 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:09.352141  2871 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:25:09.335171  2759 raft_consensus.cc:3060] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.353729  2895 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.353961  2870 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.355957  2895 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:09.356931  2733 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.358021  2853 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.360554  2662 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.361577  2662 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.364766  2761 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.369212  2823 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.370543  2823 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:09.372066  2842 consensus_meta.cc:287] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.923s	user 0.007s	sys 0.004s
I20260709 12:25:09.373749 31542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1936) took 1189 ms. Trace:
I20260709 12:25:09.374173 31542 rpcz_store.cc:276] 0709 12:25:08.186957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.409366 (+222409us) service_pool.cc:224] Handling call
0709 12:25:08.409780 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.467377 (+ 57597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.373473 (+906096us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b54001450d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:25:09.373674 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6594432}
W20260709 12:25:09.376310 32078 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 576) took 1689 ms (client timeout 1623 ms). Trace:
W20260709 12:25:09.376721 32078 rpcz_store.cc:269] 0709 12:25:07.686693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.686843 (+   150us) service_pool.cc:224] Handling call
0709 12:25:09.376101 (+1689258us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b540052bf54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:09.376238 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245594880}
W20260709 12:25:09.377725 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.377480  2852 consensus_meta.cc:287] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.922s	user 0.014s	sys 0.000s
I20260709 12:25:09.386164 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.386998 31467 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:09.390996 32082 raft_consensus.cc:3060] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Advancing to term 11
I20260709 12:25:09.392452 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.393304 31468 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:25:09.394440 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.395680 31539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1929) took 1355 ms. Trace:
I20260709 12:25:09.396706 31539 rpcz_store.cc:276] 0709 12:25:08.040579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.040720 (+   141us) service_pool.cc:224] Handling call
0709 12:25:08.041031 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.041234 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:08.093015 (+ 51781us) log.cc:844] Serialized 14 byte log entry
0709 12:25:08.949738 (+856723us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b180024fe80. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e90e644bc 00007f6e8e1b248b 00007f6e9700c9a9 00007f6e8e1ce69b 00007f6e8e1cc93f 00007f6e8e1cec02 00007f6e90e5620b 00007f6e90e5bd23 00007f6e90e5c23a
0709 12:25:09.369237 (+419499us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b180024fe80. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e97097ab1 00007f6e970a4281 00007f6e8e1cf3f3 00007f6e8e1d17c1 00007f6e8e1d1779 00007f6e8e1d1709 00007f6e8e1d16d1 00007f6e8e1d09cd 0000000000388634 0000000000388479 00007f6e8e1b283a
0709 12:25:09.395216 (+ 25979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:09.395313 (+    97us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:09.395371 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.395445 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.395610 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236291,"prepare.queue_time_us":56389,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":230680,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":13988,"spinlock_wait_cycles":36750592,"thread_start_us":681454,"threads_started":2,"wal-append.queue_time_us":253969}
I20260709 12:25:09.405972 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.384450  2887 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.416432 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.418450 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:09.428682 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.445284 32084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 580) took 1614 ms (client timeout 2017 ms). Trace:
I20260709 12:25:09.448129 32077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:09.445839 32084 rpcz_store.cc:269] 0709 12:25:07.831194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.831326 (+   132us) service_pool.cc:224] Handling call
0709 12:25:09.445079 (+1613753us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54001ba154. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:09.445211 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428441856}
W20260709 12:25:09.449479 31359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.009s	sys 0.036s
W20260709 12:25:09.450271 31359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.009s	sys 0.036s
W20260709 12:25:09.453490 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.451726 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 598615us
I20260709 12:25:09.417388  2761 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:25:09.455153 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 235283us
I20260709 12:25:09.454850 31359 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:09.457463 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
W20260709 12:25:09.460052 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.460417 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.460923 31464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42112 (request call id 1774) took 1659 ms (client timeout 2130 ms). Trace:
W20260709 12:25:09.461445 31464 rpcz_store.cc:269] 0709 12:25:07.801038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.801161 (+   123us) service_pool.cc:224] Handling call
0709 12:25:09.460754 (+1659593us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400414954. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:09.460860 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541201792}
I20260709 12:25:09.473953 32082 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:09.441563  2887 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.479305 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:09.482229 31361 leader_election.cc:400] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 10. Current term is 11.
I20260709 12:25:09.483336 31359 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:09.491851 31361 leader_election.cc:403] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:09.493352 31361 leader_election.cc:400] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10.
I20260709 12:25:09.469750  2908 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:09.454763  2785 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.466825  2906 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:09.500176 31359 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:09.488374  2911 log.cc:927] Time spent T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:25:09.463297  2761 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.501045 31510 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:09.488106  2696 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.482023  2895 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.503069  2908 raft_consensus.cc:697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:09.508530  2906 raft_consensus.cc:697] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:09.497975  2873 consensus_queue.cc:1059] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:25:09.500995  2849 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:09.508000 31510 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:09.522341 31510 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:09.524271 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:09.512871 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 547523us
I20260709 12:25:09.503796  2833 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:09.494767  2890 consensus_queue.cc:1059] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:25:09.502344  2904 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:09.511281  2859 consensus_queue.cc:1059] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:25:09.512427  2733 raft_consensus.cc:3060] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.526551  2783 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:09.505149 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 137246us
I20260709 12:25:09.527601  2833 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.532799  2904 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.516305  2696 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.561332 31464 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:09.527748  2808 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.525965  2743 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:09.528609  2849 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:09.552601 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:09.553452 32075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49886 (request call id 629) took 1127 ms. Trace:
W20260709 12:25:09.565196 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 65070.9us
I20260709 12:25:09.565758 32075 rpcz_store.cc:276] 0709 12:25:08.426384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.427490 (+  1106us) service_pool.cc:224] Handling call
0709 12:25:08.427835 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.590180 (+162345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.590213 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:08.590254 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:08.590283 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.553224 (+962941us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001333d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bce01 00007f6e912bb83e 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6
0709 12:25:09.553268 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.553396 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372936960}
I20260709 12:25:09.567066 31361 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:25:09.554803 32083 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49870 (request call id 581) took 1722 ms (client timeout 1814 ms). Trace:
W20260709 12:25:09.571436 32083 rpcz_store.cc:269] 0709 12:25:07.832614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.832757 (+   143us) service_pool.cc:224] Handling call
0709 12:25:09.554648 (+1721891us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b540059f6d4. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:09.554748 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079958272}
I20260709 12:25:09.572533 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:09.515067  2912 raft_consensus.cc:2804] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:09.548030  2908 consensus_queue.cc:237] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.517684  2895 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.549768  2900 raft_consensus.cc:3055] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:09.581699 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:09.581841 31463 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:09.560165  2823 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.585080 31465 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:09.519554  2903 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.560312  2783 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:09.559963  2905 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:25:09.576803 31468 raft_consensus.cc:1275] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:09.578611 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.579948 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.565233  2743 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.597441 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:09.571974 31469 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:09.561235  2833 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.586184 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:09.584000 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 57421.8us
I20260709 12:25:09.565302  2896 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.578615  2873 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.575991  2761 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:09.595645 31462 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 12.
I20260709 12:25:09.594684 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:09.602653 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:09.599778 31507 leader_election.cc:336] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:09.606961 31507 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:09.586545  2912 raft_consensus.cc:697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:09.582060  2900 raft_consensus.cc:740] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:09.578213  2902 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:25:09.592507  2852 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:09.594393  2783 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.613545 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.600486  2743 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.641748 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:09.577345  2922 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:09.650849 31461 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:09.651350 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 52256.2us
I20260709 12:25:09.634148  2870 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.656899  2761 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:09.614017  2767 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:09.594321  2823 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.583421  2916 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:25:09.634855  2927 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.610291  2926 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:09.681990  2870 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:25:09.682650  2915 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:25:09.659107  2935 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.682945  2761 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:09.692516  2925 log.cc:927] Time spent T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:25:09.692304  2935 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.693773  2761 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:09.694523  2935 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.682296  2767 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:09.669497  2890 consensus_queue.cc:1243] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:09.694901 31461 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 12.
W20260709 12:25:09.695652  2914 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:25:09.695477  2767 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.688366  2808 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:25:09.697810  2924 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:25:09.698064  2767 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:09.652387  2852 raft_consensus.cc:697] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:09.652328  2859 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:09.582768  2906 consensus_queue.cc:237] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.659946  2873 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:09.671650  2887 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:09.716436 31433 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.870s (SENT)
I20260709 12:25:09.610363  2896 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.744012  2873 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:09.752997 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.761523 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:09.763576 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:09.710621  2823 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.713943  2935 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.777369 31542 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:09.782478  2935 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.750406  2912 consensus_queue.cc:237] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.784682  2935 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.781589 31434 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:09.734438  2904 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:09.791450 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 214133us
I20260709 12:25:09.750645  2890 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:09.794090 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.654033  2849 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.795151 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.701474  2785 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.800191 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:09.774003  2733 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 10. Current term is 11.
I20260709 12:25:09.800890 31535 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:25:09.737852  2859 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.805691 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:09.807420 32078 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: Advancing to term 9
I20260709 12:25:09.809055 31461 raft_consensus.cc:1275] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:09.689795  2927 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.706419  2900 consensus_queue.cc:260] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.699999  2926 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.734704  2913 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:25:09.800274  2890 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.812680  2908 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:09.811532  2934 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:09.810199  2852 consensus_queue.cc:237] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:09.840396  2683 consensus_meta.cc:287] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.004s
I20260709 12:25:09.834546  2696 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.841874  2870 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.859588 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:09.860426 32076 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:25:09.841267  2927 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.852921 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:09.858840  2743 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:09.839745  2941 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:09.890130  2743 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:09.887326 32078 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:09.892208  2903 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:09.899765  2854 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.613s	user 0.000s	sys 0.011s
I20260709 12:25:09.841271  2890 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.853304  2934 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.864980  2859 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.843495  2895 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.844964  2926 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:09.917865  2918 log.cc:927] Time spent T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.366s	user 0.003s	sys 0.000s
I20260709 12:25:09.852414  2908 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:09.921723  2908 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.857225  2873 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:09.930389  2934 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:09.967537 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.972146 31467 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:09.973301 31510 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:09.970918 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.857223  2763 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:09.984988  2696 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.986022  2696 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:09.972226 31433 leader_election.cc:336] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.022s (SENT)
I20260709 12:25:09.987656  2743 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.993706  2683 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.995899  2895 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:10.010022  2895 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.997255  2926 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:09.997813  2854 consensus_queue.cc:1048] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:10.003420 31464 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:10.005317 31433 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:10.010551  2895 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.912056  2783 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.025668  2783 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.031651  2683 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.037389  2819 raft_consensus.cc:3055] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.037987  2819 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:10.014914  2926 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.008467  2743 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.045644  2743 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:10.047017  2696 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.056876  2833 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.059911  2833 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.069983  2819 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:10.075637 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 60106.3us
I20260709 12:25:10.076092  2867 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:10.079727  2944 log.cc:927] Time spent T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.188s	user 0.001s	sys 0.002s
I20260709 12:25:10.081753 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:10.079797  2940 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:25:10.084887  2683 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:10.082983  2948 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 12:25:10.086316 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 114337us
I20260709 12:25:10.092501  2815 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.093708  2815 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.110473  2912 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:10.111577  2912 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:10.112944 31537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34624 (request call id 476) took 2632 ms (client timeout 2122 ms). Trace:
W20260709 12:25:10.113521 31537 rpcz_store.cc:269] 0709 12:25:07.480667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.508624 (+ 27957us) service_pool.cc:224] Handling call
0709 12:25:10.112466 (+2603842us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b540039fb54. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912c02fa 00007f6e96281b17 00007f6e8f7fc6d4 00007f6e8f7fc662 00007f6e8f7fc591 00007f6e8f7fc50c 00007f6e8f7fb7c2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:10.112650 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050386688}
I20260709 12:25:10.116974 31538 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:10.121335 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:10.123462  2912 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:10.124588 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:10.125257 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.123561  2875 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:10.132541  2926 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:10.148337  2815 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.143594  2696 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.151830  2696 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.154733  2696 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:10.160408 32048 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:10.164811 32050 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:10.166585  2772 raft_consensus.cc:2804] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:10.167279  2772 raft_consensus.cc:697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:10.167407 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:10.167644  2912 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:10.168442 31540 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:10.168591  2912 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.169219 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.169126  2772 consensus_queue.cc:237] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.170141 31535 raft_consensus.cc:2368] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 11. Current term is 12.
I20260709 12:25:10.171617  2945 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:10.172777  2874 raft_consensus.cc:2804] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:10.172708  2945 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.173532  2874 raft_consensus.cc:697] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:10.171893 31536 raft_consensus.cc:1240] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:10.177402 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.178210 31541 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:10.178984 31461 raft_consensus.cc:1275] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:10.179972 31539 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:10.174826  2874 consensus_queue.cc:237] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.167312  2783 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.190725  2912 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.194023 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:10.198015 31539 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.199093 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:10.200942  2783 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.208761  2867 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:10.194298 31433 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.208s (SENT)
I20260709 12:25:10.216435  2815 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:10.217433  2815 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.219985  2783 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.220311  2815 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:10.221589  2945 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.229869 31541 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:10.230024 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:10.233026  2764 raft_consensus.cc:3055] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.233634  2764 raft_consensus.cc:740] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:10.241736  2896 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:10.252390 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:10.253132 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 1.43651e+06us
I20260709 12:25:10.242905  2763 consensus_queue.cc:1048] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 12:25:10.259686 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 397088us
I20260709 12:25:10.259569  2764 consensus_queue.cc:260] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:10.262620  2764 raft_consensus.cc:3060] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.261569  2822 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.238322  2895 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.271669  2822 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:10.276913  2923 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.679s	user 0.005s	sys 0.000s
I20260709 12:25:10.282404 31535 raft_consensus.cc:1240] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:10.283680 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.301437 31544 raft_consensus.cc:1275] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:25:10.302987 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.308493  2759 raft_consensus.cc:3055] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:10.310357  2688 raft_consensus.cc:3055] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.316371  2688 raft_consensus.cc:740] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:10.317440  2912 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:10.309015  2759 raft_consensus.cc:740] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:10.328598  2759 consensus_queue.cc:260] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:10.315274 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 176212us
I20260709 12:25:10.359910 31540 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:25:10.361737 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:10.362324  2961 log.cc:927] Time spent T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 12:25:10.362483 31542 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 3.
I20260709 12:25:10.318238  2912 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.353628 31538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54134 (request call id 1924) took 2429 ms. Trace:
W20260709 12:25:10.392699 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.404369 31537 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:10.409034 31539 raft_consensus.cc:2410] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:10.331275  2688 consensus_queue.cc:260] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.405639 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:10.409119 31433 leader_election.cc:336] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.415s (SENT)
I20260709 12:25:10.371677 31538 rpcz_store.cc:276] 0709 12:25:07.919473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.920053 (+   580us) service_pool.cc:224] Handling call
0709 12:25:10.116011 (+2195958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.117534 (+  1523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.345832 (+228298us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b540039fb50. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e91225571 00007f6e912bb8ad 00007f6e96280419 00007f6e8f7f7bd4 00007f6e8f7f7b62 00007f6e8f7f7a91 00007f6e8f7f7a0c 00007f6e8f7f6cc2 00007f6e8f5f748c 00007f6e8f5f68c6 00007f6e8f5f626f
0709 12:25:10.349237 (+  3405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5036969728}
I20260709 12:25:10.411471 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:10.429219 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.424055  2759 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.405864  2822 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:10.405756  2895 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:10.434563  2900 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:10.430083 32081 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.430083 31544 raft_consensus.cc:2393] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 8: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:25:10.431455 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.438401 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:10.442039 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.444229  2825 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.444777  2825 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.445065  2835 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.445574  2835 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.446849  2825 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:10.453011 32048 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:10.453383  2867 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.454044  2867 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.456269  2867 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:10.456049  2591 consensus_queue.cc:1048] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:10.458985  2772 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:10.465607 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:10.468365  2688 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.469583  2912 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:10.472275  2835 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:10.484145 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.485452 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.486464 31540 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:10.485656 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:10.476151  2783 raft_consensus.cc:1064] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
W20260709 12:25:10.486531 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 119510us
I20260709 12:25:10.464956  2772 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.466661  2825 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:10.491766 31542 raft_consensus.cc:3060] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.496790  2794 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.493378  2772 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:10.495368  2783 raft_consensus.cc:1068] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Unable to promote non-voter 8d38acb9ce494ceb917c8441666104c4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:25:10.511698 31434 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:10.516575  2794 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:10.536764 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 54877.2us
W20260709 12:25:10.542295 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.568508  2603 raft_consensus.cc:3060] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:10.541320  2901 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:10.586810 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.599661 32048 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:10.619040 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.575294  2901 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:10.642926 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 67336.4us
I20260709 12:25:10.643633  2591 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:10.637435  2901 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.654217  2591 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:10.667002 31542 raft_consensus.cc:2468] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 12.
W20260709 12:25:10.668779 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.663630  2591 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:10.653146  2683 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 12:25:10.683075 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 109547us
I20260709 12:25:10.684269  2916 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.678396 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:10.675689  2945 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.697100 32075 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:10.711529 31542 raft_consensus.cc:1275] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:25:10.703588  2819 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.711982 31542 pending_rounds.cc:85] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Aborting all ops after (but not including) 8
I20260709 12:25:10.709587  2767 consensus_queue.cc:1048] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:25:10.707940  2896 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:10.722330  2896 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:10.725649 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.727023 31537 raft_consensus.cc:1240] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:10.709239  2794 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:10.727926 31536 raft_consensus.cc:1240] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:10.684899  2916 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.732664 32081 raft_consensus.cc:2468] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:25:10.697937  2945 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.725728 31466 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:10.728408 31542 pending_rounds.cc:107] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:25:10.747754 31542 raft_consensus.cc:2889] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:10.748096 31542 pending_rounds.cc:107] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:25:10.748306 31542 raft_consensus.cc:2889] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:10.765280 31510 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:10.767019  2761 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.767567  2696 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:10.767632  2761 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:10.768476  2963 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.296s	user 0.004s	sys 0.005s
I20260709 12:25:10.768119  2696 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.751778  2783 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:10.782339 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.789655 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:10.793342 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.777864  2825 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.778141  2696 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.797293 31537 raft_consensus.cc:2368] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 11. Current term is 12.
W20260709 12:25:10.805166 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:10.806643 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:10.806993 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 154765us
I20260709 12:25:10.813663 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:10.814554 31467 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:10.821028 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:10.822109  2794 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:10.822506  2794 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.822854  2794 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.826155 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:10.776849  2783 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.828006 31467 raft_consensus.cc:2468] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
W20260709 12:25:10.830193 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.794684  2761 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.841508 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:10.841979 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.843322 31466 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.843056  2783 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:10.846745 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:10.841281 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 143296us
I20260709 12:25:10.847783 31470 raft_consensus.cc:2410] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:10.847669 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:10.872907 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.873808 31539 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 8.
I20260709 12:25:10.877957 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:10.880105 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.880492 31540 raft_consensus.cc:2393] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:10.875711 31537 raft_consensus.cc:2376] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9. Re-sending same reply.
W20260709 12:25:10.884402  2968 log.cc:927] Time spent T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:25:10.885270 31470 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:10.843655  2759 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:10.808887  2825 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:10.887603  2759 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.893419  2896 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:10.894017  2759 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:10.894408  2969 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
W20260709 12:25:10.898705 32047 leader_election.cc:336] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:10.899173 32047 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:10.899660 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:10.896262 31467 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
W20260709 12:25:10.919023 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.927868 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b96090004c463795628c0134d8ecac" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:10.937527 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:10.941303 31461 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:10.907859  2875 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:10.953732 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:10.955001 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:10.957720 32047 leader_election.cc:336] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:10.958995  2966 log.cc:927] Time spent T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:25:10.971493 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.972311 31543 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:25:10.973147 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:10.973851 31469 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.974419 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:10.975915 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.979367  2662 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:10.979743 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:10.980041  2662 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:10.980713 31462 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:10.982350  2662 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:10.982650 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:10.983613 31510 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:10.983855 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 179768us
I20260709 12:25:10.984400 31539 raft_consensus.cc:1275] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:10.985635  2761 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:10.986954  2764 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:10.987447  2688 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:10.987752  2759 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:10.988256  2896 raft_consensus.cc:1064] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:25:10.987268  2761 raft_consensus.cc:2804] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:10.999883 31465 raft_consensus.cc:1275] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:25:11.000372  2896 raft_consensus.cc:1068] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: Unable to promote non-voter 8d38acb9ce494ceb917c8441666104c4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:25:11.002856 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:10.987154 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:10.968122  2945 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:10.990556 31433 leader_election.cc:336] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.626s (SENT)
I20260709 12:25:11.006592 31510 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.007418 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.007511 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.008143 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.008265 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.037026 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.037360 31539 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:25:10.991694  2591 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.010064 31541 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.009909 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.011854 31434 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:11.012563  2683 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.013132  2867 consensus_queue.cc:1059] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:11.014014  2603 consensus_queue.cc:1059] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:11.015517 31462 raft_consensus.cc:1275] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 12:25:11.017266 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.989535 31467 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
W20260709 12:25:10.992142  2900 consensus_meta.cc:287] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 12:25:10.962093  2875 consensus_queue.cc:1048] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:10.998011  2901 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.003844 31464 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.031073 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:11.032297  2761 raft_consensus.cc:697] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:11.032706  2825 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:11.037907 31469 raft_consensus.cc:2468] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
I20260709 12:25:11.036478 31536 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
W20260709 12:25:11.044586 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.121064  2761 consensus_queue.cc:237] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:11.058506 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 71490.6us
W20260709 12:25:11.076437 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 119262us
W20260709 12:25:11.123135 32047 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.123658 32047 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:11.124259 31510 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:11.125029 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:11.125687 31510 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.048666 31538 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:25:11.081866  2683 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.082585  2591 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:11.084578 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.087316  2759 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:11.127329  2967 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.147879  2759 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:11.148445  2759 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.129318  2815 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.089740  2945 raft_consensus.cc:2804] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:11.090763 31507 leader_election.cc:336] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.664s (SENT)
I20260709 12:25:11.015003  2772 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.099463  2942 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.101711  2901 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:11.108577 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 118075us
I20260709 12:25:11.112429  2696 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.144659 31466 raft_consensus.cc:2468] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
W20260709 12:25:11.137694 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.127210 31510 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.176291 31464 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:25:11.178853 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.193421 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.194178 31466 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:11.194531 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.197773 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.127837  2603 raft_consensus.cc:3055] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:11.153004  2912 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:11.218075  2852 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:11.218763  2852 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.220366 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.221020 31461 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:11.221462  2852 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:11.221853 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.218773 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:11.222594 31465 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:11.135499  2973 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:25:11.224532 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.240422 31464 raft_consensus.cc:2468] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
W20260709 12:25:11.213076 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 85911.3us
W20260709 12:25:11.241569 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.238961 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.188449  2900 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.246580 31470 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:11.129122  2783 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:25:11.260519 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:11.258070 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 246327us
I20260709 12:25:11.210698  2603 raft_consensus.cc:740] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:11.225656  2912 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.129906  2764 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:25:11.141121  2794 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:11.261413 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.256675 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:11.225409  2945 raft_consensus.cc:697] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:11.263334 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.264122 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:11.189777  2942 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:11.278846 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 204380us
I20260709 12:25:11.276723 31510 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:11.282894 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.263715  2767 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.293220 31434 leader_election.cc:400] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 11. Current term is 12.
I20260709 12:25:11.293660 31434 leader_election.cc:403] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.294548 32079 raft_consensus.cc:1240] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Rejecting Update request from peer b63f042a541248b88888cbd3049b38ca for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:11.270166  2912 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.269935  2810 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.306114  2974 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.306617  2974 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.310246 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:11.306989  2974 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:11.313894 31433 leader_election.cc:336] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.314549 31433 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:11.316931 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.318387 32081 raft_consensus.cc:1240] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:11.323658 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.345456 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:11.384271 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.387946 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:11.302194  2767 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.305321  2815 consensus_queue.cc:1048] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:25:11.396023 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 119391us
I20260709 12:25:11.356858  2852 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:25:11.401392 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 112387us
I20260709 12:25:11.405333 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:11.407966 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 146501us
I20260709 12:25:11.390374  2835 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:11.340844  2810 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.343820  2603 consensus_queue.cc:260] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.415004 31434 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.394893  2688 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:25:11.415940 31507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 1.733s (SENT) [suppressed 86 similar messages]
I20260709 12:25:11.405925  2764 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:11.406913  2772 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:11.445355  2984 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 for earlier term 11. Current term is 12.
I20260709 12:25:11.446657  2825 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:11.447093  2896 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:11.411985  2696 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:11.419611  2945 consensus_queue.cc:237] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.447202  2825 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.447917  2896 consensus_queue.cc:1048] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:25:11.458316  2825 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.460152 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:11.461211 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.461802 31542 raft_consensus.cc:2368] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
W20260709 12:25:11.439404 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 125573us
I20260709 12:25:11.454900 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.455771 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.456776 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.455189 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.494990  2993 raft_consensus.cc:493] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.495688  2993 raft_consensus.cc:515] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.497591 32079 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:11.497694  2810 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:11.498102  2993 leader_election.cc:290] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:11.457499  2982 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:25:11.499627  2989 log.cc:927] Time spent T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:25:11.449044 31507 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.102s (SENT)
I20260709 12:25:11.425717 31434 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:11.453887 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.453624 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.413844  2683 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:11.500409 32081 raft_consensus.cc:1240] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:11.507656 32079 raft_consensus.cc:1240] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:11.511838  2916 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:11.515193 31535 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:11.516950 31535 raft_consensus.cc:1275] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:11.518535 31535 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:11.519470  2794 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:11.521226  2767 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:11.524466  2825 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.526566  2825 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:11.527549  2974 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.528416  2759 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.529748  2974 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:11.414029  2852 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.450181  2662 raft_consensus.cc:3055] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:11.559856 31539 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:11.543555 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 142369us
W20260709 12:25:11.551858 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 126221us
I20260709 12:25:11.552723  2852 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:11.561203 31510 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.560025  2662 raft_consensus.cc:740] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:11.568168 31537 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:11.605372 31543 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:11.445430  2603 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.602679 31434 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:11.606849 31541 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:11.570142 31433 leader_election.cc:336] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.604192  2759 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:11.620083 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.624512 31467 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:11.626358 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.457672  2912 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.629364 31467 raft_consensus.cc:2368] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
I20260709 12:25:11.428745  2688 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.501119  2764 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:11.635795 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 70387.7us
W20260709 12:25:11.643627 31277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 134086us
I20260709 12:25:11.644253 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.653090 31510 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:11.650177 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 89395us
I20260709 12:25:11.607437  2852 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.656126 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 207118us
I20260709 12:25:11.661347 31434 leader_election.cc:304] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:11.661587 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:11.662434 31539 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.663223 31467 raft_consensus.cc:1240] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:11.634864  2759 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.664758 32079 raft_consensus.cc:1240] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:11.666807 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.667843 31536 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.653795  2819 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:11.674700  2683 raft_consensus.cc:2749] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.675175 31434 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.675858 31461 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:11.676786 31465 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:11.678345 31464 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:11.658918  2662 consensus_queue.cc:260] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.675925 31470 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:25:11.679944  2764 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:11.695739 31510 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.708041 31466 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:25:11.708194 31510 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.708666  2995 raft_consensus.cc:2804] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:11.709043 31510 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.695966  2986 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:11.697023  2991 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.697201 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 74617.2us
I20260709 12:25:11.698052  2767 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.680476 31463 raft_consensus.cc:1240] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.708417 31466 pending_rounds.cc:85] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 6
I20260709 12:25:11.696717 31469 raft_consensus.cc:1240] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:25:11.711911 31466 pending_rounds.cc:107] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:25:11.712162 31466 raft_consensus.cc:2889] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:11.708953  2761 raft_consensus.cc:2804] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:11.716347 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 146249us
I20260709 12:25:11.711532 31470 pending_rounds.cc:85] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 6
I20260709 12:25:11.717067 31470 pending_rounds.cc:107] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:25:11.717357 31470 raft_consensus.cc:2889] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:11.716156 31510 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:11.722066 31433 leader_election.cc:336] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.722654 31542 raft_consensus.cc:1240] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:11.722625 31433 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:11.720499  2815 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.728427  2815 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:11.718590  2662 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:11.734050 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.735013 31359 leader_election.cc:400] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 11. Current term is 12.
I20260709 12:25:11.728834  2815 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.739853 31359 leader_election.cc:403] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.709195  2995 raft_consensus.cc:697] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:11.681438  2942 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:11.712901  2767 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:11.746425 32047 leader_election.cc:336] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:11.742254 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.714179  2896 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:11.756423 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.757656 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.757437 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:11.758139  2688 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:11.762590 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:11.763411 31462 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:11.764633  2983 log.cc:927] Time spent T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.256s	user 0.004s	sys 0.000s
I20260709 12:25:11.767251  2767 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.766842  2995 consensus_queue.cc:237] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:11.772967 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 144752us
W20260709 12:25:11.778676 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 56647.8us
I20260709 12:25:11.709969  2759 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:11.743571  2683 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:11.784078 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.667555  2852 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.743264  2761 raft_consensus.cc:697] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:11.744819  2986 raft_consensus.cc:697] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:11.755359  2825 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:11.754978  2916 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.785992 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.785985 31467 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 7.
I20260709 12:25:11.788488 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:11.788555 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:11.815771 31470 raft_consensus.cc:2410] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:25:11.790882 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.760294  2896 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.714296  2991 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:11.798493 31507 leader_election.cc:336] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Timed out: RequestConsensusVote RPC to 127.29.131.193:43521 timed out after 2.643s (SENT)
I20260709 12:25:11.781591  2974 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:11.713663  2945 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:25:11.798923 31462 raft_consensus.cc:2468] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
I20260709 12:25:11.800185  3001 raft_consensus.cc:1064] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:25:11.801450  2912 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:11.802510 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:11.803895  3008 raft_consensus.cc:3060] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:25:11.804728 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 85328.7us
W20260709 12:25:11.819051 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.814342 31466 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
W20260709 12:25:11.824453 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 67942.2us
W20260709 12:25:11.824198 31433 leader_election.cc:336] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.826712 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:11.820680  2896 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:11.832598 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.814139  2916 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.835510 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:11.842236 31542 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.837045 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.842841 31544 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:25:11.837527 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9489bc7325d849ad9c1aec0189f21268" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.837198  3001 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.837845 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:11.838474  3013 raft_consensus.cc:1064] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:25:11.849334 31538 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.840093  3000 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.840593 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:11.840906  2991 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:11.837109 31507 leader_election.cc:336] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:11.862105  3013 raft_consensus.cc:1068] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Unable to promote non-voter 8d38acb9ce494ceb917c8441666104c4: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:25:11.862763 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44579.3us
W20260709 12:25:11.862866 31507 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.863380 31507 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:11.850046 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.855628 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.860110 31539 raft_consensus.cc:2468] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 5.
I20260709 12:25:11.864876  2688 consensus_queue.cc:1059] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:11.852325  2764 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.866418  2764 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.854184 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:11.867481 31462 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.868466  2764 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:11.868980  2764 consensus_queue.cc:1059] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:11.861276 31510 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:11.863504 31433 leader_election.cc:336] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.843480 31434 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:11.870738 31433 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.871107 31433 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:11.871466 31434 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:11.872229 31433 leader_election.cc:336] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.841593  3007 consensus_queue.cc:1059] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:25:11.872418 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:11.872622 31433 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:11.872923  3007 raft_consensus.cc:3055] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:11.873277  3007 raft_consensus.cc:740] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:11.873582  2901 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:11.874058 31462 raft_consensus.cc:2468] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:11.872433  3000 raft_consensus.cc:3055] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:11.873466  2835 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:11.873811  2825 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.862457  2761 consensus_queue.cc:237] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.871598  2662 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.874010  2901 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.886459 31542 raft_consensus.cc:2468] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:25:11.829900  2783 consensus_queue.cc:1059] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:25:11.848464  2916 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.850571  2984 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.825378  2974 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.887609  3000 raft_consensus.cc:740] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:11.959278  3013 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.855404  2942 consensus_queue.cc:1059] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:25:11.908259  2662 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.908813  2688 consensus_queue.cc:1243] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer 8d38acb9ce494ceb917c8441666104c4 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:11.902144  2825 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:25:11.964785 31292 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45406 (request call id 163) took 21633 ms (client timeout 15000 ms). Trace:
W20260709 12:25:11.966128 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 93910.4us
W20260709 12:25:11.979696 31433 leader_election.cc:336] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:11.983108 31538 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:25:11.984014 32048 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:11.976225 31359 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:11.920248  2901 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:11.989712 31433 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:11.963872  3012 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:12.000056 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 137222us
I20260709 12:25:11.984149  2819 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:11.985399  2662 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.985294  2825 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.007477  3008 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 11. Current term is 12.
I20260709 12:25:12.027981  2993 raft_consensus.cc:1064] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
W20260709 12:25:12.028554  2993 raft_consensus.cc:1068] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Unable to promote non-voter 8d38acb9ce494ceb917c8441666104c4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:25:11.898530  2986 consensus_queue.cc:237] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:11.874162  3007 consensus_queue.cc:260] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:11.999969  2688 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.007473  2763 raft_consensus.cc:2804] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:12.001775  3012 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.965420  2984 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:12.076509 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 46519.1us
W20260709 12:25:12.090294 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 110641us
I20260709 12:25:12.066530  2688 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:25:12.105508 31433 leader_election.cc:336] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.117223 31433 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:12.092324  3020 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.029779  2819 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.072119  3012 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.087668  2759 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.087256  2763 raft_consensus.cc:697] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:12.069169  3008 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:25:12.148439  3008 consensus_queue.cc:1059] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.150287  2767 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.138295  3020 raft_consensus.cc:3055] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:12.151639  3020 raft_consensus.cc:740] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:12.151750  2974 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:12.152699  3015 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:25:12.152626  3020 consensus_queue.cc:260] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.154027  3020 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.156564  2984 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.157272  2984 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.158241  2984 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.029951  3000 consensus_queue.cc:260] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.164177  2763 consensus_queue.cc:237] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.165426  3000 raft_consensus.cc:3060] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:12.087713  2987 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.229s
I20260709 12:25:12.172983  2819 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:12.173574  2815 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.174858  2683 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.175424  2683 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.180786  2993 raft_consensus.cc:3055] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:12.181239  2993 raft_consensus.cc:740] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:12.182221  2993 consensus_queue.cc:260] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:12.139200 31433 leader_election.cc:336] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:12.140336  3014 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:12.131119  3019 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.141464  3016 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:12.126001  2688 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:12.209429 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.131583  3007 raft_consensus.cc:3060] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:12.240414 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.243628 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:12.243137 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.245141 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.248447 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:12.252280 31462 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:12.254662 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:12.255439 31462 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.249205 31463 raft_consensus.cc:2468] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 7.
I20260709 12:25:12.261175 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:12.261936 31463 raft_consensus.cc:2468] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
W20260709 12:25:12.262869 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 186623us
I20260709 12:25:12.269230 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:12.137316  2759 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:25:12.269907 31463 raft_consensus.cc:2468] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:12.273278 31359 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:12.273252 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 134080us
W20260709 12:25:12.275996 31433 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.277005 31433 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:12.281961 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.263451  2819 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:25:12.282421 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 407601us
I20260709 12:25:12.284962 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:12.290288 31470 raft_consensus.cc:1275] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:12.230741  3019 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.305962 31462 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 13.
W20260709 12:25:12.304306 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.303676 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 442430us
I20260709 12:25:12.305392 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:12.309535 31510 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:12.313175 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.300709  2603 consensus_meta.cc:287] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.002s
W20260709 12:25:11.977875 31292 rpcz_store.cc:269] 0709 12:24:50.281308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.323020 (+ 41712us) service_pool.cc:224] Handling call
0709 12:25:11.771147 (+21448127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:06.731028 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:06.888788 (+157760us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:06.888841 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:25:06.888867 (+    26us) tablet.cc:662] Decoding operations
0709 12:25:06.890185 (+  1318us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:06.890273 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:06.890316 (+    43us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:25:07.022678 (+132362us) tablet.cc:701] Row locks acquired
0709 12:25:07.025739 (+  3061us) write_op.cc:260] PREPARE: finished
0709 12:25:07.051661 (+ 25922us) write_op.cc:270] Start()
0709 12:25:07.059273 (+  7612us) write_op.cc:276] Timestamp: P: 1783599907051574 usec, L: 0
0709 12:25:07.063758 (+  4485us) op_driver.cc:348] REPLICATION: starting
0709 12:25:07.205847 (+142089us) log.cc:844] Serialized 4006 byte log entry
0709 12:25:07.849165 (+643318us) op_driver.cc:464] REPLICATION: finished
0709 12:25:08.035610 (+186445us) write_op.cc:301] APPLY: starting
0709 12:25:08.035689 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:08.036571 (+   882us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:08.036699 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:08.084308 (+ 47609us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:08.084558 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:25:08.084604 (+    46us) write_op.cc:312] APPLY: finished
0709 12:25:08.084877 (+   273us) log.cc:844] Serialized 77 byte log entry
0709 12:25:08.085061 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:08.085199 (+   138us) write_op.cc:454] Released schema lock
0709 12:25:08.085246 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:08.085643 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:08.085676 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":704088,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":163810,"apply.run_cpu_time_us":4075,"apply.run_wall_time_us":50008,"num_ops":10,"prepare.queue_time_us":398229,"prepare.run_cpu_time_us":47454,"prepare.run_wall_time_us":657982,"raft.queue_time_us":264664,"raft.run_cpu_time_us":7007,"raft.run_wall_time_us":123855,"replication_time_us":760292,"thread_start_us":419365,"threads_started":4,"wal-append.queue_time_us":170565,"wal-append.run_cpu_time_us":37381,"wal-append.run_wall_time_us":1793355}]]}
I20260709 12:25:12.314533 31510 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:12.316270 31433 leader_election.cc:336] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.318189 31433 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:12.301155  3027 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.322515 31510 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.324980  3027 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.365499  3027 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:12.318117  3023 log.cc:927] Time spent T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:25:12.299988  2819 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.367656  2995 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:12.367786  2819 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:12.328898  2901 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.368067  2995 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.368496  2995 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.370011  2901 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:12.329653 31507 leader_election.cc:336] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.370653 31507 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:12.372321 31507 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.372702 31507 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:12.374289 31507 leader_election.cc:336] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.334295  2662 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.377033  2662 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.377601 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:12.377802 31466 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:12.378893 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:12.379014 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 56577.2us
I20260709 12:25:12.380038 31510 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.380137 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:12.380380  2761 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.336042  3019 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.312882  2815 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:12.316241  2895 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.338799  3033 raft_consensus.cc:2804] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:12.377640  3013 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.343627  2759 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.346717  2825 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.378911  2995 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.383985  2825 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:12.340500 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.340595  3030 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.330988  3012 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.384840 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:12.350684  2852 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:12.353602  3011 log.cc:927] Time spent T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.514s	user 0.003s	sys 0.008s
I20260709 12:25:12.353240  2683 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.359738  3007 raft_consensus.cc:2804] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.399957  3007 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.400313  3007 raft_consensus.cc:3060] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.400887  2683 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.401624  2759 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.360821  2688 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.403478  2985 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:12.404328 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.394491  2974 raft_consensus.cc:2804] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:12.405230  2974 raft_consensus.cc:697] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:12.406158  2974 consensus_queue.cc:237] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.381304 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:12.349308  2767 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:12.399466  3033 raft_consensus.cc:697] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:12.410552  3033 consensus_queue.cc:237] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.413414  2993 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:12.421819  2896 consensus_meta.cc:287] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 12:25:12.422232  2896 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:12.395627 31507 leader_election.cc:336] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.427912  2991 raft_consensus.cc:3055] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:12.428337  2991 raft_consensus.cc:740] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:12.428584  3007 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.429208  2991 consensus_queue.cc:260] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.430251  2991 raft_consensus.cc:3060] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.430648  3007 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.437125 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:12.437885 32075 raft_consensus.cc:2368] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
W20260709 12:25:12.452602 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.438865 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:12.476673 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:12.439951 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.472371 32078 raft_consensus.cc:1240] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:12.440975 32079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:12.485407 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 169174us
W20260709 12:25:12.486217 32047 leader_election.cc:336] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.487460 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:12.488999 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 215807us
I20260709 12:25:12.474270 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:12.495543 32076 raft_consensus.cc:2393] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 8: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:12.495710 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:12.497802 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 112626us
I20260709 12:25:12.501132 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:12.501808 31462 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 10: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:12.384203  2916 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.497828 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:12.474416  2688 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.504631 31361 leader_election.cc:400] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
I20260709 12:25:12.507766 31361 leader_election.cc:403] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:12.506073 31469 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.483799  2896 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:12.488765  2942 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.508474 31359 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:12.511523 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:12.515579 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:12.516347 31465 raft_consensus.cc:2393] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 12: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:12.517243 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:12.446380 31293 catalog_manager.cc:5697] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 9. New cstate: current_term: 9 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:12.519979 31507 leader_election.cc:336] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:12.521059 31507 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.521466 31507 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:12.521268 31293 catalog_manager.cc:5697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 2 to 6, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 6 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:12.522562 31507 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.523146  3024 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:12.523515 31507 leader_election.cc:336] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.498798  2995 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:12.524442 31507 leader_election.cc:336] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:12.527725  3012 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:12.528494  2942 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.530618  2942 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.497660  2987 consensus_queue.cc:1048] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:25:12.537041  2916 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:12.537879 31543 raft_consensus.cc:2393] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 10: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:25:12.538770 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.540014 31461 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:12.542516 32084 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:12.543622 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:12.544517 31543 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:25:12.546501 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:12.547523 31543 raft_consensus.cc:2393] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 12: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:25:12.552960 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 47215.8us
W20260709 12:25:12.553584 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.554049 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.554973 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:12.555786 31465 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.550706 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:12.558897 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:12.559546 31463 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:12.562734 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.564471 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.565025 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:12.564963 31467 raft_consensus.cc:1275] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:12.563882 31434 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.568046 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:12.568547 31466 raft_consensus.cc:1275] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:12.568610 31539 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.567191 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:12.575069  3033 consensus_queue.cc:1048] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:12.578764  2993 consensus_queue.cc:1048] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:12.579684 31434 leader_election.cc:304] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:12.581323 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.580960 31434 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.583508  3040 consensus_queue.cc:1059] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 12:25:12.583746 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 72336.7us
I20260709 12:25:12.584275  3030 raft_consensus.cc:2749] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.583853  2985 raft_consensus.cc:493] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:12.561941  2900 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.585603  3034 consensus_queue.cc:1059] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:12.586143  2900 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.586495  3031 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.586773  3032 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:12.587253  3008 consensus_queue.cc:1059] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:12.587826  3031 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.588155  3032 raft_consensus.cc:3055] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:12.588079  3008 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.588414  2900 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:12.588660  3032 raft_consensus.cc:740] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:12.589115  2852 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.589540  3034 raft_consensus.cc:3055] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:12.589949  3034 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:12.585289  2985 raft_consensus.cc:515] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.590462 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:12.607841 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:12.608678 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:12.608907  2985 leader_election.cc:290] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:12.609563  2985 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:12.562251  3007 raft_consensus.cc:3060] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.594219 31466 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:12.580696 31293 catalog_manager.cc:5697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 4 to 6, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 6 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.589956  2852 consensus_queue.cc:1059] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:12.600661  3040 raft_consensus.cc:3055] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:12.623947  3040 raft_consensus.cc:740] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:12.604960 31468 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:12.606716  2942 raft_consensus.cc:493] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:12.591032 31543 raft_consensus.cc:2393] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 10: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:25:12.619539 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 111181us
I20260709 12:25:12.593408 31434 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.610250 31361 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:12.610126 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:12.589655  3032 consensus_queue.cc:260] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.565966  2688 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:12.561204  2783 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:25:12.610049  2985 raft_consensus.cc:697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:12.620532  2991 raft_consensus.cc:2804] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:12.643602  2991 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:12.644105  2991 raft_consensus.cc:3060] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.643985  2985 consensus_queue.cc:237] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.645697  3030 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:12.647151 31359 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:12.647562  2852 raft_consensus.cc:3055] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:12.648016  2852 raft_consensus.cc:740] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:12.634744 31293 catalog_manager.cc:5697] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 5 to 9, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 9 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.638125 31469 raft_consensus.cc:2468] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:12.624423  3031 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:25:12.624274  3028 raft_consensus.cc:2804] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:12.622853  3000 raft_consensus.cc:2804] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:12.641682  3032 raft_consensus.cc:3060] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.641593  3034 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:12.663724 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53534.1us
I20260709 12:25:12.703074 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:12.703341 31467 raft_consensus.cc:1275] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:12.704149 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 52241.3us
I20260709 12:25:12.700609 31465 raft_consensus.cc:2468] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:25:12.715054 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.707868 31539 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
I20260709 12:25:12.712821  2688 raft_consensus.cc:697] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:12.716477  2835 raft_consensus.cc:2764] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:12.716724  3040 consensus_queue.cc:260] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.723712  2688 consensus_queue.cc:237] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.724876  3040 raft_consensus.cc:3060] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.702447  3028 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:12.726759  3028 raft_consensus.cc:3060] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.716992  3039 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:12.706041  3000 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:12.732450  3000 raft_consensus.cc:3060] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.734352  3028 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.703500  3030 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
W20260709 12:25:12.741775 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:12.748468 31466 raft_consensus.cc:2468] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:12.750037  2901 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.750393  3039 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:12.750481  2901 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.750716 31359 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:12.751024  2901 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.668228  2759 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.740899 31293 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 7 to 10, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:12.747493 31434 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:12.764650 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.775513 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5050cffdfb1414e9bf38e82277f43bd" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:12.660475  2942 raft_consensus.cc:515] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.781400 31434 leader_election.cc:304] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:12.788051 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.792900 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.796273 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.795414 32083 raft_consensus.cc:1275] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:12.799021 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:12.802775 31539 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 9.
I20260709 12:25:12.762288  3033 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:12.778904  3034 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.747210  3019 consensus_queue.cc:1059] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:25:12.751441  3039 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.808913  3019 raft_consensus.cc:3055] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:12.809270  3019 raft_consensus.cc:740] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:25:12.811259 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.805521 31510 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.785676  2825 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:12.814745 31510 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.786031  3020 raft_consensus.cc:2749] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:12.820477 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:12.818121 31434 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:12.821797  2916 raft_consensus.cc:2804] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:12.825716  2942 leader_election.cc:290] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:12.829082 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:12.829696 31469 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 7.
I20260709 12:25:12.832832 31293 catalog_manager.cc:5697] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 1 to 6, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 6 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:12.845863 31463 raft_consensus.cc:2468] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:12.810885  3031 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.799585  2993 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:12.856611 31293 catalog_manager.cc:5697] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 3 to 5, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 5 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.843331  2916 raft_consensus.cc:697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:12.852813  3001 raft_consensus.cc:1064] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:25:12.810451  3033 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.815625  3013 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:25:12.851090  3012 raft_consensus.cc:2804] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:12.861924 32050 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: b63f042a541248b88888cbd3049b38ca
W20260709 12:25:12.868947 30223 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 31420)
I20260709 12:25:12.736183  3030 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.800251  2852 consensus_queue.cc:260] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:12.870918 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.878216  2688 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.878705 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.877996 32050 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:12.883455 32050 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:12.884191  2987 raft_consensus.cc:2804] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:12.880589  2688 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.895629 31293 catalog_manager.cc:5697] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 reported cstate change: term changed from 5 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 8 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.896777  2991 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.859562  3024 consensus_queue.cc:1048] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:12.849927  3019 consensus_queue.cc:260] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:12.867857  2763 consensus_queue.cc:1048] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:25:12.855468  3031 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:12.880592  3018 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.904982  2990 consensus_queue.cc:1059] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 12:25:12.905476  3051 log.cc:927] Time spent T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:25:12.884048  3012 raft_consensus.cc:697] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:12.895058  2688 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:12.984419 31509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.908775 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.002528 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.107910  2942 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.063315  3019 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:13.091413 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 208003us
I20260709 12:25:12.907902  3033 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:12.906395  3045 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:25:12.908600  3046 log.cc:927] Time spent T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:25:12.906026  3048 log.cc:927] Time spent T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:25:13.098531  2852 raft_consensus.cc:3060] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:13.126003 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 379298us
I20260709 12:25:13.127005 31359 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:13.103911  2825 raft_consensus.cc:697] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:12.905943  3044 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.905762  2975 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.943593  3028 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:13.030676  3007 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963) with higher term. Message: Invalid argument: T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
I20260709 12:25:12.968776  3001 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:13.140574  3044 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.115643  2991 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:13.112852  2942 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.116014  3000 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:13.147836 31359 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:13.148962  3063 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.927798  2916 consensus_queue.cc:237] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.153394  3044 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:13.151193 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 333126us
W20260709 12:25:13.178169 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.156383  2942 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.187705 31359 leader_election.cc:400] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233) with higher term. Message: Invalid argument: T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
I20260709 12:25:13.188784 31359 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:13.189915 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:13.175432  3007 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.150808  3012 consensus_queue.cc:237] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:13.204299 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.168288  2987 raft_consensus.cc:697] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:13.280395  3000 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:13.263751 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.294838 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.301852 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.302881 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.341318  3062 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 12:25:13.379515  3045 log.cc:927] Time spent T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 12:25:13.389495  3016 log.cc:927] Time spent T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:25:13.304023  2825 consensus_queue.cc:237] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:13.420495 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 231834us
I20260709 12:25:13.425480 31359 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:13.423530 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 308934us
I20260709 12:25:13.431929 31359 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:13.434083 31361 leader_election.cc:400] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 7 election: Vote denied by peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531) with higher term. Message: Invalid argument: T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8.
W20260709 12:25:13.434348 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.434842  3019 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.422875  3039 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:13.438832  3019 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:13.437801  2942 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:13.428543  3060 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:25:13.439690 31359 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:13.424185  3031 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:13.442662 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.431097  2901 consensus_meta.cc:287] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.005s
W20260709 12:25:13.446491 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.446973 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.388819  2987 consensus_queue.cc:237] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:13.425555  2991 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:25:13.425243  3000 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:25:13.450445 31359 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:13.450691  3019 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:13.444003  3030 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.464354 31359 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:13.457685  3028 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:13.449115  2901 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.472481 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:13.490149  3034 consensus_meta.cc:287] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
W20260709 12:25:13.492693 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.470927  3019 raft_consensus.cc:2804] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:13.461184  3030 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:13.490841  3028 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.505328  2991 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.506178  2991 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.508917  2991 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:13.496495  3019 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.510288  3019 raft_consensus.cc:3060] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:13.515983  3032 consensus_meta.cc:287] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.000s
I20260709 12:25:13.473989  3063 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:13.522032  3039 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.531582  3030 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:13.531628  3039 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:13.533488  3019 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.534176  3039 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:13.500072  3034 consensus_queue.cc:1059] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:25:13.581105  2942 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:13.584668  3039 raft_consensus.cc:3055] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:25:13.607663 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.613091 32084 raft_consensus.cc:1240] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:13.604905  3039 raft_consensus.cc:740] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:25:13.615314 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.607146  3019 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:13.619279 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:13.619731 31535 raft_consensus.cc:1240] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.619338  3044 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:13.620249  2783 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:13.637655  2783 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:13.639842  2783 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:13.640129  2852 consensus_meta.cc:287] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:25:13.640784 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:13.641517  3039 consensus_queue.cc:260] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.642117 31544 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.642731  3039 raft_consensus.cc:3060] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.643256 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:13.643707 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:13.644433 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:13.644779 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:13.645316 31540 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:13.646417 31537 raft_consensus.cc:1240] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:13.646957 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:13.647744 31535 raft_consensus.cc:2410] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:13.620471 31539 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:13.650378 31341 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:13.650815 31341 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:13.630467 31536 raft_consensus.cc:1240] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.637017  3044 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:13.654783 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:13.655215 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:13.651096 31341 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:13.663702 31537 raft_consensus.cc:1275] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:13.664762 31535 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:13.671789 31543 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:13.683313  2852 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.684039  2852 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:13.685923  2794 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:13.693346  2852 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:13.687918  2794 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:13.779404 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 65265.4us
W20260709 12:25:13.795181 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.798559 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.800940 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:13.801575 31465 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.814260 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:13.814857 31463 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.798599  2763 raft_consensus.cc:3055] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:13.797649  3020 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:13.819496 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:13.820659 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:13.821138 31463 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:13.803591  2819 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.803762  3000 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.822068 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:13.824339 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.831993 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:13.835273 31467 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:13.836774 31465 raft_consensus.cc:2468] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:13.833067  2819 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.838759  3000 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.839811  2794 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:13.840845  3000 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:13.828894  3020 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.812572  2985 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.848294 31464 raft_consensus.cc:1240] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:13.815200  3044 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:13.846617 31465 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:13.849853 31461 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:13.817981  2763 raft_consensus.cc:740] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:25:13.855418 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 45500us
W20260709 12:25:13.856714 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.833065  2901 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:13.847648  3000 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.862421 31464 raft_consensus.cc:1240] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:13.863106 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:13.860690 32050 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 
I20260709 12:25:13.865325 31465 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:25:13.869786 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.858223 31507 leader_election.cc:336] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:13.855736  3044 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:13.874707 30223 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 31420)
I20260709 12:25:13.851441  2985 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:13.885541 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:13.886487 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:13.900274 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:13.890789 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 194748us
I20260709 12:25:13.905313 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:13.881754  2988 raft_consensus.cc:2804] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:13.909759 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:13.912237 32084 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:13.911357  3020 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:13.878614  3000 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:13.919569 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.922585 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 64379.8us
W20260709 12:25:13.923740 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.923689 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.926244 31507 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:13.880585  3061 consensus_queue.cc:1048] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:25:13.964172 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:13.977810 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.930687  2993 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.923638  2988 raft_consensus.cc:697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
W20260709 12:25:13.996223 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.021965  2825 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:14.022593  2825 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.022740 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:14.024736  3087 log.cc:927] Time spent T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:25:14.250792 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:14.252203 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.062008 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.254869 32075 raft_consensus.cc:2393] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 12: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
W20260709 12:25:14.058691 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 162963us
I20260709 12:25:14.166361  2852 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:25:14.250882 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.264889 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:14.269392 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.271553 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:14.241024  3088 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
W20260709 12:25:14.292052 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 365811us
I20260709 12:25:14.263420  2852 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.058156  3039 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.294994 31507 leader_election.cc:336] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.005960  2900 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:14.024868  2825 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:14.272130  3000 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:14.309248  3039 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.310761 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:14.316776 31359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.317107 31461 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:14.271745  3071 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:14.271570  2942 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:14.317526 31359 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.320106  3044 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:25:14.026631  2993 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.288146  2783 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:25:14.328687 31359 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.232251  2988 consensus_queue.cc:237] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.313925  2985 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.334064  2974 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:14.334657  2974 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:14.336089 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.314352  2900 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.319118  3000 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.340874  3000 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:14.342623  3085 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.487s	user 0.004s	sys 0.037s
I20260709 12:25:14.343060  3000 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:14.345989 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:14.347098 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:14.351444 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 56486.1us
W20260709 12:25:14.357409 31507 leader_election.cc:336] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.362675 31507 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.363193 31507 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:14.364068  3012 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:14.365933 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.366571 31507 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.367007  3097 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.367692  3097 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.367079 31507 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:14.369158  2852 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:14.369522  3012 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.369563  3097 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.370357 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:14.370714  2900 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.359504  3000 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.371661 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.371999 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaea245d9414f42b05616da46574eb4" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:14.372289  2993 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:14.323346  3071 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.374550  3071 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:14.323529  2942 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:14.375422 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:14.374457 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.375622 31464 raft_consensus.cc:2393] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 10: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:25:14.378423 31507 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.379033 31507 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:14.382746 31463 raft_consensus.cc:2393] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 12: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:14.384639 31466 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:14.384711 31463 raft_consensus.cc:1275] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:14.386595 31466 raft_consensus.cc:1275] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:14.389971  2819 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.390828 31464 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:14.389914  2942 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.394443  3039 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.399256 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:14.400605 32075 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 12: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:25:14.402849 31507 leader_election.cc:336] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.403426 31507 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:14.404573 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.407944  2993 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.410662  2900 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.411408  2900 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:14.412201 32047 leader_election.cc:336] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.413686  2900 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.395599  2974 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:14.416028 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.416493 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.410574  3012 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.353381  3098 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.418341 31469 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:14.421904 31436 leader_election.cc:304] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.402012  3039 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.425268 31507 leader_election.cc:336] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.428646  2900 raft_consensus.cc:2749] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.431289 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:14.430601  3039 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:14.442544 32047 leader_election.cc:336] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.459367 31507 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.460384 32047 leader_election.cc:336] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.460357  3098 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.465442 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.444028  2916 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:14.468851 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 140247us
W20260709 12:25:14.460474 31507 leader_election.cc:336] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.469597 31507 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:14.416446  2763 consensus_queue.cc:260] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.471825 31359 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:14.472222 31508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.474272 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.472250 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:14.476253 31542 raft_consensus.cc:1240] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:14.476365 31537 raft_consensus.cc:1240] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:14.477546 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.478840 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:14.479774 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:14.480329 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.480473 31540 raft_consensus.cc:2393] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:14.481001 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.481298 31361 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.482863 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.485803 31359 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.486243 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.484912  2794 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.486997  3024 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.487799 31539 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:14.479437  2974 raft_consensus.cc:493] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:14.487978 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.473464  3101 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:14.496078 31544 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:14.461953  3098 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.482856  3097 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:14.503576 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.506302 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:14.511461  3099 log.cc:927] Time spent T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:25:14.514757 31540 raft_consensus.cc:3060] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.522572 31543 raft_consensus.cc:2393] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 10: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:14.479382  3000 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:25:14.505474 31507 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.508574  2763 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.485175  2852 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:25:14.511399  3103 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:14.534612 31507 leader_election.cc:336] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.537557 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:14.537806 31507 leader_election.cc:336] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.538264 31507 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:14.542457 31540 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:14.525331  2974 raft_consensus.cc:515] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.545253  2974 leader_election.cc:290] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:14.525010  3097 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.551888  3097 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:14.552848 31507 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.553311 31507 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:14.553999  2993 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.554735  2993 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:14.556378 31507 leader_election.cc:336] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.556694  3098 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.557317  3098 consensus_queue.cc:1059] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:14.557943 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.558705 31507 leader_election.cc:336] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.559203 31507 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:14.568687 32081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:14.571156  2993 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:14.571964 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.575340 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:14.580767 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 94579.1us
I20260709 12:25:14.530532  3104 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.587491 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.588229 31464 raft_consensus.cc:1275] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:14.522949  3024 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.589098 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:14.589253 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 79325.2us
W20260709 12:25:14.595767 31507 leader_election.cc:336] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.597105 31507 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.586138 31510 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:14.643410 31507 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:14.643770 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 57741.2us
I20260709 12:25:14.587070  3103 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.645207  3103 raft_consensus.cc:3055] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:14.645744  3103 raft_consensus.cc:740] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:14.591815  3039 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.647652  3039 consensus_queue.cc:1059] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:14.648836  3039 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:14.612401  3020 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.629169  3105 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:14.629283 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.651757 31465 raft_consensus.cc:2393] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 in current term 9: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
W20260709 12:25:14.635584  3086 log.cc:927] Time spent T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.780s	user 0.009s	sys 0.017s
W20260709 12:25:14.657176 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 59690.7us
W20260709 12:25:14.657917 31507 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.658380 31507 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:14.658779  2974 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.658753  2852 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.668382  3012 consensus_queue.cc:1048] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:14.672128 31510 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:14.672684  3104 raft_consensus.cc:3055] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:14.673094  3104 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:14.673942  3104 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.675987  3111 raft_consensus.cc:3055] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:14.686817  3111 raft_consensus.cc:740] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:14.687714  2852 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.687842  3111 consensus_queue.cc:260] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.688253  2852 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.689278  3111 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.689596  3024 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:14.690385  2852 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.678642  3109 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index 2 to 7, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:14.694839 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:14.679488  3012 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.696213  3065 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:14.651307  3020 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.660202  2993 raft_consensus.cc:2804] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:14.699055  2993 raft_consensus.cc:697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:14.700178  2993 consensus_queue.cc:237] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.676962  3101 consensus_queue.cc:1048] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:25:14.675199  3104 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.676272  2916 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:14.710624 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:14.646881  3103 consensus_queue.cc:260] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.712637  3103 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.714639  2900 raft_consensus.cc:493] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.715180  2900 raft_consensus.cc:515] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.718406  2900 leader_election.cc:290] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:14.719604 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:14.680068 31507 leader_election.cc:336] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.722479 31507 leader_election.cc:336] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.722967 31507 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:14.733775 31507 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.734772 31507 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.735716 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.736295 31507 leader_election.cc:336] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:14.736836 31507 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:14.739411 31507 leader_election.cc:336] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.740392 31507 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.741473 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 139604us
W20260709 12:25:14.801158 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 60787.6us
W20260709 12:25:14.801908 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.802022 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 176126us
W20260709 12:25:14.802503 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.803045 31433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.738363 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:14.774890  3020 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:14.778635 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.741179  2916 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.742785  3012 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:14.778373  3113 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:25:14.794994 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 121621us
I20260709 12:25:14.809872 31467 raft_consensus.cc:1240] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Rejecting Update request from peer 8d38acb9ce494ceb917c8441666104c4 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:14.796185 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.803217 31507 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.811975 31507 leader_election.cc:336] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.813122 31507 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.814172 31507 leader_election.cc:336] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.815214 31507 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.804642 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 66321.4us
I20260709 12:25:14.815716 31507 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:14.806051 31359 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.822629 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.791152  3097 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.825023  3113 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.820304  3027 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.762245 31281 maintenance_manager.cc:643] P 893a35e10f7f42ceb588211d8d9ba07f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.586s	user 0.158s	sys 0.078s Metrics: {"bytes_written":30299,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":253593,"dirs.run_cpu_time_us":400,"dirs.run_wall_time_us":2530,"drs_written":1,"lbm_read_time_us":6379,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":124673,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":215841,"threads_started":1,"update_count":10}
W20260709 12:25:14.832631 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 245252us
I20260709 12:25:14.832976 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:14.836661 31461 raft_consensus.cc:1275] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:14.849483 31361 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:14.831420  2901 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:14.807646  3111 consensus_queue.cc:1059] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:25:14.866216 32083 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:14.876801 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.877434 31544 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:14.879635 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.880246 31541 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 7.
I20260709 12:25:14.881337 31543 raft_consensus.cc:1275] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:14.881981 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.882280 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.882769 31539 raft_consensus.cc:2410] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:14.886133 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.887786 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.888935 31543 raft_consensus.cc:2393] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 10: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:14.888595 31541 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 12.
I20260709 12:25:14.836745  2974 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:25:14.869736 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43fc3cfb135493da75cf9bdc7debaa9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.870247 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:14.897086 31535 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.870631 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.870930 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:14.898154 31540 raft_consensus.cc:3060] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.866240  2852 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.872610  3112 raft_consensus.cc:3055] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:14.875135 30223 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 31420)
I20260709 12:25:14.840804  3000 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.909343 31282 maintenance_manager.cc:419] P 893a35e10f7f42ceb588211d8d9ba07f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9480 bytes on disk
I20260709 12:25:14.891105 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.835291  3027 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.893043 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.893929 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.831453  3024 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.828712  3118 consensus_queue.cc:1059] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:25:14.911418 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.888723  3120 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.864816  3098 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:14.915035 31540 raft_consensus.cc:2468] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:25:14.916215 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.915721 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:14.922453 31539 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
W20260709 12:25:14.912526 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 75559.9us
I20260709 12:25:14.899008  3104 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.930617 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.931314 31281 maintenance_manager.cc:643] P 893a35e10f7f42ceb588211d8d9ba07f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.021s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":437,"lbm_reads_lt_1ms":4}
I20260709 12:25:14.932454 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:14.937335 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.909348  3112 raft_consensus.cc:740] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:14.884771  2901 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:14.918416  3111 consensus_queue.cc:1243] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:25:14.952632 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.911651  3124 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:25:14.971817 31434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.954715 31538 raft_consensus.cc:1240] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:14.953683  3039 raft_consensus.cc:3055] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:14.957916 31435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.923859  3120 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:14.972349 31436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.977265 31433 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.988461  2901 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:14.988538  3000 raft_consensus.cc:3055] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:14.989018  3000 raft_consensus.cc:740] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:14.989856  3000 consensus_queue.cc:260] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.991055  3000 raft_consensus.cc:3060] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.943280  3104 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:14.997033  3104 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.999176  3120 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:14.981405  3113 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:15.006215 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:15.008018 31433 consensus_peers.cc:597] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:15.012099 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b935bf4ae0467a9564dbd51820ce7c" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:15.012936 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.954480  3103 consensus_queue.cc:1059] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:14.953117  3109 consensus_queue.cc:1048] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:25:15.019907 32048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.982092  3039 raft_consensus.cc:740] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:15.038241 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:15.038820 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:15.040998 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:15.041338 31359 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:15.041558 31541 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.042266 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:15.042546 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.021646  3097 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:15.053678 31543 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:15.054929 31359 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:15.034858  3113 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.035452  3103 consensus_queue.cc:1243] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:15.060806 31543 raft_consensus.cc:1275] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:25:15.061849 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 196046us
I20260709 12:25:15.063493 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:15.059947 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:15.068159 31434 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:15.074229 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.080403 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.082938 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.084745 31434 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.060181  3128 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:15.081883  3111 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.079272  3104 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:15.081040  3098 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.081750  2835 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:15.068778  3113 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:15.083853  2900 consensus_queue.cc:1048] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:25:15.105091  3118 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:15.119944 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 84017.7us
I20260709 12:25:15.103219  3020 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:15.126463  3020 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:15.126942  3020 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.130767 31535 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:25:15.093062  3128 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.131461  3128 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.134387  3020 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:15.115135  3104 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:15.124619 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 192166us
I20260709 12:25:15.122897 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.135900 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:15.143972 31433 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.145805 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.148123 31462 raft_consensus.cc:1275] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:15.079959  3039 consensus_queue.cc:260] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.149679 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:15.150657  3039 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.150764 32076 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
I20260709 12:25:15.150219 32083 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 2 to 7, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:15.142840 31465 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 2 to 7, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:15.151597  3113 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:15.153651 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.121053  2835 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:15.145179 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:15.167186 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 74912.6us
I20260709 12:25:15.162042 31361 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.195536 31434 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.195020 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 49901.9us
I20260709 12:25:15.121089  3132 raft_consensus.cc:3060] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.199311 31461 raft_consensus.cc:1275] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:15.199987 31510 leader_election.cc:304] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:15.203847 31433 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.206804 31433 leader_election.cc:336] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.161150 31464 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
I20260709 12:25:15.138916  3104 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:15.114166  3111 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.207432 31433 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.208096  2900 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.213351 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:15.213485  3133 raft_consensus.cc:2749] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.155764  3027 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:15.197546  2835 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:15.212620 31434 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:15.201117  3098 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:15.222007 31433 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.222805 31433 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.223408  2974 consensus_queue.cc:1048] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:25:15.231690 31433 leader_election.cc:336] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.214725  3118 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.235368  3020 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Requested vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:15.227607  3109 consensus_queue.cc:1048] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:25:15.237941  3111 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:15.239099 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:15.239848 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:15.240564 32076 raft_consensus.cc:2393] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 12: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:15.227429  2900 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.196883  3113 consensus_queue.cc:1059] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:25:15.157629  3097 consensus_queue.cc:1175] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "842fbe33f4144fa69f1fd428652b6998" responder_term: 12 status { last_received { term: 8 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 11. Current term is 12. Ops: [11.7-11.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:15.242146 31433 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.219762  3024 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:15.262743 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 100469us
I20260709 12:25:15.242849  3027 raft_consensus.cc:2804] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:15.263612 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.291733 31361 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.259680  3024 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.266682  3111 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.317342 31541 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:15.266624  2900 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.320009 31359 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:15.321646  3113 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:15.294440  3138 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.296538  3027 raft_consensus.cc:697] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:15.324069  3111 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:15.313457  3024 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.324891  3098 raft_consensus.cc:3060] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.340009  3132 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.343005  3118 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:15.295130  3143 consensus_queue.cc:1059] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 12:25:15.362425 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 116734us
I20260709 12:25:15.375288 31434 leader_election.cc:304] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.379820 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 69394.8us
I20260709 12:25:15.381034 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.375026  3118 raft_consensus.cc:697] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:15.388275 31434 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.388773  3104 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.388981  3139 raft_consensus.cc:2749] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.386180  3159 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.386603  3146 raft_consensus.cc:3055] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:15.392803  3146 raft_consensus.cc:740] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:15.396868 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:15.397465 31541 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:15.390600 31361 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.403201  3159 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:15.406100  3144 log.cc:927] Time spent T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:15.406733 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:15.407410  3143 consensus_queue.cc:1048] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:15.407523  3158 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:15.408013  3111 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:15.409595 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:15.409621  2987 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:15.411062  2987 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:15.413141  2987 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:15.415560  3118 consensus_queue.cc:237] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.417485 31535 raft_consensus.cc:1240] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:15.419139  3138 consensus_queue.cc:1059] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:15.419768  3138 consensus_queue.cc:1243] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer b63f042a541248b88888cbd3049b38ca log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:15.420403  3112 consensus_queue.cc:260] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.421591  3112 raft_consensus.cc:3060] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.421782  3128 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.382862  3132 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:25:15.429562 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:15.429816 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:15.384500  3027 consensus_queue.cc:237] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:15.431600 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 169662us
I20260709 12:25:15.424269  3000 raft_consensus.cc:3055] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:15.438172  3000 raft_consensus.cc:740] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
W20260709 12:25:15.439728  3140 log.cc:927] Time spent T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.320s	user 0.000s	sys 0.002s
I20260709 12:25:15.439128  3000 consensus_queue.cc:260] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.441023  2835 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.446933 31361 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.450058  3113 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:15.451400 31361 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.451524 31541 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:15.454011 31359 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:15.467290 31433 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.468818 31433 leader_election.cc:336] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.469239 31433 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.472116 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:15.473300 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 85126us
W20260709 12:25:15.475960 31433 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.476955 31433 leader_election.cc:336] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.477380 31433 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.478785 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.392395  3104 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:15.474300 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:15.481712 31433 leader_election.cc:336] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.484897 31433 leader_election.cc:336] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.485150 31507 leader_election.cc:336] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.485746 31433 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.486444 31507 leader_election.cc:336] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.486563 31433 leader_election.cc:336] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.487006 31433 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.486869 31507 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:15.491967 31464 raft_consensus.cc:1275] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:15.493536 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:15.499704 32050 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:15.479452  3097 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:15.479110  3039 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.393636  3146 consensus_queue.cc:260] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.489697  3111 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.484689  3158 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.495157  3148 raft_consensus.cc:3060] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:15.479802  3153 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.491142  3113 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.594386  3113 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:15.596036  3160 log.cc:927] Time spent T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:25:15.498571  2900 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.498904  3133 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.491058  3150 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:15.583380 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 49144.4us
I20260709 12:25:15.580506  3097 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:15.600503  3097 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.507148  3131 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.603933  2988 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.607754  2776 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.608469  2776 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:15.502108  3132 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:25:15.662624  2835 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:15.621486  3146 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.611172  2776 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:15.675293 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 183003us
W20260709 12:25:15.676147 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 188744us
W20260709 12:25:15.687168 31433 leader_election.cc:336] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.687290 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.687723 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.688019 31461 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:15.688073 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.688606 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:15.687695 31433 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.688850 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.689313 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.690055 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.690425 31462 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:15.683274 31277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 194306us
I20260709 12:25:15.692813 31361 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.664705  3027 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.694862 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.697216 31470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.699942 31465 raft_consensus.cc:1240] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:15.668421  2852 raft_consensus.cc:3055] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:15.667346  3150 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:15.710697 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:15.712364 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 212724us
I20260709 12:25:15.705415 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:15.706080 31461 raft_consensus.cc:1240] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:15.707614 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:15.713476 31466 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:15.703111  3128 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:15.703720  3111 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.748615 31462 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
W20260709 12:25:15.735317  3163 log.cc:927] Time spent T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:25:15.705816  2852 raft_consensus.cc:740] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:15.777506 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:15.777515 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:15.778419 31544 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.764832  3159 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.736346  2776 consensus_queue.cc:1048] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:25:15.765677  3109 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 3 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:15.769081  3136 log.cc:927] Time spent T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: Append to log took a long time: real 0.650s	user 0.004s	sys 0.000s
I20260709 12:25:15.810282 31466 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
W20260709 12:25:15.814798 31433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 127654us
W20260709 12:25:15.815624 31433 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.816059 31433 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.818142 31544 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:15.819906 31359 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:15.830413 31433 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.831027 31433 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.850150 31433 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.800405  3098 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.850828 31433 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.783201  3173 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:15.853684 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 160190us
I20260709 12:25:15.857649  2901 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:15.856760 31433 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.829319  3148 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.845443  3120 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:15.864295 31433 leader_election.cc:336] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.865024 31433 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.850497  3169 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.793936  3150 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.869100 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:15.851543  3172 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.807307  2852 consensus_queue.cc:260] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.876094  2852 raft_consensus.cc:3060] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.877614  3000 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.878000 31535 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:15.879431  3120 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:15.879930  3113 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:15.880393  3120 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:15.879815  3148 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:15.797088  3024 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:15.891686 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.893810 31433 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.894894 31433 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.896219 31433 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.898267 31433 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.899153 31433 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.897008  2835 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.901580  3024 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:15.899631 31433 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.909745 30223 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 31420)
W20260709 12:25:15.911252 31433 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.912292 31433 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.898006  3118 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:15.915045 31433 leader_election.cc:336] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.909608  3152 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.917230 31433 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.927369 31361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.932904 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:15.935525 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 248761us
I20260709 12:25:15.936461 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
W20260709 12:25:15.936182 31507 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.937220 32083 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.938525 31507 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:15.943336 31507 leader_election.cc:336] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:15.947544 31433 leader_election.cc:336] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.948055 31433 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.917006  3182 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:15.947494 31507 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.950017 31507 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:15.960480 31433 leader_election.cc:336] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.960963 31433 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.962111 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:15.965751 32083 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 13.
I20260709 12:25:15.967267  3101 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:15.967784 31507 consensus_peers.cc:597] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:15.968600 31507 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.969106 31507 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:15.970096  3101 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.952997 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.972221  3112 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.975185 31361 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.976845 31361 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:15.970983 31507 leader_election.cc:336] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.947294  3012 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:15.983614 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:15.987401 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:15.989035 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.989687 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:15.990033 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:15.990346 31468 raft_consensus.cc:3060] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:15.990672 31507 leader_election.cc:336] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:15.977766  3187 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.986268  3148 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.978973  3112 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.992177 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.032531  3098 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:16.033141 31341 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:16.040692 31341 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:16.041021 31341 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:16.031296 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:16.039734 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 47647.1us
I20260709 12:25:16.043938 31361 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:15.992908  3124 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:16.039769 31436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 49483.7us
I20260709 12:25:15.995456  3179 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.030740  2852 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:15.997397  3103 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:16.070205  3165 log.cc:927] Time spent T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.338s	user 0.000s	sys 0.004s
I20260709 12:25:15.996127  3178 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.064716 31510 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:16.052971  3000 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.044015  3093 consensus_queue.cc:1048] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:16.090330 31466 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 3 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:16.048038  3148 consensus_queue.cc:1059] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:25:16.090996  3124 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.097213  3183 raft_consensus.cc:2804] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:16.080930  2852 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.095996  3113 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:16.124938  3152 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.126258 31467 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:16.128073  3113 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.126852  2852 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:16.129503 31360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.132020 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.132522 31468 raft_consensus.cc:2468] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 13.
I20260709 12:25:16.134554 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.134588 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.134423 31464 raft_consensus.cc:1240] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Rejecting Update request from peer 503bef451a2b424fa35e8e46b8c06f29 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:16.109113  3103 raft_consensus.cc:3055] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:16.136394 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.136247  3183 raft_consensus.cc:697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 13 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:16.138934  3103 raft_consensus.cc:740] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:16.110558  3124 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.148984  3183 consensus_queue.cc:237] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:16.159942 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.138406  3113 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.155745 32084 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 3 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:16.137467  2852 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:25:16.193833 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.149114  3103 consensus_queue.cc:260] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.195360 31361 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:16.199190 31433 leader_election.cc:336] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.200040 31433 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:16.201145 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:16.201426 31433 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:16.201560 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 155516us
W20260709 12:25:16.202203 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.198421  3000 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.220620  3124 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:16.222945 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:16.213721  3000 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:25:16.223882 32047 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.224304 32047 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.225267  3000 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:16.225524 32047 leader_election.cc:336] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.226040  3093 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.226660  3103 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:16.207517  3188 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.204757  3148 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.225981 32047 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:16.231997 31541 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:16.234073 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.236687 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.236833 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.237418 31538 raft_consensus.cc:2468] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:16.197515  3118 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:16.212702 31433 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:16.243906 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:16.244436 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 252895us
W20260709 12:25:16.245169 31507 leader_election.cc:336] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.245653 31507 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:16.238202  3098 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.247687  3098 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:16.239742  3148 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 12:25:16.252323 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:16.252907 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:16.253391 31507 consensus_peers.cc:597] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:16.253913 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.255214  2974 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.255465 31359 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:16.257908 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:16.243157 31433 leader_election.cc:336] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:16.299386 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:16.279457  3148 raft_consensus.cc:2804] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.328631  3118 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
W20260709 12:25:16.303563 31433 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.329802  3000 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.356544  3118 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:16.360672  3198 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:25:16.362486  3120 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:16.362695  3118 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:16.363196  3120 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:16.352581  3148 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.366058  3120 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:16.366742  3118 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.367856  3118 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.372505 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.373807 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:16.381624  2704 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:16.382333  3118 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.382833 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:16.385682 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.385876 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.394698  3112 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.375609  3148 raft_consensus.cc:3060] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.374912  3000 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:16.421650 31536 raft_consensus.cc:1240] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:25:16.423731 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbf61ba8f0cc44ee87136dd991354c89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
W20260709 12:25:16.439952 32047 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 188 similar messages]
I20260709 12:25:16.441380 31361 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.426429 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.435097 31461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.436398 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.444777 31361 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:16.449164 31433 consensus_peers.cc:597] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.450763 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:16.452682  2993 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:16.459467  2993 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.459174 31536 raft_consensus.cc:1275] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:16.461591  2993 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:16.402222  3112 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:16.414624  3192 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:16.419428  3101 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:16.469364  3168 consensus_queue.cc:1059] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:16.452553  3120 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:16.471441  3024 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
W20260709 12:25:16.474040 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.468178 31434 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.481516 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.449558  3124 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.454974  3097 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:16.502089 31507 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.502713 31507 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:16.513293 31361 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.527261 31291 catalog_manager.cc:5697] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 10 to 13, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 13 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.529655  3097 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.530421  3097 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.478765  3192 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.533586  3192 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:16.547889 31434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 79782.4us
I20260709 12:25:16.548754 31434 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.567330 31434 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.574398  3098 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.491511  3101 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:16.581354 31291 catalog_manager.cc:5697] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.586585 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.589502 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:16.594451 31359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 142126us
I20260709 12:25:16.500583  3120 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.555500  2835 raft_consensus.cc:3055] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:16.592681  3178 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:16.556348  3187 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.505293  3024 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:16.611171 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 95489.3us
I20260709 12:25:16.576882  3182 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:16.602805  2835 raft_consensus.cc:740] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:16.625975  2835 consensus_queue.cc:260] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.627192  2835 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.627830  3098 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.628324  3098 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.628886  3024 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:16.630326  3098 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.631969  3101 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:16.633020  3207 log.cc:927] Time spent T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:25:16.615476  3124 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.642139  3124 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.644160  3124 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.647397  3124 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.647946  3124 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:16.650367  3124 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:16.595515  3152 consensus_queue.cc:1048] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:25:16.655056 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 153003us
W20260709 12:25:16.656083 31507 leader_election.cc:336] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.650946  3124 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.656631 31507 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:16.656984  3124 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.657473  2783 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:16.657863 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.658159  2783 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.659879  3000 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:16.662093  3120 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:16.667994 31433 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.680462 31543 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:16.680788 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.674691  3120 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.684422  3120 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.686673  3120 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:16.686937  3203 log.cc:927] Time spent T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: Append to log took a long time: real 0.272s	user 0.000s	sys 0.002s
I20260709 12:25:16.696777 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.697242 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.698518 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.699601 31462 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:16.703295 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.681589  3124 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.710816 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.711787 31468 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:16.709582 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.718086 31538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.718689 31538 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:16.719571 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.720602 31462 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:16.720914 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:16.721858 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.722222 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.723146 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.695829  3148 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.724232 31536 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:16.712971  3120 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.725737  3120 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:16.727555  3217 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.728076  3120 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:16.728168  3217 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:16.735136  3206 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.735746  3206 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.738337  3206 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:16.738389 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:16.728729 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.740656  3217 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:16.743024 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.743125 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.743832 31536 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:16.729477 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:16.732164  3112 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:16.733398 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:16.745237  3112 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:16.745631  3112 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.745718 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:16.746093  3112 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.746105 31359 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.747000 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.725742  3148 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.750763  3113 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:16.753377 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.750288  3097 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.756258 31361 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.758495 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:16.759048 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:16.758821 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:16.761246  3097 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.761655 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:16.763926 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.765645 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:16.767359 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:16.767910 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:16.769675 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:16.772485 31291 catalog_manager.cc:5697] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 9, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 9 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:16.773967 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:16.773967 31291 catalog_manager.cc:5697] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 9 to 12, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 12 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:16.775242  3206 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.776497 31359 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:16.777671 31359 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.779138 31291 catalog_manager.cc:5697] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 8 to 10, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.780849 32084 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:16.780879 31291 catalog_manager.cc:5697] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.780884 31361 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.783888 31291 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 8 to 12, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 12 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:16.785629 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:16.786557  3206 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:16.785646 31291 catalog_manager.cc:5697] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 8, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:16.788793 31291 catalog_manager.cc:5697] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.790345  3097 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:16.797398  3097 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.797775  3097 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.790820  3124 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.791160  3113 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.792629 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:16.793969 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 93047.9us
W20260709 12:25:16.804579 31507 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.805167 31507 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:16.805980  3206 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:16.795466 31293 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38044 (request call id 250) took 23818 ms (client timeout 15000 ms). Trace:
I20260709 12:25:16.807672  3148 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.810686  3182 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 12:25:16.806813 31293 rpcz_store.cc:269] 0709 12:24:52.977438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.977691 (+   253us) service_pool.cc:224] Handling call
0709 12:25:16.795384 (+23817693us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:13.510420 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:13.511109 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:13.511171 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:25:13.511194 (+    23us) tablet.cc:662] Decoding operations
0709 12:25:13.512069 (+   875us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:13.512177 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:13.512206 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:25:13.512945 (+   739us) tablet.cc:701] Row locks acquired
0709 12:25:13.512996 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:25:13.513202 (+   206us) write_op.cc:270] Start()
0709 12:25:13.513349 (+   147us) write_op.cc:276] Timestamp: P: 1783599913513112 usec, L: 0
0709 12:25:13.513369 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:25:13.587971 (+ 74602us) log.cc:844] Serialized 3331 byte log entry
0709 12:25:14.341563 (+753592us) spinlock_profiling.cc:243] Waited 952 us on lock 0x7b4400022b4c. stack: 00007f6e8e19d343 00007f6e8e19d240 00007f6e8db2c1d4 00007f6e9786a304 00007f6e9786a299 00007f6e8e057db1 00007f6e8e0f5c85 00007f6e8e0f66a2 00007f6e90e681db 00007f6e90e63aaf 00007f6e90e5786e 00007f6e90e56bb6 00007f6e90e567d8 00007f6e90e60221 00007f6e90e601d9 00007f6e90e60169
0709 12:25:14.493234 (+151671us) op_driver.cc:464] REPLICATION: finished
0709 12:25:14.631733 (+138499us) write_op.cc:301] APPLY: starting
0709 12:25:14.631847 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:14.632780 (+   933us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:14.632826 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:14.883542 (+250716us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:14.883913 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=16
0709 12:25:14.883962 (+    49us) write_op.cc:312] APPLY: finished
0709 12:25:14.890329 (+  6367us) log.cc:844] Serialized 113 byte log entry
0709 12:25:14.895877 (+  5548us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:14.911712 (+ 15835us) write_op.cc:454] Released schema lock
0709 12:25:14.927486 (+ 15774us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:14.982660 (+ 55174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:15.008136 (+ 25476us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":822302,"reported_tablets":51,"spinlock_wait_cycles":15360,"child_traces":[["op",{"apply.queue_time_us":133576,"apply.run_cpu_time_us":16823,"apply.run_wall_time_us":321788,"cfile_cache_hit":14,"cfile_cache_hit_bytes":14672,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6223,"cfile_init":2,"lbm_read_time_us":27228,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":8,"prepare.queue_time_us":95417,"prepare.run_cpu_time_us":20934,"prepare.run_wall_time_us":142942,"raft.queue_time_us":76314,"raft.run_cpu_time_us":27102,"raft.run_wall_time_us":89647,"replication_time_us":979661,"spinlock_wait_cycles":2189056,"thread_start_us":264165,"threads_started":4,"wal-append.queue_time_us":89294,"wal-append.run_cpu_time_us":60543,"wal-append.run_wall_time_us":2202100}]]}
W20260709 12:25:16.813205 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:16.813390  3097 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.770582  3112 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.838050 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:16.839425 31468 raft_consensus.cc:2410] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:16.840135  3112 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.809670  3124 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:16.841166 31468 raft_consensus.cc:1275] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:16.811034 31291 catalog_manager.cc:5697] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.865228  3124 consensus_queue.cc:1243] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer 842fbe33f4144fa69f1fd428652b6998 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:25:16.851490  3097 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.809478 31361 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.853379 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:16.853741 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:16.872713 31539 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.873148 31541 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.875699 31291 catalog_manager.cc:5697] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.877012  3124 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:16.877223 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 67850.6us
I20260709 12:25:16.879838  3124 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.880354  3124 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.880995 31361 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.882342  3148 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.880844  3097 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:16.884792  3124 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.884189 31291 catalog_manager.cc:5697] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.887267  3109 consensus_queue.cc:1048] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:16.893492 31539 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:16.888798 31541 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:16.905702 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.906950 31540 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 12.
I20260709 12:25:16.907469 31359 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:16.908413 31359 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:16.908969 31543 raft_consensus.cc:1240] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Rejecting Update request from peer 842fbe33f4144fa69f1fd428652b6998 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:25:16.911150 30223 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 31420)
I20260709 12:25:16.915006  3124 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:16.915596  3124 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:16.917069  3112 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:16.917652  3112 raft_consensus.cc:697] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:16.918531  3112 consensus_queue.cc:237] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.919386  3179 consensus_queue.cc:1059] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:16.917227  3124 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.920508  3179 raft_consensus.cc:3055] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:16.922999  3179 raft_consensus.cc:740] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:16.923918  3179 consensus_queue.cc:260] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.925388  3179 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.931872 31359 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:16.935876  3097 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:16.936311  3097 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.936659  3097 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.946190  3027 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.946738  3097 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.946823  3027 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:16.949970  3027 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.950968 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:16.951987 31536 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
W20260709 12:25:16.952543 31433 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:16.953825 31434 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:16.954164 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:16.954964 31536 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.954111 31291 catalog_manager.cc:5697] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.956642 31291 catalog_manager.cc:5697] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 11 to 12, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 12 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.890671 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:16.982511  3113 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:16.983731 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 100610us
I20260709 12:25:16.984584 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:16.985477  3113 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:16.986865 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:16.972766  3027 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:16.987782  3113 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.987950  3027 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.988423  3027 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.989656 31291 catalog_manager.cc:5697] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 8 to 11, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 11 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:16.995702 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:17.004055 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.004841 31465 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 12.
I20260709 12:25:16.961623  3097 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:16.999416 31463 pending_rounds.cc:85] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 4
I20260709 12:25:17.007763 31463 pending_rounds.cc:107] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:25:17.008059 31463 raft_consensus.cc:2889] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:16.999593 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:17.010457 31469 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.021497 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:17.022308 31464 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.024950 31469 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:17.035928 31291 catalog_manager.cc:5697] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 7 to 10, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.040231 31291 catalog_manager.cc:5697] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 9, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 9 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:17.057865 31464 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 13.
I20260709 12:25:17.066202 31291 catalog_manager.cc:5697] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 10 to 12, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 12 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:17.069957 31507 leader_election.cc:336] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:17.069864 31536 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 13.
I20260709 12:25:17.070516 31507 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:17.071307  3206 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.071890 31359 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:17.072091 31507 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:17.072541 31507 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:17.072733  3097 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:17.073331  3097 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:17.073544  3206 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:17.080358 31462 raft_consensus.cc:2410] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 503bef451a2b424fa35e8e46b8c06f29 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:17.080269 31291 catalog_manager.cc:5697] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.082355  3097 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.082262 31291 catalog_manager.cc:5697] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 8 to 11, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 11 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:17.084157 31291 catalog_manager.cc:5697] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.085825 31291 catalog_manager.cc:5697] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 7 to 10, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.027657  3027 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:17.095767 31433 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:17.096895 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:17.097179  3027 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.121429 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:17.123472 31536 raft_consensus.cc:3060] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:17.125934 31507 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:17.127763 31507 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:17.137969 31536 raft_consensus.cc:2468] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
I20260709 12:25:17.138835  3206 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:17.143893 31434 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:17.145608  3186 raft_consensus.cc:2804] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:17.159981  3186 raft_consensus.cc:697] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:17.173399  3112 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:17.174037  3112 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:17.184866 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.195365 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.184490  3186 consensus_queue.cc:237] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.204312  3112 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.218943 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:17.229184  3113 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.233006  3113 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.229530  3112 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:17.249987  3113 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.255342 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.256013 31468 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 10.
I20260709 12:25:17.260443 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.257683 31361 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:17.265618  3113 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.279018  3113 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.280071  3113 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.296581  3148 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.297223  3148 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.299392  3148 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.300673 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.300774 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.301774  3113 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.305478 31359 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.306768  3113 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.306981  3097 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:17.307822 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:17.308641 31468 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.311409  3206 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:17.312214  3097 raft_consensus.cc:493] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.312006  3206 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.312712  3097 raft_consensus.cc:515] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.314806  3206 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:17.315026  3097 leader_election.cc:290] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.319027 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.320338 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:17.320677 31507 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:17.323808 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:17.324401 31544 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.324615 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564dc334ebd54aa5baeadc07e099bada" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.326647 31510 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:17.324891 31541 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:17.331869 31544 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:17.332497  3109 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.336570 31361 leader_election.cc:304] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.337435 31468 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 11.
I20260709 12:25:17.337966  3148 raft_consensus.cc:2749] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.338405 31359 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:17.338799  3148 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:17.339483  3097 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:17.340019  3097 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:17.340924  3097 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.352843  3097 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.353374  3097 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:17.360749 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.367573 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.366715  3097 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.369295 31359 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.371995  3113 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:17.383380  3206 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:17.384629  3206 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.396123  3113 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.396741  3113 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:17.399127  3113 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.405061 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.405937 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.407639  3206 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:17.408596 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:17.409792 31507 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:17.415442 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.416348 31468 raft_consensus.cc:2393] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 8: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:17.417371 31510 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:17.420930  3206 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.421381  3148 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:17.423530  3236 log.cc:927] Time spent T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 12:25:17.425480  3112 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.427635  3112 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:17.430011  3112 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.430274 31544 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:17.433527  3113 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:17.443964 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.446026 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.448071 31361 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.448822  3097 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.451920  3097 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.452375  3097 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.454401  3097 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.456730 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.457163 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.458637 31359 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.459470  3097 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:17.471483 31468 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:17.472967  3097 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:17.487768 31465 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:17.489316  3148 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:17.490032  3148 consensus_queue.cc:1243] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Peer 842fbe33f4144fa69f1fd428652b6998 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:17.496913 31465 pending_rounds.cc:85] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Aborting all ops after (but not including) 6
I20260709 12:25:17.497262 31465 pending_rounds.cc:107] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:25:17.497542 31465 raft_consensus.cc:2889] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:17.507637  3206 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.589349  3148 raft_consensus.cc:493] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:17.589963  3148 raft_consensus.cc:515] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:17.593700  3148 leader_election.cc:290] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.595626 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.597680  3097 raft_consensus.cc:493] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.604624 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce134725c84d9782a48f1b1cb859c0" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.608248  3097 raft_consensus.cc:515] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:17.610456  3097 leader_election.cc:290] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.618310 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.622536 31361 leader_election.cc:304] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.624119 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a542644bc5014371a0403670d46545d9" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.624728  3148 raft_consensus.cc:2749] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:17.625990 31361 leader_election.cc:304] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:17.626784  3148 raft_consensus.cc:2749] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:17.663818 31536 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:17.665916  3148 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:17.712565 31468 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:17.716535 31341 auto_rebalancer.cc:629] Failed to schedule move for tablet f85a739decfd445aac542c70782b537d: Illegal state: Replica b63f042a541248b88888cbd3049b38ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:17.792590  3097 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.793228  3097 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.795449  3097 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:17.800676 31341 auto_rebalancer.cc:629] Failed to schedule move for tablet b13f8c8324c04c879d0aa55e41fae892: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:17.800916  3148 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:17.803912 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:17.805308 31341 auto_rebalancer.cc:629] Failed to schedule move for tablet 27e02f01756e4d3397cca6128df3c644: Illegal state: Replica b63f042a541248b88888cbd3049b38ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:17.811291 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.814114  3148 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.814692  3148 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:17.816874  3148 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.829622  3148 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.830181  3097 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.830266  3148 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.830957  3097 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.833135  3097 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.833369  3148 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.835011 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.835644 31544 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:17.837077 31359 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:17.838043 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.839093  3148 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:17.839546  3148 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.840075  3148 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:17.840811 31543 raft_consensus.cc:1275] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:17.844077  3097 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.844573  3097 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.846099  3112 raft_consensus.cc:493] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.846669  3112 raft_consensus.cc:515] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:17.848245  3097 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.848493 31536 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:17.848677  3112 leader_election.cc:290] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.849576 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.851648  3112 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:17.852145 31361 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.853639  3112 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:17.854267  3112 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.854667  3112 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.856849  3112 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.859272 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.858314 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.859930 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.861806 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.863828 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.864410 31463 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 8.
I20260709 12:25:17.866089 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.866866 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.867899  3148 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.868144 31289 catalog_manager.cc:5697] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 5 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.878186  3179 consensus_queue.cc:1048] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:17.874197 31291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45406 (request call id 164) took 5348 ms. Trace:
I20260709 12:25:17.879978 31289 catalog_manager.cc:5697] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 9 to 10, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 10 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:17.881410 31289 catalog_manager.cc:5697] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 5 to 9, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.882946 31289 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 9 to 10, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.884485 31289 catalog_manager.cc:5697] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.885923 31289 catalog_manager.cc:5697] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 5 to 8, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:17.890892 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:17.893455 31341 auto_rebalancer.cc:629] Failed to schedule move for tablet 4d2a9a290e1f42029551de25d5a7932a: Illegal state: Replica 842fbe33f4144fa69f1fd428652b6998 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:17.894436 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0ffee11de74139a74b497dea5ab8fc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:17.896282 31465 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:25:17.897397 31433 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:17.899407  3148 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:17.880139 31291 rpcz_store.cc:276] 0709 12:25:12.526049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.526262 (+   213us) service_pool.cc:224] Handling call
0709 12:25:17.874103 (+5347841us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:17.160767 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:17.179104 (+ 18337us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:17.179137 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:25:17.179155 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:17.232508 (+ 53353us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:17.234242 (+  1734us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:17.234698 (+   456us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:25:17.251847 (+ 17149us) tablet.cc:701] Row locks acquired
0709 12:25:17.251867 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:25:17.252014 (+   147us) write_op.cc:270] Start()
0709 12:25:17.258284 (+  6270us) write_op.cc:276] Timestamp: P: 1783599917251969 usec, L: 0
0709 12:25:17.263599 (+  5315us) op_driver.cc:348] REPLICATION: starting
0709 12:25:17.289075 (+ 25476us) log.cc:844] Serialized 8766 byte log entry
0709 12:25:17.503954 (+214879us) op_driver.cc:464] REPLICATION: finished
0709 12:25:17.520049 (+ 16095us) write_op.cc:301] APPLY: starting
0709 12:25:17.520137 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:17.567093 (+ 46956us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:17.567263 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:17.688033 (+120770us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:17.688363 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 12:25:17.688412 (+    49us) write_op.cc:312] APPLY: finished
0709 12:25:17.688821 (+   409us) log.cc:844] Serialized 196 byte log entry
0709 12:25:17.688988 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:17.689166 (+   178us) write_op.cc:454] Released schema lock
0709 12:25:17.689232 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:17.689661 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:17.689694 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":448283,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":15841,"apply.run_cpu_time_us":28441,"apply.run_wall_time_us":169579,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96351,"num_ops":22,"prepare.queue_time_us":54724,"prepare.run_cpu_time_us":19223,"prepare.run_wall_time_us":199892,"raft.queue_time_us":67070,"raft.run_cpu_time_us":917,"raft.run_wall_time_us":27760,"replication_time_us":240196,"thread_start_us":192511,"threads_started":4,"wal-append.queue_time_us":61263}]]}
I20260709 12:25:17.908545 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:17.908915 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:17.909458 31543 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:17.910322 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:17.910974 31465 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:17.911587 30223 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 31420)
I20260709 12:25:17.914448  3097 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:17.915473 31361 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:17.911784 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:17.917028 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.917786  3112 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:17.918392  3112 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.918463 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.919418  3113 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.919842 31361 leader_election.cc:304] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:17.920655  3217 raft_consensus.cc:2749] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:17.921278  3217 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:17.933183 31465 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
I20260709 12:25:17.934405 31361 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998; no voters: 
I20260709 12:25:17.936754  3148 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:17.943337 31289 catalog_manager.cc:5697] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 10, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:17.951275 31433 consensus_peers.cc:597] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:17.951571  3148 raft_consensus.cc:697] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Becoming Leader. State: Replica: 503bef451a2b424fa35e8e46b8c06f29, State: Running, Role: LEADER
I20260709 12:25:17.952163 31289 catalog_manager.cc:5697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 4 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.952504  3148 consensus_queue.cc:237] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:17.954200 31289 catalog_manager.cc:5697] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 5 to 8, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.956159 31289 catalog_manager.cc:5697] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 2 to 6, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 6 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.957823 31289 catalog_manager.cc:5697] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 8 to 9, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:17.963009 31433 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:17.963390 31289 catalog_manager.cc:5697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.966456 31289 catalog_manager.cc:5697] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 5 to 6, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 6 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:17.974282 31289 catalog_manager.cc:5697] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 3 to 7, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 7 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.978583 31543 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503bef451a2b424fa35e8e46b8c06f29 in term 9.
W20260709 12:25:17.981932 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:17.983795  3217 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.984330  3217 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:17.984781 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:17.986641  3217 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:17.987185 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:17.988660 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:17.993741 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:17.994424  3097 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.996989 31289 catalog_manager.cc:5697] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 5 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.002193 31289 catalog_manager.cc:5697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 6 to 7, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 7 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.004360 31289 catalog_manager.cc:5697] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 4 to 8, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:18.037284 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:18.123291 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:18.124577 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:18.140722  3148 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.141338  3148 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:18.143522  3148 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:18.146958 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:18.168344 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:18.174088 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:18.174751 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:18.176576 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.182670 31359 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:18.183527  3113 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:18.191125 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:18.199327  3113 raft_consensus.cc:493] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.199925  3113 raft_consensus.cc:515] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:18.202772 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:18.202246  3113 leader_election.cc:290] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:18.199295 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:18.206426 31543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c179546c46da4fa98f8b4fb61f9128b2" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.210354 31359 leader_election.cc:304] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:18.211145  3113 raft_consensus.cc:2749] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:18.449550  3256 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.450232  3256 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:18.451601  3113 raft_consensus.cc:493] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:18.452775  3256 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:18.452200  3113 raft_consensus.cc:515] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:18.455286  3113 leader_election.cc:290] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:18.550460 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.563767 31464 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:18.567479  3217 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:18.572503 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:18.595891  3256 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:18.596524  3148 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.596462  3256 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:18.597056  3148 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:18.598565  3256 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:18.610167  3148 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:18.618268 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.618815 31543 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 503bef451a2b424fa35e8e46b8c06f29: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:18.619169 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:18.622325 31359 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:18.623153  3256 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.623839  3112 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:18.626004 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:18.626637 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.645040 31359 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:18.658623  3217 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.677083  3148 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.677676  3148 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:18.741163  3148 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:18.753959 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.755144 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d762e82a994f48968e08b715c9df4a7a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:18.782091  3256 raft_consensus.cc:493] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.782697  3256 raft_consensus.cc:515] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:18.775664  3112 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.806869 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d891c1ae594a36bd0f372d87b398dd" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:18.784494  3112 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:18.846117  3256 leader_election.cc:290] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:18.847616  3112 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:18.850277 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.852150 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.857625  3112 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.858373  3112 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:18.871843  3112 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:18.888242 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:18.891556 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 175997us
W20260709 12:25:18.906373 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 128754us
I20260709 12:25:18.907529 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:18.912037 30223 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 31420)
I20260709 12:25:18.921273 31361 leader_election.cc:304] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:18.922782 31361 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:18.934113 31464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:18.931808 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a052dcb61f484ed39d373e82a7245551" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:18.947988 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 43519.2us
I20260709 12:25:18.949672 31361 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:18.923081  3148 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.953434 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7bbda785db43a8a40b2bbd07b0c97a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:18.923436  3256 raft_consensus.cc:2749] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.943791  3112 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.962950  3113 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:18.957016  3148 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:18.981540 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:18.983301  3148 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:18.990123  3217 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.990641  3217 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:18.997689 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:18.998081 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 91325.6us
I20260709 12:25:19.005016 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2038e3170e644e7e9fb1afa87e11d993" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:19.011404 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:19.011611 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:19.012256 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:19.018177 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.019428 31359 leader_election.cc:304] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.020205  3112 raft_consensus.cc:2749] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:19.020602 31359 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.021732 31359 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.022948  3217 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:19.023003  3277 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.023205 31359 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:19.024397 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:19.023409  3256 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:19.034610 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:19.036646  3097 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.037252 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:19.040141 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:19.041916 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.042781  3097 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:19.046185 31507 consensus_peers.cc:597] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.052251 31292 catalog_manager.cc:5697] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.053814 31292 catalog_manager.cc:5697] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:19.061533 31289 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38054 (request call id 255) took 17565 ms (client timeout 15000 ms). Trace:
W20260709 12:25:19.061949 31289 rpcz_store.cc:269] 0709 12:25:01.496600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.582690 (+ 86090us) service_pool.cc:224] Handling call
0709 12:25:19.061452 (+17478762us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:18.040968 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:18.049119 (+  8151us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:18.049152 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:25:18.049170 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:18.050924 (+  1754us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:18.051021 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:18.051055 (+    34us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:25:18.052237 (+  1182us) tablet.cc:701] Row locks acquired
0709 12:25:18.052256 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:25:18.052408 (+   152us) write_op.cc:270] Start()
0709 12:25:18.052509 (+   101us) write_op.cc:276] Timestamp: P: 1783599918052357 usec, L: 0
0709 12:25:18.052528 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:18.131262 (+ 78734us) log.cc:844] Serialized 6801 byte log entry
0709 12:25:18.144286 (+ 13024us) op_driver.cc:464] REPLICATION: finished
0709 12:25:18.144632 (+   346us) write_op.cc:301] APPLY: starting
0709 12:25:18.144717 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:18.152802 (+  8085us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:18.152898 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:18.175830 (+ 22932us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:18.176169 (+   339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:25:18.176229 (+    60us) write_op.cc:312] APPLY: finished
0709 12:25:18.176594 (+   365us) log.cc:844] Serialized 156 byte log entry
0709 12:25:18.178899 (+  2305us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:18.179059 (+   160us) write_op.cc:454] Released schema lock
0709 12:25:18.179114 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:18.189242 (+ 10128us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:18.189276 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115147,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":131,"apply.run_cpu_time_us":19861,"apply.run_wall_time_us":44543,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71264,"num_ops":17,"prepare.queue_time_us":21288,"prepare.run_cpu_time_us":5101,"prepare.run_wall_time_us":101936,"replication_time_us":91623,"thread_start_us":115697,"threads_started":1}]]}
I20260709 12:25:19.055687 31292 catalog_manager.cc:5697] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 7 to 8, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.069453 31292 catalog_manager.cc:5697] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 10, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 10 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.071369 31292 catalog_manager.cc:5697] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:19.072221 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.072265  3112 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.072875  3112 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:19.073812 31292 catalog_manager.cc:5697] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 8, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 8 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.074978  3112 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:19.082806 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:19.088328 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.089756 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:19.075690 31292 catalog_manager.cc:5697] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 9 to 10, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 10 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.093267 31292 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 9, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:19.094218 31507 consensus_peers.cc:597] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:19.095005 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.094744 31292 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 11, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 11 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:19.095755 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.096321 31292 catalog_manager.cc:5697] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.104311 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30d3a647c247fab04a1722a89b8818" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:19.105654  3097 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.106088  3112 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.106145  3097 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:19.106737  3112 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:19.108664  3097 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:19.109181 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:19.109701  3112 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:19.111141 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:19.111863 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:19.112507  3112 raft_consensus.cc:493] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:19.113076  3112 raft_consensus.cc:515] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:19.113852 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:19.115463 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:19.116106  3097 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:19.119376 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:19.114028 31359 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.123718  3097 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.125038 31359 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.125519  3112 leader_election.cc:290] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:19.130941  3097 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:19.137684 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:19.138459 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25b6ccdad024914a1cfccf61addaad1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:19.153425 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:19.155962 31359 leader_election.cc:304] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.157281  3097 raft_consensus.cc:2749] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:19.165000 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:19.165766 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:19.193356 31467 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:19.229784 31537 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:19.231067 31436 consensus_peers.cc:597] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 796a9ec54e6448408ebf535a6f6a5d4f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.250303  3267 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:19.253911 31433 consensus_peers.cc:597] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.260407 31565 debug-util.cc:398] Leaking SignalData structure 0x7b08000f2dc0 after lost signal to thread 30226
W20260709 12:25:19.261476 31565 debug-util.cc:398] Leaking SignalData structure 0x7b080014b940 after lost signal to thread 31327
W20260709 12:25:19.262080 31565 debug-util.cc:398] Leaking SignalData structure 0x7b08000adc60 after lost signal to thread 31419
W20260709 12:25:19.262388 31565 debug-util.cc:398] Leaking SignalData structure 0x7b0800336180 after lost signal to thread 31420
I20260709 12:25:19.267052 31291 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 12 to 13, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 13 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:19.271576 31291 catalog_manager.cc:5697] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 9, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 9 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:19.277164 31565 debug-util.cc:398] Leaking SignalData structure 0x7b080037a8c0 after lost signal to thread 31494
W20260709 12:25:19.289191 31565 debug-util.cc:398] Leaking SignalData structure 0x7b0800393b00 after lost signal to thread 31495
W20260709 12:25:19.290315 31565 debug-util.cc:398] Leaking SignalData structure 0x7b080039e200 after lost signal to thread 31568
W20260709 12:25:19.290575 31565 debug-util.cc:398] Leaking SignalData structure 0x7b08003adc40 after lost signal to thread 31569
W20260709 12:25:19.291697 31565 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa5c0 after lost signal to thread 32108
W20260709 12:25:19.291944 31565 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0de0 after lost signal to thread 32109
W20260709 12:25:19.297228 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.300117 31291 catalog_manager.cc:5697] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.303526 31291 catalog_manager.cc:5697] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 9 to 10, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.308169 31291 catalog_manager.cc:5697] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:19.313616 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.309862 31291 catalog_manager.cc:5697] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 3 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:19.335201  3097 raft_consensus.cc:493] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.336735  3097 raft_consensus.cc:515] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:19.341241  3097 leader_election.cc:290] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:19.341147 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:19.343154 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5214a2e2a24f0c93da1f05318d0380" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:19.346261 31292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38064 (request call id 251) took 6928 ms. Trace:
I20260709 12:25:19.346441 31359 leader_election.cc:304] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.351126  3097 raft_consensus.cc:2749] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.347528 31291 catalog_manager.cc:5697] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 6 to 8, leader changed from 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:19.353300 31291 catalog_manager.cc:5697] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 2 to 7, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:19.362788  3267 raft_consensus.cc:2955] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.364670 31537 raft_consensus.cc:2955] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.379976 31463 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:19.354887 31292 rpcz_store.cc:276] 0709 12:25:12.417920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.418118 (+   198us) service_pool.cc:224] Handling call
0709 12:25:19.346178 (+6928060us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:19.166148 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:19.173659 (+  7511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:19.173694 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:25:19.173711 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:19.174620 (+   909us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:19.174699 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:19.174724 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:25:19.175460 (+   736us) tablet.cc:701] Row locks acquired
0709 12:25:19.175477 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:25:19.175628 (+   151us) write_op.cc:270] Start()
0709 12:25:19.175727 (+    99us) write_op.cc:276] Timestamp: P: 1783599919175580 usec, L: 0
0709 12:25:19.175746 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:19.176421 (+   675us) log.cc:844] Serialized 4054 byte log entry
0709 12:25:19.200339 (+ 23918us) op_driver.cc:464] REPLICATION: finished
0709 12:25:19.230866 (+ 30527us) write_op.cc:301] APPLY: starting
0709 12:25:19.230949 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:19.237091 (+  6142us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:19.237194 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:19.243098 (+  5904us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:19.243388 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:25:19.243442 (+    54us) write_op.cc:312] APPLY: finished
0709 12:25:19.243771 (+   329us) log.cc:844] Serialized 97 byte log entry
0709 12:25:19.243948 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:19.244082 (+   134us) write_op.cc:454] Released schema lock
0709 12:25:19.244134 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:19.244533 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:19.244563 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22608,"reported_tablets":46,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":12347,"apply.run_cpu_time_us":13039,"apply.run_wall_time_us":13622,"cfile_cache_hit":42,"cfile_cache_hit_bytes":46047,"num_ops":10,"prepare.queue_time_us":63190,"prepare.run_cpu_time_us":3608,"prepare.run_wall_time_us":19453,"replication_time_us":24446,"thread_start_us":77179,"threads_started":2}]]}
W20260709 12:25:19.358763 31416 debug-util.cc:398] Leaking SignalData structure 0x7b08001ead80 after lost signal to thread 30226
W20260709 12:25:19.392006 31416 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad620 after lost signal to thread 31327
W20260709 12:25:19.392753 31416 debug-util.cc:398] Leaking SignalData structure 0x7b08000da8e0 after lost signal to thread 31419
W20260709 12:25:19.393055 31416 debug-util.cc:398] Leaking SignalData structure 0x7b0800118300 after lost signal to thread 31420
W20260709 12:25:19.394191 31416 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4b00 after lost signal to thread 31494
W20260709 12:25:19.401551 31416 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4a20 after lost signal to thread 31495
W20260709 12:25:19.402606 31416 debug-util.cc:398] Leaking SignalData structure 0x7b080037f6c0 after lost signal to thread 31568
W20260709 12:25:19.402901 31416 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa1e0 after lost signal to thread 31569
W20260709 12:25:19.403985 31416 debug-util.cc:398] Leaking SignalData structure 0x7b0800224860 after lost signal to thread 32108
W20260709 12:25:19.404047 31433 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.404366 31416 debug-util.cc:398] Leaking SignalData structure 0x7b080033b3c0 after lost signal to thread 32109
W20260709 12:25:19.404428 31436 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f85a739decfd445aac542c70782b537d. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.415894 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:19.421226 31433 consensus_peers.cc:597] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.421553 31537 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:19.423040  3027 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:19.432035  3256 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.432621  3256 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:19.434628  3256 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:19.437218 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:19.438490 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:19.440678 31361 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.443778  3112 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:19.450004 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:19.484642 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:19.486107  3267 raft_consensus.cc:2955] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.488009 31541 raft_consensus.cc:2955] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.524195 31291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45406 (request call id 165) took 1532 ms. Trace:
I20260709 12:25:19.524634 31291 rpcz_store.cc:276] 0709 12:25:17.989999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.990158 (+   159us) service_pool.cc:224] Handling call
0709 12:25:19.522012 (+1531854us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:19.387141 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:19.387766 (+   625us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:19.387823 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:25:19.387835 (+    12us) tablet.cc:662] Decoding operations
0709 12:25:19.388718 (+   883us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:19.388775 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:19.388804 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:25:19.389599 (+   795us) tablet.cc:701] Row locks acquired
0709 12:25:19.389620 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:25:19.389780 (+   160us) write_op.cc:270] Start()
0709 12:25:19.389881 (+   101us) write_op.cc:276] Timestamp: P: 1783599919389734 usec, L: 0
0709 12:25:19.389903 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:25:19.390544 (+   641us) log.cc:844] Serialized 3370 byte log entry
0709 12:25:19.392558 (+  2014us) op_driver.cc:464] REPLICATION: finished
0709 12:25:19.394799 (+  2241us) write_op.cc:301] APPLY: starting
0709 12:25:19.394875 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:19.405609 (+ 10734us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:19.405710 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:19.461971 (+ 56261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:19.463020 (+  1049us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:25:19.463080 (+    60us) write_op.cc:312] APPLY: finished
0709 12:25:19.464236 (+  1156us) log.cc:844] Serialized 81 byte log entry
0709 12:25:19.465736 (+  1500us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:19.465869 (+   133us) write_op.cc:454] Released schema lock
0709 12:25:19.465919 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:19.517593 (+ 51674us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:19.519932 (+  2339us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19877,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":2032,"apply.run_cpu_time_us":11257,"apply.run_wall_time_us":118814,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33536,"num_ops":8,"prepare.queue_time_us":172,"prepare.run_cpu_time_us":3688,"prepare.run_wall_time_us":3690,"replication_time_us":2529}]]}
I20260709 12:25:19.533757 31541 consensus_queue.cc:237] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:19.542110 31293 catalog_manager.cc:5697] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:19.543903 31293 catalog_manager.cc:5697] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.545861 31293 catalog_manager.cc:5697] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.539465  3256 raft_consensus.cc:493] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.547175  3256 raft_consensus.cc:515] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:19.549599  3256 leader_election.cc:290] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:19.549860 31293 catalog_manager.cc:5697] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 8 to 10, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 10 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.552937 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:19.557901 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2a9a290e1f42029551de25d5a7932a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:19.558401 31293 catalog_manager.cc:5697] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 6 to 8, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.559262 31359 leader_election.cc:304] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.562140  3256 raft_consensus.cc:2749] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:19.564304 31293 catalog_manager.cc:5697] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 10 to 12, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 12 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:25:19.568557 31510 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1433e6dfe06d41c7addfb5462c25ef76. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.572175 31467 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:19.575765  3109 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:19.572309 31293 catalog_manager.cc:5697] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:25:19.588650 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.588075 31293 catalog_manager.cc:5697] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 8 to 10, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 10 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.591243 31293 catalog_manager.cc:5697] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 7 to 11, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 11 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:19.595352 31293 catalog_manager.cc:5697] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.595468  3109 raft_consensus.cc:2955] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.597142 31293 catalog_manager.cc:5697] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:19.612449 31463 raft_consensus.cc:2955] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.626678 31467 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
W20260709 12:25:19.641507 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:19.648458 31436 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531): Couldn't send request to peer 8d38acb9ce494ceb917c8441666104c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25e1632d46704126852887ade0b97386. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.648715 31541 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:19.650189  3027 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:19.652205 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.691979  3295 ts_tablet_manager.cc:933] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:19.761125  3256 raft_consensus.cc:493] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.761816  3256 raft_consensus.cc:515] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:19.763988  3256 leader_election.cc:290] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:19.765837 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:19.770741 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa2173634bd428990b41e94ec873527" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:19.782735 31361 leader_election.cc:304] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:19.784034  3256 raft_consensus.cc:2749] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:19.790655 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 43785.4us
I20260709 12:25:19.837441  3267 raft_consensus.cc:2955] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.862937 31537 raft_consensus.cc:2955] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.907876  3295 tablet_copy_client.cc:323] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
W20260709 12:25:19.912497 30223 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 31420)
I20260709 12:25:19.913712 31292 catalog_manager.cc:5697] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 10 to 11, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 11 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.915663 31292 catalog_manager.cc:5697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 10, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 10 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.919096 31292 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:19.922003 31292 catalog_manager.cc:5697] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 6 to 9, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 9 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.923696 31292 catalog_manager.cc:5697] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 11, leader changed from b63f042a541248b88888cbd3049b38ca (127.29.131.195) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 11 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.927899 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet 796a9ec54e6448408ebf535a6f6a5d4f from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:25:19.928731 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet 796a9ec54e6448408ebf535a6f6a5d4f from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-796a9ec54e6448408ebf535a6f6a5d4f
I20260709 12:25:19.927034 31292 catalog_manager.cc:5697] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.947942 31292 catalog_manager.cc:5697] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.954663 31292 catalog_manager.cc:5697] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 11, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 11 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
I20260709 12:25:19.957471 31293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38054 (request call id 256) took 3081 ms. Trace:
I20260709 12:25:19.960673 31292 catalog_manager.cc:5697] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 8 to 13, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193). New cstate: current_term: 13 leader_uuid: "503bef451a2b424fa35e8e46b8c06f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } }
W20260709 12:25:19.964881 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:19.963639 31480 tablet_copy_source_session.cc:215] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:19.959456 31293 rpcz_store.cc:276] 0709 12:25:16.875765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.876231 (+   466us) service_pool.cc:224] Handling call
0709 12:25:19.957371 (+3081140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:19.608579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:19.609078 (+   499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:19.609109 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:25:19.609126 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:19.610108 (+   982us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:19.610169 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:19.610195 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:25:19.611051 (+   856us) tablet.cc:701] Row locks acquired
0709 12:25:19.611066 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:25:19.611200 (+   134us) write_op.cc:270] Start()
0709 12:25:19.611325 (+   125us) write_op.cc:276] Timestamp: P: 1783599919611157 usec, L: 0
0709 12:25:19.611341 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:25:19.611926 (+   585us) log.cc:844] Serialized 4455 byte log entry
0709 12:25:19.614361 (+  2435us) op_driver.cc:464] REPLICATION: finished
0709 12:25:19.617862 (+  3501us) write_op.cc:301] APPLY: starting
0709 12:25:19.617946 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:19.631384 (+ 13438us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:19.631480 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:19.645562 (+ 14082us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:19.645812 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:25:19.645865 (+    53us) write_op.cc:312] APPLY: finished
0709 12:25:19.646195 (+   330us) log.cc:844] Serialized 105 byte log entry
0709 12:25:19.663409 (+ 17214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:19.663556 (+   147us) write_op.cc:454] Released schema lock
0709 12:25:19.663618 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:19.820691 (+157073us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:19.820733 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31432,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":3279,"apply.run_cpu_time_us":13680,"apply.run_wall_time_us":202758,"cfile_cache_hit":44,"cfile_cache_hit_bytes":46112,"num_ops":11,"prepare.queue_time_us":4270,"prepare.run_cpu_time_us":3616,"prepare.run_wall_time_us":6177,"replication_time_us":2913}]]}
I20260709 12:25:19.971760  3298 ts_tablet_manager.cc:933] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:19.977779  3295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796a9ec54e6448408ebf535a6f6a5d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:19.994899  3295 tablet_copy_client.cc:806] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:20.028923  3298 tablet_copy_client.cc:323] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:25:20.029466  3301 raft_consensus.cc:493] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.029911  3301 raft_consensus.cc:515] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:20.033023  3256 raft_consensus.cc:493] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:20.047389  3256 raft_consensus.cc:515] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.049670  3256 leader_election.cc:290] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:20.031153 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet f85a739decfd445aac542c70782b537d from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:25:20.053930 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet f85a739decfd445aac542c70782b537d from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-f85a739decfd445aac542c70782b537d
W20260709 12:25:20.082079 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:20.033313  3295 tablet_copy_client.cc:670] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:20.095599  3301 leader_election.cc:290] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.113060 31480 tablet_copy_source_session.cc:215] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:20.178387 31293 catalog_manager.cc:5697] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } } }
I20260709 12:25:20.193500 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:20.212112 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 97346.4us
I20260709 12:25:20.259387  3304 raft_consensus.cc:493] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.260365  3112 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.260700  3304 raft_consensus.cc:515] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.261250  3112 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.265357  3097 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.266245  3097 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:20.273528 31293 catalog_manager.cc:5697] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:20.284086  3112 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:20.286049  3097 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.287706  3295 tablet_copy_client.cc:538] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:20.298574 31293 catalog_manager.cc:5697] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index -1 to 7, NON_VOTER 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) added. New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:20.301056  3298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85a739decfd445aac542c70782b537d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:20.308002  3301 raft_consensus.cc:493] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.330039  3304 leader_election.cc:290] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:20.330739  3308 raft_consensus.cc:493] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.331630  3308 raft_consensus.cc:515] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.334683  3308 leader_election.cc:290] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:20.330344  3317 ts_tablet_manager.cc:933] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:20.347091  3304 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.325560  3301 raft_consensus.cc:515] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:20.350497  3301 leader_election.cc:290] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.350881  3304 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.369517  3304 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:20.387418 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:20.390569  3304 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.396687  3304 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.402652  3304 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:20.403170 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:20.442598  3295 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:25:20.460381 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:20.465857 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:20.471972 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc04eb7c849448bba0b8d22faf8751a" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.472640 32084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:20.473333 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:20.479314 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b503c7c204e5cb7b8dcf59fffdae6" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.487617  3317 tablet_copy_client.cc:323] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.194:40963
I20260709 12:25:20.490507 31480 tablet_copy_service.cc:140] P 842fbe33f4144fa69f1fd428652b6998: Received BeginTabletCopySession request for tablet 25e1632d46704126852887ade0b97386 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:48410)
I20260709 12:25:20.491441 31480 tablet_copy_service.cc:161] P 842fbe33f4144fa69f1fd428652b6998: Beginning new tablet copy session on tablet 25e1632d46704126852887ade0b97386 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:48410: session id = 8d38acb9ce494ceb917c8441666104c4-25e1632d46704126852887ade0b97386
I20260709 12:25:20.500926 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b17789440044608d6b5d4f1b95d09c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.502424 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a413d9092d14aea9490265eb7f932db" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.513687 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:20.518239 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d99c62694f427cb30f713a2843eec8" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.519562 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a937a8e153c40d396843c808354fb5b" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.519801 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09d8cfad9a493ebdab9d29ceaeedfc" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.523772 32078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b617a3dcc54fb4b4d2c6cda2c6cc55" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:20.586243 31480 tablet_copy_source_session.cc:215] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:20.590507  3317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e1632d46704126852887ade0b97386. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:20.611734 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 56374.7us
I20260709 12:25:20.617111  3315 raft_consensus.cc:493] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.617812  3315 raft_consensus.cc:515] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:20.619432 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:20.621145  3315 leader_election.cc:290] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:20.623472 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:20.638837  3321 ts_tablet_manager.cc:933] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: Initiating tablet copy from peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.672811 31290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38044 (request call id 251) took 7139 ms. Trace:
I20260709 12:25:20.673610 31290 rpcz_store.cc:276] 0709 12:25:13.532990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.534062 (+  1072us) service_pool.cc:224] Handling call
0709 12:25:20.672621 (+7138559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16284,"reported_tablets":51,"spinlock_wait_cycles":1001728}
I20260709 12:25:20.683457 31361 leader_election.cc:304] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:20.684376  3304 raft_consensus.cc:2749] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.685599 31361 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:20.686342  3304 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:20.692680 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:20.695180 31539 consensus_queue.cc:237] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.697160 31361 leader_election.cc:304] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:20.707093  3304 raft_consensus.cc:2749] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.695169 31537 consensus_queue.cc:237] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.717496 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:20.717684 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db923f6154349d3ba9a88713b04d088" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:20.726876 31463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:20.743394 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 48296.2us
I20260709 12:25:20.747592 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5b01f306242f19825d56ac764bc69" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:20.749146  3301 raft_consensus.cc:493] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.749833  3301 raft_consensus.cc:515] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:20.755367  3301 leader_election.cc:290] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:20.757771  3097 raft_consensus.cc:493] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.761452 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.758462  3097 raft_consensus.cc:515] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:20.773708  3298 tablet_copy_client.cc:806] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:20.774417  3298 tablet_copy_client.cc:670] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:20.775444  3317 tablet_copy_client.cc:806] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
W20260709 12:25:20.780864 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:20.782572 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:20.776039  3317 tablet_copy_client.cc:670] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:20.779131  3321 tablet_copy_client.cc:323] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.131.195:37233
I20260709 12:25:20.788388 31554 tablet_copy_service.cc:140] P b63f042a541248b88888cbd3049b38ca: Received BeginTabletCopySession request for tablet 1433e6dfe06d41c7addfb5462c25ef76 from peer 8d38acb9ce494ceb917c8441666104c4 ({username='slave'} at 127.0.0.1:34624)
I20260709 12:25:20.788961 31554 tablet_copy_service.cc:161] P b63f042a541248b88888cbd3049b38ca: Beginning new tablet copy session on tablet 1433e6dfe06d41c7addfb5462c25ef76 from peer 8d38acb9ce494ceb917c8441666104c4 at {username='slave'} at 127.0.0.1:34624: session id = 8d38acb9ce494ceb917c8441666104c4-1433e6dfe06d41c7addfb5462c25ef76
I20260709 12:25:20.792397  3317 tablet_copy_client.cc:538] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:20.793448 30223 tablet_replica.cc:333] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:20.795876  3304 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.796573  3304 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:20.807623 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:20.798223  3097 leader_election.cc:290] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.798630 30223 raft_consensus.cc:2243] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.809355 30223 pending_rounds.cc:70] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:20.809652 30223 pending_rounds.cc:77] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 7 index: 8 } timestamp: 7305625201516797952 op_type: NO_OP noop_request { }
I20260709 12:25:20.810079 30223 raft_consensus.cc:2889] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:20.810482 30223 raft_consensus.cc:2272] T 0f0ffee11de74139a74b497dea5ab8fc P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.810371 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.799437 31468 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:20.813431  3314 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:20.814278 30223 tablet_replica.cc:333] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:20.810801  3298 tablet_copy_client.cc:538] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:20.798729 32076 raft_consensus.cc:1275] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:20.810813 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.828799 32078 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:20.829269 31554 tablet_copy_source_session.cc:215] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:20.830194 31465 raft_consensus.cc:1275] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:20.832237  3314 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:20.818651  3304 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.804667  3317 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:25:20.844012  3321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1433e6dfe06d41c7addfb5462c25ef76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:20.856856  3311 consensus_queue.cc:1048] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:20.863076 31361 leader_election.cc:304] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:20.864051  3097 raft_consensus.cc:2749] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.864455 31361 leader_election.cc:304] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:20.867587  3097 raft_consensus.cc:2749] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.867906 31361 leader_election.cc:304] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:20.868678  3097 raft_consensus.cc:2749] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:20.869185 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:20.866578 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:20.879833 31361 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:20.881471  3311 consensus_queue.cc:1048] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:20.883471 31510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.884624 30223 raft_consensus.cc:2243] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.885298  3311 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:20.891024 30223 pending_rounds.cc:70] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:20.891750 30223 pending_rounds.cc:77] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 9 } timestamp: 7305625166469627904 op_type: NO_OP noop_request { }
I20260709 12:25:20.892171 30223 raft_consensus.cc:2889] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:20.892572 30223 raft_consensus.cc:2272] T 1a937a8e153c40d396843c808354fb5b P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.893744 31361 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:20.894960  3097 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.895357  3304 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.895918  3304 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:20.898447 30223 tablet_replica.cc:333] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:20.899992 30223 raft_consensus.cc:2243] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.901024 30223 raft_consensus.cc:2272] T 78881770eb254ce191fad6a8664b7430 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.907979 31467 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:20.917034 30223 tablet_replica.cc:333] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:20.919346  3097 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:20.923374 31433 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:20.926471  3298 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:25:20.935017  3304 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.937264 31537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.928970 30223 raft_consensus.cc:2243] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.938648 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbeeb8bf3c34f9fad2c9e7cfc641146" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:20.956557 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0207be23688449b2931af8e5102e206e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:20.959652 31361 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:20.960181 30223 raft_consensus.cc:2272] T a542644bc5014371a0403670d46545d9 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.955022  3295 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:20.961161 31361 leader_election.cc:304] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:20.961900  3295 tablet_bootstrap.cc:492] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:25:20.962527  3302 raft_consensus.cc:2749] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:20.964504 31507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.960713  3112 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:20.965292  3321 tablet_copy_client.cc:806] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:20.965956  3321 tablet_copy_client.cc:670] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:20.967707  3295 ts_tablet_manager.cc:1403] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.526s	user 0.035s	sys 0.039s
I20260709 12:25:20.965507  3112 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:20.971439 31361 leader_election.cc:304] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:20.960814  3097 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.977591  3097 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.978992  3112 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.980638 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:20.982481 30223 tablet_replica.cc:333] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:20.983523 30223 raft_consensus.cc:2243] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.970393 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e02f01756e4d3397cca6128df3c644" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:20.969077 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a818d01cfc443aea4e12b8ef804f14c" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:20.990770 31361 leader_election.cc:304] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:20.996017 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:20.998885 30223 pending_rounds.cc:70] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:20.978087  3097 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:21.009768 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b119c4a56bea40fb9d13fc79732c5c7f" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.013653  3097 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:20.999203 30223 pending_rounds.cc:77] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 8 index: 5 } timestamp: 7305625231035965440 op_type: NO_OP noop_request { }
I20260709 12:25:21.019817 30223 raft_consensus.cc:2889] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.020304 30223 raft_consensus.cc:2272] T 75d99c62694f427cb30f713a2843eec8 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.997574  3304 raft_consensus.cc:2749] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:21.022224 31361 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:21.033061 31361 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:21.036768  3302 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:21.037541  3302 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:21.019510  3315 raft_consensus.cc:2749] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:21.030087  3097 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.052361  3097 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:21.054649  3097 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:21.058867 31361 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:21.041640 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:21.064009  3295 raft_consensus.cc:359] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:21.065024  3295 raft_consensus.cc:740] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:25:21.065865 30223 tablet_replica.cc:333] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.065636  3295 consensus_queue.cc:260] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:20.996163  3331 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:21.080057  3321 tablet_copy_client.cc:538] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:21.090050 31539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:21.067091 30223 raft_consensus.cc:2243] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:21.089217 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 53025.9us
I20260709 12:25:21.098270  3112 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:21.098507 30223 pending_rounds.cc:70] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.098882 30223 pending_rounds.cc:77] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 10 index: 6 } timestamp: 7305625158772793344 op_type: NO_OP noop_request { }
I20260709 12:25:21.099078  3112 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:21.099290 30223 raft_consensus.cc:2889] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.099790 30223 raft_consensus.cc:2272] T a052dcb61f484ed39d373e82a7245551 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.099706  3112 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:21.100867 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:21.102133  3112 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:21.111300 30223 tablet_replica.cc:333] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
W20260709 12:25:21.089493 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:21.112361 30223 raft_consensus.cc:2243] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.111733 32076 raft_consensus.cc:2955] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:21.113102 30223 raft_consensus.cc:2272] T 18ce134725c84d9782a48f1b1cb859c0 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.113606  3112 raft_consensus.cc:493] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.114099  3112 raft_consensus.cc:515] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:21.116132 30223 tablet_replica.cc:333] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.117326 30223 raft_consensus.cc:2243] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.117982 30223 pending_rounds.cc:70] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.118208 30223 pending_rounds.cc:77] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 6 index: 7 } timestamp: 7305625227348283392 op_type: NO_OP noop_request { }
I20260709 12:25:21.118578 30223 raft_consensus.cc:2889] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.118769  3112 leader_election.cc:290] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:21.118984 30223 raft_consensus.cc:2272] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 503bef451a2b424fa35e8e46b8c06f29 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.122225 30223 tablet_replica.cc:333] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.118398 32083 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:21.123920 30223 raft_consensus.cc:2243] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.124495 30223 raft_consensus.cc:2272] T b119c4a56bea40fb9d13fc79732c5c7f P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.128008 30223 tablet_replica.cc:333] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.129297 30223 raft_consensus.cc:2243] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.130076 30223 pending_rounds.cc:70] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.130337 30223 pending_rounds.cc:77] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 8 index: 6 } timestamp: 7305625203817512960 op_type: NO_OP noop_request { }
I20260709 12:25:21.130609  3295 ts_tablet_manager.cc:1434] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.162s	user 0.009s	sys 0.000s
I20260709 12:25:21.130888 30223 raft_consensus.cc:2889] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.132769 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-796a9ec54e6448408ebf535a6f6a5d4f received from {username='slave'} at 127.0.0.1:48410
I20260709 12:25:21.132863 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab7bbda785db43a8a40b2bbd07b0c97a with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:21.133363 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-796a9ec54e6448408ebf535a6f6a5d4f on tablet 796a9ec54e6448408ebf535a6f6a5d4f with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:21.135640 30223 raft_consensus.cc:2272] T d762e82a994f48968e08b715c9df4a7a P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.130182 31290 catalog_manager.cc:5697] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 7 to 8, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 11 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:21.149076 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f717dfc5b2ba4dcf876418eb16911078" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.153985 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:21.158715 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.157410 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00e106a7374108a1bb1bb841b5edaa" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:21.157194 31462 raft_consensus.cc:2955] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:21.160071 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1433e6dfe06d41c7addfb5462c25ef76" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.168313 31361 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:21.173666 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0ab2689b6649ac9fba57f55c7cd0f1" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.186039 30223 tablet_replica.cc:333] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.176607  3302 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:21.187165 30223 raft_consensus.cc:2243] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.196659 30223 pending_rounds.cc:70] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.199385 30223 pending_rounds.cc:77] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 8 index: 9 } timestamp: 7305625162264842240 op_type: NO_OP noop_request { }
I20260709 12:25:21.207350 30223 raft_consensus.cc:2889] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.207811 30223 raft_consensus.cc:2272] T 17b17789440044608d6b5d4f1b95d09c P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.209853 31278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d762e82a994f48968e08b715c9df4a7a with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:21.212585 30223 tablet_replica.cc:333] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.215626 30223 raft_consensus.cc:2243] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.179840 31361 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:21.220017 31359 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:21.250640 31361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 70880.2us
I20260709 12:25:21.250661  3302 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:21.251646  3301 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:21.254705 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:21.255808 31358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.258800 30223 raft_consensus.cc:2272] T e9371bed6dc240b6969ed373c14c9a75 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:21.260960 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:21.283023 31361 leader_election.cc:304] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:21.285328  3301 raft_consensus.cc:2749] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:21.284428 30223 tablet_replica.cc:333] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.289112 30223 raft_consensus.cc:2243] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:21.293777 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:21.294893 30223 raft_consensus.cc:2272] T a25b6ccdad024914a1cfccf61addaad1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.295549  3301 raft_consensus.cc:493] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d38acb9ce494ceb917c8441666104c4)
I20260709 12:25:21.298744  3301 raft_consensus.cc:515] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:21.301021  3301 leader_election.cc:290] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:21.304934 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:21.306145 32076 raft_consensus.cc:1217] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 12:25:21.309139  3321 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap starting.
I20260709 12:25:21.313016 30223 tablet_replica.cc:333] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.316489 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.326961 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4c1a36e3964960952aee6245d4560e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:21.329753 31361 leader_election.cc:304] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:21.322532 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:21.334106 30223 raft_consensus.cc:2243] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.335911  3301 raft_consensus.cc:2749] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:21.356995 30223 raft_consensus.cc:2272] T 05d891c1ae594a36bd0f372d87b398dd P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.360967  3302 raft_consensus.cc:493] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.361335 30223 tablet_replica.cc:333] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.362414 30223 raft_consensus.cc:2243] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.361929  3302 raft_consensus.cc:515] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:21.363272 30223 pending_rounds.cc:70] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.363543 30223 pending_rounds.cc:77] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 10 index: 9 } timestamp: 7305625153612619776 op_type: NO_OP noop_request { }
I20260709 12:25:21.363893 30223 raft_consensus.cc:2889] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.364207 30223 raft_consensus.cc:2272] T 0db923f6154349d3ba9a88713b04d088 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.367767 30223 tablet_replica.cc:333] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.368580 30223 raft_consensus.cc:2243] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.369251 30223 pending_rounds.cc:70] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 2 pending ops.
I20260709 12:25:21.369589 30223 pending_rounds.cc:77] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 10 index: 7 } timestamp: 7305625228801163264 op_type: NO_OP noop_request { }
I20260709 12:25:21.373414 30223 raft_consensus.cc:2889] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.369040  3302 leader_election.cc:290] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:21.384857 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.390448 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673eb8b7e874dc68e3b56393a06a549" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:21.373699 30223 pending_rounds.cc:77] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 7 index: 6 } timestamp: 7305625050703482880 op_type: NO_OP noop_request { }
I20260709 12:25:21.396677 30223 raft_consensus.cc:2889] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.397111 30223 raft_consensus.cc:2272] T 8a818d01cfc443aea4e12b8ef804f14c P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.406560 31361 leader_election.cc:304] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:21.409233  3301 raft_consensus.cc:2749] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:21.412876 30223 tablet_replica.cc:333] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.414523  3317 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.440804 30223 raft_consensus.cc:2243] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:21.445248 31507 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 371 similar messages]
I20260709 12:25:21.451323  3317 tablet_bootstrap.cc:492] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
W20260709 12:25:21.451454 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:21.452387  3317 ts_tablet_manager.cc:1403] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.648s	user 0.036s	sys 0.012s
I20260709 12:25:21.453686 30223 pending_rounds.cc:70] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 2 pending ops.
I20260709 12:25:21.453965 30223 pending_rounds.cc:77] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 7 index: 5 } timestamp: 7305625144633618432 op_type: NO_OP noop_request { }
I20260709 12:25:21.454267 30223 raft_consensus.cc:2889] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.454551 30223 pending_rounds.cc:77] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 6 index: 4 } timestamp: 7305625092590747648 op_type: NO_OP noop_request { }
I20260709 12:25:21.454815 30223 raft_consensus.cc:2889] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.455181 30223 raft_consensus.cc:2272] T 564dc334ebd54aa5baeadc07e099bada P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.458110 30223 tablet_replica.cc:333] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.459092 30223 raft_consensus.cc:2243] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.470238  3298 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.459864 30223 raft_consensus.cc:2272] T 1fc04eb7c849448bba0b8d22faf8751a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.472695  3298 tablet_bootstrap.cc:492] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:25:21.476188  3301 raft_consensus.cc:493] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.476703  3301 raft_consensus.cc:515] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:21.478868  3301 leader_election.cc:290] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:21.482713 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:21.481765 31293 catalog_manager.cc:5697] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 9 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:21.484185 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede0de141bd4d8aafecf4cc1902f9f3" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.473428  3298 ts_tablet_manager.cc:1403] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.549s	user 0.028s	sys 0.020s
I20260709 12:25:21.502918  3317 raft_consensus.cc:359] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:21.504179  3317 raft_consensus.cc:740] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:25:21.507181 31361 leader_election.cc:304] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:21.509519  3302 raft_consensus.cc:2749] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:21.505841  3317 consensus_queue.cc:260] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:21.518843  3317 ts_tablet_manager.cc:1434] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.003s
I20260709 12:25:21.520685 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-25e1632d46704126852887ade0b97386 received from {username='slave'} at 127.0.0.1:48410
I20260709 12:25:21.521171 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-25e1632d46704126852887ade0b97386 on tablet 25e1632d46704126852887ade0b97386 with peer 8d38acb9ce494ceb917c8441666104c4
W20260709 12:25:21.530201 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ab7bbda785db43a8a40b2bbd07b0c97a: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:25:21.553843 30223 tablet_replica.cc:333] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.555081 30223 raft_consensus.cc:2243] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.561247 30223 raft_consensus.cc:2272] T ebc2f1162c2a4dea82b0b11efc141c5a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.570065  3298 raft_consensus.cc:359] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:21.570917  3298 raft_consensus.cc:740] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
W20260709 12:25:21.592800 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:21.597316 30223 tablet_replica.cc:333] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.598491 30223 raft_consensus.cc:2243] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.599056 30223 pending_rounds.cc:70] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.606065 30223 pending_rounds.cc:77] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 7 index: 8 } timestamp: 7305625227346456576 op_type: NO_OP noop_request { }
I20260709 12:25:21.606525 30223 raft_consensus.cc:2889] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.606879 30223 raft_consensus.cc:2272] T 2038e3170e644e7e9fb1afa87e11d993 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.609876 30223 tablet_replica.cc:333] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.611124 30223 raft_consensus.cc:2243] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.611699 30223 pending_rounds.cc:70] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.611931 30223 pending_rounds.cc:77] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 6 index: 4 } timestamp: 7305625104353988608 op_type: NO_OP noop_request { }
I20260709 12:25:21.612273 30223 raft_consensus.cc:2889] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.615252 30223 raft_consensus.cc:2272] T 27e02f01756e4d3397cca6128df3c644 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.618165 30223 tablet_replica.cc:333] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.618721 30223 raft_consensus.cc:2243] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.619208 30223 pending_rounds.cc:70] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.619501 30223 pending_rounds.cc:77] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 11 index: 9 } timestamp: 7305625145889902592 op_type: NO_OP noop_request { }
I20260709 12:25:21.619805 30223 raft_consensus.cc:2889] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.620121 30223 raft_consensus.cc:2272] T afa2173634bd428990b41e94ec873527 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.571584  3298 consensus_queue.cc:260] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:21.622531  3298 ts_tablet_manager.cc:1434] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.137s	user 0.006s	sys 0.000s
I20260709 12:25:21.623293 30223 tablet_replica.cc:333] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.624092 30223 raft_consensus.cc:2243] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.624764 30223 pending_rounds.cc:70] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.624982 30223 pending_rounds.cc:77] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7305625225423097856 op_type: NO_OP noop_request { }
I20260709 12:25:21.625329 30223 raft_consensus.cc:2889] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.625643 30223 raft_consensus.cc:2272] T 4d2a9a290e1f42029551de25d5a7932a P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.628925 30223 tablet_replica.cc:333] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.629690 30223 raft_consensus.cc:2243] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.630643 30223 raft_consensus.cc:2272] T 27460804ee284848a7cc13b9117e52c7 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.633515 30223 tablet_replica.cc:333] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.634418 30223 raft_consensus.cc:2243] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.635448 30223 raft_consensus.cc:2272] T 069da3737bb54ce19c27f8dcaa7fdf87 P 503bef451a2b424fa35e8e46b8c06f29 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.639906 30223 tablet_replica.cc:333] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.640307 31480 tablet_copy_service.cc:342] P 842fbe33f4144fa69f1fd428652b6998: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-f85a739decfd445aac542c70782b537d received from {username='slave'} at 127.0.0.1:48410
I20260709 12:25:21.640780 30223 raft_consensus.cc:2243] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.640782 31480 tablet_copy_service.cc:434] P 842fbe33f4144fa69f1fd428652b6998: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-f85a739decfd445aac542c70782b537d on tablet f85a739decfd445aac542c70782b537d with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:21.641543 30223 pending_rounds.cc:70] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 2 pending ops.
I20260709 12:25:21.641793 30223 pending_rounds.cc:77] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 4 } timestamp: 7305625169697894400 op_type: NO_OP noop_request { }
I20260709 12:25:21.642122 30223 raft_consensus.cc:2889] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.642386 30223 pending_rounds.cc:77] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 8 index: 3 } timestamp: 7305625113186529280 op_type: NO_OP noop_request { }
I20260709 12:25:21.643272 30223 raft_consensus.cc:2889] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.645809 30223 raft_consensus.cc:2272] T f84b503c7c204e5cb7b8dcf59fffdae6 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.688000  3301 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:21.703347  3301 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:21.725069 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:21.725220 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:21.728394  3301 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:21.730057 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:21.734876 31361 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:21.736132  3302 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:21.738349 32076 raft_consensus.cc:1217] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 12:25:21.747357 30223 tablet_replica.cc:333] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.748445 30223 raft_consensus.cc:2243] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.749630 30223 raft_consensus.cc:2272] T 46d997871e814deba55c8b52416644f9 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:21.754179 31433 consensus_peers.cc:597] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:21.771893 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:21.778218 30223 tablet_replica.cc:333] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.778286  3321 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.780205 30223 raft_consensus.cc:2243] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.780362  3321 tablet_bootstrap.cc:492] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: Bootstrap complete.
I20260709 12:25:21.781015 30223 pending_rounds.cc:70] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.781275 30223 pending_rounds.cc:77] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 5 index: 4 } timestamp: 7305624991007866880 op_type: NO_OP noop_request { }
I20260709 12:25:21.781656 30223 raft_consensus.cc:2889] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.782030 30223 raft_consensus.cc:2272] T ab7bbda785db43a8a40b2bbd07b0c97a P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.789554 30223 tablet_replica.cc:333] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.790361 30223 raft_consensus.cc:2243] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.790916 30223 pending_rounds.cc:70] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.791168 30223 pending_rounds.cc:77] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 7 index: 5 } timestamp: 7305625227353460736 op_type: NO_OP noop_request { }
I20260709 12:25:21.791554 30223 raft_consensus.cc:2889] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.791875 30223 raft_consensus.cc:2272] T 0207be23688449b2931af8e5102e206e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.794747 30223 tablet_replica.cc:333] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.781289  3321 ts_tablet_manager.cc:1403] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: Time spent bootstrapping tablet: real 0.472s	user 0.043s	sys 0.020s
I20260709 12:25:21.795714 30223 raft_consensus.cc:2243] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:21.795907 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:21.796517 30223 raft_consensus.cc:2272] T 6c4c1a36e3964960952aee6245d4560e P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.798753  3321 raft_consensus.cc:359] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:21.799660  3321 raft_consensus.cc:740] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Initialized, Role: LEARNER
I20260709 12:25:21.800312  3321 consensus_queue.cc:260] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: NON_VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: true } }
I20260709 12:25:21.802752  3321 ts_tablet_manager.cc:1434] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:21.814028 30223 tablet_replica.cc:333] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.814980 30223 raft_consensus.cc:2243] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.815670 30223 raft_consensus.cc:2272] T c179546c46da4fa98f8b4fb61f9128b2 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.818701 30223 tablet_replica.cc:333] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.827702 30223 raft_consensus.cc:2243] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.828860 30223 raft_consensus.cc:2272] T d8d8c56f099c45638ca5f2f4da38bc89 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.830350 31554 tablet_copy_service.cc:342] P b63f042a541248b88888cbd3049b38ca: Request end of tablet copy session 8d38acb9ce494ceb917c8441666104c4-1433e6dfe06d41c7addfb5462c25ef76 received from {username='slave'} at 127.0.0.1:34624
I20260709 12:25:21.830896 31554 tablet_copy_service.cc:434] P b63f042a541248b88888cbd3049b38ca: ending tablet copy session 8d38acb9ce494ceb917c8441666104c4-1433e6dfe06d41c7addfb5462c25ef76 on tablet 1433e6dfe06d41c7addfb5462c25ef76 with peer 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:21.837153 30223 tablet_replica.cc:333] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.838080 30223 raft_consensus.cc:2243] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.838718 30223 pending_rounds.cc:70] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 2 pending ops.
I20260709 12:25:21.838940 30223 pending_rounds.cc:77] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 10 } timestamp: 7305625228771663872 op_type: NO_OP noop_request { }
I20260709 12:25:21.839273 30223 raft_consensus.cc:2889] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.839537 30223 pending_rounds.cc:77] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 8 index: 9 } timestamp: 7305625158099398656 op_type: NO_OP noop_request { }
I20260709 12:25:21.839839 30223 raft_consensus.cc:2889] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.840152 30223 raft_consensus.cc:2272] T b3d5b01f306242f19825d56ac764bc69 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:21.844470 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:21.858619  3297 raft_consensus.cc:1064] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:25:21.861436  3297 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:21.868858 32076 raft_consensus.cc:1217] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:25:21.873566 30223 tablet_replica.cc:333] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.880461 30223 raft_consensus.cc:2243] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.881098 30223 pending_rounds.cc:70] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.881379 30223 pending_rounds.cc:77] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 7 } timestamp: 7305625229307404288 op_type: NO_OP noop_request { }
I20260709 12:25:21.881749 30223 raft_consensus.cc:2889] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.882145 30223 raft_consensus.cc:2272] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.896989 30223 tablet_replica.cc:333] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.897830 30223 raft_consensus.cc:2243] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.898787 30223 raft_consensus.cc:2272] T 739df497c0c147fa9da0afc2bb1c8873 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.907548 30223 tablet_replica.cc:333] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.908552 30223 raft_consensus.cc:2243] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.909229 30223 pending_rounds.cc:70] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.909586 30223 pending_rounds.cc:77] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 6 } timestamp: 7305625156911812608 op_type: NO_OP noop_request { }
I20260709 12:25:21.909987 30223 raft_consensus.cc:2889] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.910328 30223 raft_consensus.cc:2272] T f85a739decfd445aac542c70782b537d P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.913419 32076 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:21.915001  3310 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:21.915860 30223 tablet_replica.cc:333] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.916878 30223 raft_consensus.cc:2243] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.921147 31536 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:25:21.924662 31433 consensus_peers.cc:597] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:21.927371  3310 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:21.943588 30223 pending_rounds.cc:70] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 2 pending ops.
I20260709 12:25:21.943965 30223 pending_rounds.cc:77] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 10 index: 6 } timestamp: 7305625153541611520 op_type: NO_OP noop_request { }
I20260709 12:25:21.944334 30223 raft_consensus.cc:2889] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.944643 30223 pending_rounds.cc:77] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 5 } timestamp: 7305625116566786048 op_type: NO_OP noop_request { }
I20260709 12:25:21.944974 30223 raft_consensus.cc:2889] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.945371 30223 raft_consensus.cc:2272] T 796a9ec54e6448408ebf535a6f6a5d4f P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.949918  3302 raft_consensus.cc:493] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.950565  3302 raft_consensus.cc:515] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:21.953632 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:21.953806  3302 leader_election.cc:290] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:21.953984 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e95a0a4f4dca8f4b0e55fd24889e" candidate_uuid: "503bef451a2b424fa35e8e46b8c06f29" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:21.955564 31359 leader_election.cc:304] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 503bef451a2b424fa35e8e46b8c06f29; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:21.956743  3302 raft_consensus.cc:2749] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:21.965958 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:21.967736 30223 tablet_replica.cc:333] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.969723 30223 raft_consensus.cc:2243] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.970379 30223 pending_rounds.cc:70] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:21.970649 30223 pending_rounds.cc:77] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 5 } timestamp: 7305625218771361792 op_type: NO_OP noop_request { }
I20260709 12:25:21.971007 30223 raft_consensus.cc:2889] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:21.971366 30223 raft_consensus.cc:2272] T dd5214a2e2a24f0c93da1f05318d0380 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.974501 30223 tablet_replica.cc:333] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:21.981609 30223 raft_consensus.cc:2243] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.982183 30223 raft_consensus.cc:2272] T ea09d8cfad9a493ebdab9d29ceaeedfc P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.004443 30223 tablet_replica.cc:333] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.006886 30223 raft_consensus.cc:2243] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.007704 30223 raft_consensus.cc:2272] T 2673eb8b7e874dc68e3b56393a06a549 P 503bef451a2b424fa35e8e46b8c06f29 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.007843  3297 raft_consensus.cc:2955] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.012279 30223 tablet_replica.cc:333] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.013092 30223 raft_consensus.cc:2243] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.013628 30223 pending_rounds.cc:70] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 2 pending ops.
I20260709 12:25:22.013844 30223 pending_rounds.cc:77] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 10 index: 6 } timestamp: 7305625153913892864 op_type: NO_OP noop_request { }
I20260709 12:25:22.021128 31536 raft_consensus.cc:2955] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.026826 30223 raft_consensus.cc:2889] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:22.027180 30223 pending_rounds.cc:77] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 8 index: 5 } timestamp: 7305625116217454592 op_type: NO_OP noop_request { }
I20260709 12:25:22.030742 30223 raft_consensus.cc:2889] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:22.031105 30223 raft_consensus.cc:2272] T 25e1632d46704126852887ade0b97386 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.057051 32076 raft_consensus.cc:2955] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:22.063629 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.068137 31290 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca reported cstate change: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.068005 30223 tablet_replica.cc:333] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.072451 30223 raft_consensus.cc:2243] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:22.072813 31433 consensus_peers.cc:597] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.093395 30223 raft_consensus.cc:2272] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.096557 30223 tablet_replica.cc:333] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.109544 30223 raft_consensus.cc:2243] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.115746 30223 raft_consensus.cc:2272] T b13f8c8324c04c879d0aa55e41fae892 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.118611 30223 tablet_replica.cc:333] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.119421 30223 raft_consensus.cc:2243] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.126587 30223 pending_rounds.cc:70] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:22.126837 30223 pending_rounds.cc:77] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 6 } timestamp: 7305625230066802688 op_type: NO_OP noop_request { }
I20260709 12:25:22.127220 30223 raft_consensus.cc:2889] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:22.127629 30223 raft_consensus.cc:2272] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.130461 30223 tablet_replica.cc:333] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.131268 30223 raft_consensus.cc:2243] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.132040 30223 pending_rounds.cc:70] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:22.132288 30223 pending_rounds.cc:77] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 9 index: 8 } timestamp: 7305625159622238208 op_type: NO_OP noop_request { }
I20260709 12:25:22.132634 30223 raft_consensus.cc:2889] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:22.132972 30223 raft_consensus.cc:2272] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 503bef451a2b424fa35e8e46b8c06f29 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.141506 30223 tablet_replica.cc:333] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.142186 30223 raft_consensus.cc:2243] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.143307 30223 raft_consensus.cc:2272] T 41818a7a6f784af8b64045cfa65d7383 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.163517 30223 tablet_replica.cc:333] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.164319 30223 raft_consensus.cc:2243] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.165659 30223 pending_rounds.cc:70] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Trying to abort 1 pending ops.
I20260709 12:25:22.165885 30223 pending_rounds.cc:77] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29: Aborting op as it isn't in flight: id { term: 4 index: 6 } timestamp: 7305625230928662528 op_type: NO_OP noop_request { }
I20260709 12:25:22.166357 30223 raft_consensus.cc:2889] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:22.166659 30223 raft_consensus.cc:2272] T 5a413d9092d14aea9490265eb7f932db P 503bef451a2b424fa35e8e46b8c06f29 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.169250 30223 tablet_replica.cc:333] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.170014 30223 raft_consensus.cc:2243] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.170578 30223 raft_consensus.cc:2272] T 1433e6dfe06d41c7addfb5462c25ef76 P 503bef451a2b424fa35e8e46b8c06f29 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.185904 30223 tablet_replica.cc:333] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.186718 30223 raft_consensus.cc:2243] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.187304 30223 raft_consensus.cc:2272] T f717dfc5b2ba4dcf876418eb16911078 P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.189963 30223 tablet_replica.cc:333] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.190647 30223 raft_consensus.cc:2243] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:22.202692  3302 raft_consensus.cc:670] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:25:22.210290 32076 raft_consensus.cc:1217] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:25:22.210227 30223 raft_consensus.cc:2272] T 3d30d3a647c247fab04a1722a89b8818 P 503bef451a2b424fa35e8e46b8c06f29 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:22.222822 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.227288 30223 tablet_replica.cc:333] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29: stopping tablet replica
I20260709 12:25:22.228304 30223 raft_consensus.cc:2243] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.228993 30223 raft_consensus.cc:2272] T 5b00e106a7374108a1bb1bb841b5edaa P 503bef451a2b424fa35e8e46b8c06f29 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:22.241824 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:22.246454 31433 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:22.256695  3330 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.257283  3330 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:22.262411 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.263478 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
W20260709 12:25:22.263913 31507 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.264173  3311 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.263553  3330 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:22.264693  3311 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.265475 31510 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:22.266228  3339 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:22.271313  3297 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.271840  3297 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.274046  3297 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:22.279548  3310 raft_consensus.cc:1064] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:25:22.282079  3310 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:22.266932  3311 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:22.284162 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:22.286885 31469 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
W20260709 12:25:22.287400 31433 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.288910 31510 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:22.291795 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:22.292424 31536 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
I20260709 12:25:22.294588  3311 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.294952  3311 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.295370  3311 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.295640 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:22.297151  3352 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.297575  3352 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.297922  3352 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.310117  3311 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.325349 31536 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:22.311218 32076 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:22.327272  3297 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:22.328889  3310 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:22.335150  3352 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.335510 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:22.339684 31469 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 12: Already voted for candidate 842fbe33f4144fa69f1fd428652b6998 in this term.
I20260709 12:25:22.340914  3311 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:22.331142 31507 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:22.316006 31433 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.353909 31462 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:22.362721  3297 raft_consensus.cc:1064] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:25:22.365041 32083 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:22.366317  3297 consensus_queue.cc:237] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:22.366744  3349 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:22.376375  3353 raft_consensus.cc:2955] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.385062 32083 raft_consensus.cc:2955] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.391476 32078 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEARNER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:22.393851  3297 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:22.401670 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.411103  3352 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:22.424166 31292 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:22.470396 31433 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.471800 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 796a9ec54e6448408ebf535a6f6a5d4f with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:22.480103  3353 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.480672  3353 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:22.483090 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:22.494220  3353 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:22.497105  3352 raft_consensus.cc:2955] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.500321 32076 raft_consensus.cc:2955] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.525705 31292 catalog_manager.cc:5697] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:22.539700 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:22.541158 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 46402.7us
I20260709 12:25:22.555087 31542 raft_consensus.cc:1275] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:22.555058 31541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:22.556404 31536 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:22.556463 31541 raft_consensus.cc:2393] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 12: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:22.562412 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:22.563114 31544 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 13.
I20260709 12:25:22.607488 31544 raft_consensus.cc:2955] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } attrs { replace: true } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:22.616848 31507 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.617655 31507 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:22.618646  3339 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:22.627410 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 796a9ec54e6448408ebf535a6f6a5d4f: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:25:22.623505  3352 consensus_queue.cc:1048] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:25:22.633457 31433 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.652783 31469 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:22.659189  3297 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:22.659788 32076 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:22.661626 31434 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:22.663123  3297 raft_consensus.cc:2749] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:22.663816  3297 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:22.674893  3349 raft_consensus.cc:2955] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.676630 31434 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:22.677956  3353 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:22.678371  3353 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.678800  3353 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.685009 32076 raft_consensus.cc:2955] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.687173  3353 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.709499  3353 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:22.736956 31433 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.777560 31536 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:22.779512 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9371bed6dc240b6969ed373c14c9a75" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:22.780107 31542 raft_consensus.cc:3060] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.788002 31541 raft_consensus.cc:2955] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.798643 31542 raft_consensus.cc:2468] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 14.
I20260709 12:25:22.801203  3353 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.801766  3353 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:22.804764 32050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:40963, user_credentials={real_user=slave}} blocked reactor thread for 56030us
I20260709 12:25:22.814229  3369 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.814810  3369 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.817152  3369 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:22.819710  3353 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:22.827122 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.831600 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:22.832302 31465 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:22.837280 31510 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:22.841760  3364 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.842197  3364 raft_consensus.cc:493] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.842559  3364 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:22.851600 31433 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.853430  3310 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:25:22.860129 31434 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:22.860908  3352 raft_consensus.cc:2804] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:22.861419  3352 raft_consensus.cc:697] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 14 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:22.862272  3352 consensus_queue.cc:237] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.853820  3353 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.864573  3353 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.866833  3353 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:22.870087 31433 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:22.881063 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.891598 31542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:22.894059  3310 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.894627  3310 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.896720  3310 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:22.897434 31280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f85a739decfd445aac542c70782b537d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:22.895931 31541 raft_consensus.cc:2955] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:22.901721 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:22.904484 31433 leader_election.cc:336] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.904922 31536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:22.908933 31434 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:22.909731  3353 raft_consensus.cc:2749] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:22.912173  3310 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.912668  3310 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:22.915776 31434 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:22.916811  3353 raft_consensus.cc:2749] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:22.919023 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:22.920023 31433 leader_election.cc:336] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.920677 31436 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:22.921094  3310 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:22.921443  3353 raft_consensus.cc:2749] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:22.929872 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 83467.2us
I20260709 12:25:22.934147  3364 raft_consensus.cc:515] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.935367 31542 raft_consensus.cc:2393] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 842fbe33f4144fa69f1fd428652b6998 in current term 12: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
W20260709 12:25:22.934514 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:22.943385 31434 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:22.944455  3353 raft_consensus.cc:3060] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.946615 31292 catalog_manager.cc:5697] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 8 to 9, VOTER 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) evicted. New cstate: current_term: 9 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:22.949306 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:22.950613 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:22.951171 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.967902  3364 leader_election.cc:290] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:22.969688 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27460804ee284848a7cc13b9117e52c7" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:22.952251  3367 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.981734  3353 raft_consensus.cc:2749] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:22.982079 31507 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:22.995640  3364 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:22.996205  3364 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:22.998246  3364 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.000294  3310 raft_consensus.cc:2955] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:23.002504 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:23.007513 31465 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:22.978155  3367 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.009363 31510 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:23.009925  3367 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.010459  3367 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.010812  3367 raft_consensus.cc:493] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.012501  3367 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:23.013007 31277 connection.cc:573] client connection to 127.29.131.193:43521 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:25:23.010983  3366 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.011723 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:23.015854 31465 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:23.013715 31469 raft_consensus.cc:2468] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
W20260709 12:25:23.014715 31507 connection.cc:769] client connection to 127.29.131.193:43521 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 12:25:23.019547 31293 catalog_manager.cc:5697] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 13 to 14, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 14 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.021991  3330 raft_consensus.cc:1064] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: attempting to promote NON_VOTER 8d38acb9ce494ceb917c8441666104c4 to VOTER
I20260709 12:25:23.015769  3349 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.023707  3349 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.025631  3349 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:23.017078  3366 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:23.027021 31510 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:23.027922  3369 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.028287  3369 raft_consensus.cc:493] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.028651  3369 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.039412  3330 consensus_queue.cc:237] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:23.043005  3366 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.061075 32076 raft_consensus.cc:2955] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:23.070194 31540 raft_consensus.cc:2955] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:23.075311 31510 leader_election.cc:304] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:23.075555 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:23.076267 31544 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 10.
I20260709 12:25:23.077358  3364 raft_consensus.cc:2804] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:23.077888  3364 raft_consensus.cc:697] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:23.081548  3364 consensus_queue.cc:237] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.086684 31434 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:23.094702 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:23.095388 31462 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 13.
W20260709 12:25:23.098227 32047 leader_election.cc:336] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.100082 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:23.101166  3307 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:23.101562  3307 raft_consensus.cc:493] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.077970  3369 raft_consensus.cc:515] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.087548  3349 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.108505  3307 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.114207 31293 catalog_manager.cc:5697] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.123692  3367 raft_consensus.cc:515] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.125862  3367 leader_election.cc:290] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.111634  3349 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.132369  3349 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.158273  3349 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.171406  3307 raft_consensus.cc:515] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:23.173734  3307 leader_election.cc:290] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.177495  3369 leader_election.cc:290] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:23.190191 32047 leader_election.cc:336] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:23.191779 31510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:40531, user_credentials={real_user=slave}} blocked reactor thread for 79447.2us
W20260709 12:25:23.202354 31507 leader_election.cc:336] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.202652 31462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc2f1162c2a4dea82b0b11efc141c5a" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
W20260709 12:25:23.203505 31507 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.203605 31462 raft_consensus.cc:3060] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.206629 31292 catalog_manager.cc:5697] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 11 to 12, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 12 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:23.208652 31433 leader_election.cc:336] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:23.209439 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:23.212841 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069da3737bb54ce19c27f8dcaa7fdf87" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:23.213382 31467 raft_consensus.cc:3060] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.215715 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d8c56f099c45638ca5f2f4da38bc89" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:23.216301 31469 raft_consensus.cc:3060] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.222946  3310 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.223513  3310 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.227488  3310 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:23.229276 31465 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:23.231529  3365 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:23.233063 31507 leader_election.cc:336] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:23.236343 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:23.236928 31507 leader_election.cc:336] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:23.237677 31507 leader_election.cc:336] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.239486 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:23.242534 31469 raft_consensus.cc:2468] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:23.242745 31467 raft_consensus.cc:2468] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 14.
W20260709 12:25:23.247512 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:23.244922  3297 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.253127  3297 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.255746 31462 raft_consensus.cc:2468] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:23.259881 31510 leader_election.cc:304] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:23.260756  3385 raft_consensus.cc:2804] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:23.261292 31510 leader_election.cc:304] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:23.262454  3380 raft_consensus.cc:2804] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:23.262986  3380 raft_consensus.cc:697] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:23.263783  3297 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:23.263945  3380 consensus_queue.cc:237] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.261126  3349 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:23.269831 32050 leader_election.cc:304] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:23.271898 31544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d997871e814deba55c8b52416644f9" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:23.272464 31544 raft_consensus.cc:3060] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:23.274039 32048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:37233, user_credentials={real_user=slave}} blocked reactor thread for 110020us
I20260709 12:25:23.275395  3378 raft_consensus.cc:2804] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:23.261308  3385 raft_consensus.cc:697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:23.286206 31544 raft_consensus.cc:2468] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842fbe33f4144fa69f1fd428652b6998 in term 11.
W20260709 12:25:23.287892 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.288139 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:23.290519 31434 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:23.289767 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:23.299369 32076 raft_consensus.cc:1275] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEARNER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:23.295186  3297 raft_consensus.cc:2804] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:23.296182  3378 raft_consensus.cc:697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 14 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:23.300566  3297 raft_consensus.cc:697] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Becoming Leader. State: Replica: 842fbe33f4144fa69f1fd428652b6998, State: Running, Role: LEADER
I20260709 12:25:23.301280  3378 consensus_queue.cc:237] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:23.301415  3297 consensus_queue.cc:237] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.302673  3385 consensus_queue.cc:237] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:23.309336 31433 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.309845 31433 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:23.310874 31433 leader_election.cc:336] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:23.311599 31433 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.311964 31433 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:23.312673  3275 raft_consensus.cc:2749] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.314990  3349 raft_consensus.cc:2749] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.314772  3330 consensus_queue.cc:1048] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:23.321170 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:23.325158  3275 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
W20260709 12:25:23.325812 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:23.325717  3275 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.331216  3275 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:23.347195 31540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "842fbe33f4144fa69f1fd428652b6998" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:23.365657 31433 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.366159 31433 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:23.366921  3275 raft_consensus.cc:2749] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.389492 31292 catalog_manager.cc:5697] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 13 to 14, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 14 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:23.395166 31433 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:23.403611 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:23.404356 31293 catalog_manager.cc:5697] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 10 to 11, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 11 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.405704 31293 catalog_manager.cc:5697] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 10 to 11, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 11 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.410970  3330 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.411580  3330 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.413581  3330 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.415314 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:23.415933 31465 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:23.417117 31510 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:23.417909  3365 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:23.418279  3365 raft_consensus.cc:493] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.418658  3365 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.430271  3365 raft_consensus.cc:515] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:23.433358 31507 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.429352  3383 raft_consensus.cc:2955] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
I20260709 12:25:23.444885 31292 catalog_manager.cc:5697] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 reported cstate change: term changed from 10 to 11, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194). New cstate: current_term: 11 leader_uuid: "842fbe33f4144fa69f1fd428652b6998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.449568 32076 raft_consensus.cc:2955] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:23.454164 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:23.456050  3365 leader_election.cc:290] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.457579 31465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739df497c0c147fa9da0afc2bb1c8873" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:23.458217 31465 raft_consensus.cc:3060] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.468149 31290 catalog_manager.cc:5697] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:23.459605 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:23.478597  3365 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.479375 31462 raft_consensus.cc:2955] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } } }
W20260709 12:25:23.482616 31433 consensus_peers.cc:597] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.479205  3365 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.500523 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:23.501226 31467 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 9.
I20260709 12:25:23.502254 31510 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:23.503008  3367 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.503415  3367 raft_consensus.cc:493] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.503815  3367 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.504045  3365 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.517592  3367 raft_consensus.cc:515] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.519964  3367 leader_election.cc:290] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:23.490996 31507 leader_election.cc:336] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.521783 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41818a7a6f784af8b64045cfa65d7383" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:23.522356 31467 raft_consensus.cc:3060] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.523360 31540 raft_consensus.cc:1275] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 14 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:23.539505 31467 raft_consensus.cc:2468] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:23.540669 31465 raft_consensus.cc:2468] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
I20260709 12:25:23.543875 31467 raft_consensus.cc:1275] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:23.543987 31510 leader_election.cc:304] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:23.544767  3385 raft_consensus.cc:2804] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:23.544910 31510 leader_election.cc:304] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29
I20260709 12:25:23.545804  3381 raft_consensus.cc:2804] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:23.546322  3381 raft_consensus.cc:697] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:23.546799  3369 consensus_queue.cc:1048] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:23.547323  3381 consensus_queue.cc:237] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.545344  3385 raft_consensus.cc:697] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:23.552228  3385 consensus_queue.cc:237] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.555617  3330 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.556154  3330 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.558709  3349 consensus_queue.cc:1048] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:23.560037 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:23.560649 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:23.561327 31467 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:23.561401  3330 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.562605 31510 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:23.563832 31507 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.565212  3365 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:23.567435  3365 raft_consensus.cc:493] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 503bef451a2b424fa35e8e46b8c06f29)
I20260709 12:25:23.568122  3365 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:23.575944 31507 leader_election.cc:336] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:23.591315 31507 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.594095  3365 raft_consensus.cc:515] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:23.597522  3365 leader_election.cc:290] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:23.601493 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13f8c8324c04c879d0aa55e41fae892" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:23.602064 31467 raft_consensus.cc:3060] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:23.609227 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:23.609436 31507 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.615899 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:23.609238 31467 raft_consensus.cc:2468] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
I20260709 12:25:23.617781 31510 leader_election.cc:304] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:23.618571  3365 raft_consensus.cc:2804] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:23.619076  3365 raft_consensus.cc:697] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:23.619940  3365 consensus_queue.cc:237] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:23.624083 31507 leader_election.cc:336] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:23.648605 31293 catalog_manager.cc:5697] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 9 to 10, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 10 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.650468 31293 catalog_manager.cc:5697] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 11 to 12, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 12 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:23.697764 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f85a739decfd445aac542c70782b537d: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:23.742640 31507 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.745560 31469 raft_consensus.cc:1275] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:23.750902 31293 catalog_manager.cc:5697] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 11 to 12, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 12 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:23.757061 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:23.759964 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.762444  3399 log.cc:927] Time spent T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:25:23.777120 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:23.783463 31469 raft_consensus.cc:1275] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 14 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:25:23.820524 31507 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.856631 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 56545.1us
W20260709 12:25:23.851903 31433 consensus_peers.cc:597] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.803323  3364 consensus_queue.cc:1048] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:25:23.867355  3370 consensus_queue.cc:1048] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:23.870734 31465 raft_consensus.cc:1275] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:23.873706  3365 consensus_queue.cc:1048] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:23.951287 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:23.953954 31544 raft_consensus.cc:1275] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Refusing update from remote peer 842fbe33f4144fa69f1fd428652b6998: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:23.956996  3349 consensus_queue.cc:1048] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:23.960176 31469 raft_consensus.cc:1275] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:23.972002  3330 consensus_queue.cc:1048] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:23.975486 31507 consensus_peers.cc:597] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.977442 31507 consensus_peers.cc:597] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.998981 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:24.031905 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:24.045631 30223 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 31416)
I20260709 12:25:24.065801 31469 raft_consensus.cc:1275] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:24.067198  3381 consensus_queue.cc:1048] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:24.101737 31507 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:24.141345 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:24.198067 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:24.246096 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:24.249851 31469 raft_consensus.cc:1275] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:24.251497  3330 consensus_queue.cc:1048] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:24.356174 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:24.393414 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:24.395095 31433 consensus_peers.cc:597] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:24.572465 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:24.586242 31277 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 56751.2us
W20260709 12:25:24.621455 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:24.768374  3365 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.769099 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:24.768931  3365 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:24.771164  3365 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:24.773298 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998" is_pre_election: true
I20260709 12:25:24.773963 31469 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 12.
I20260709 12:25:24.775338 31510 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:24.778173  3365 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.778537  3365 raft_consensus.cc:493] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.778852  3365 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:24.791147 31507 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:24.814862  3365 raft_consensus.cc:515] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:24.818138 31469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78881770eb254ce191fad6a8664b7430" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "842fbe33f4144fa69f1fd428652b6998"
I20260709 12:25:24.818653 31469 raft_consensus.cc:3060] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.825713 31469 raft_consensus.cc:2468] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 13.
I20260709 12:25:24.826761 31510 leader_election.cc:304] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:24.827576  3383 raft_consensus.cc:2804] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:24.828100  3383 raft_consensus.cc:697] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 13 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:24.829021  3383 consensus_queue.cc:237] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:24.832548 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:24.838953 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:24.845916 31507 leader_election.cc:336] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:24.847587  3365 leader_election.cc:290] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 13 election: Requested vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:24.872316 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 796a9ec54e6448408ebf535a6f6a5d4f: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:24.884639 31293 catalog_manager.cc:5697] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 11 to 13, leader changed from 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 13 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:24.994316 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:25.013047 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:25.027770 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:25.046146 30223 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:25.144556 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:25.174813 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:25.331671 31507 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:25.332538 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:25.371778 31469 raft_consensus.cc:1275] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:25.373487  3365 consensus_queue.cc:1048] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:25.424244 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:25.434440 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:25.660159 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:25.692678 31433 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:25.701646 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:25.703531 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:25.728010 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:25.847968 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:25.910744 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:25.954686 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ab7bbda785db43a8a40b2bbd07b0c97a: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:25.960528 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:25.969980 31507 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:25.987391 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.001070 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.044757 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.046702 30223 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:26.097559 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:26.131604 31433 consensus_peers.cc:597] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.174345 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:26.181712 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.240149 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.242482 31507 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.247471 31507 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.281112 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:26.283751 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.309106 31507 consensus_peers.cc:597] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.322739 31507 consensus_peers.cc:597] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.410046 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:26.466188 31433 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111) [suppressed 498 similar messages]
W20260709 12:25:26.487896 31433 consensus_peers.cc:597] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.507465 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.641469 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.659541 31507 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:26.740051 31433 consensus_peers.cc:597] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.758529 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.778743 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.788275 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:26.906896 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:26.984359 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:26.992871 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 796a9ec54e6448408ebf535a6f6a5d4f: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:27.047168 30223 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:27.101984 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:27.109512 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:27.133050 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:27.288033 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:27.332031 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:27.334770 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:27.566805 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:27.690311 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:27.769121 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:27.849738 31507 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:27.941044 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:27.979066 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:28.017385 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:28.033768 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.047704 30223 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:28.220921 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.222398 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:28.229110 31507 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:28.231050 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:28.266418 31433 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:28.355096 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.366253 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.404093 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.450997 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:28.673229 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.677371 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.710953 31433 consensus_peers.cc:597] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:28.695812 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:28.714674 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.729106 31507 consensus_peers.cc:597] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:28.744390 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:28.763751 31507 consensus_peers.cc:597] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:28.851554 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:28.865124 31507 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:28.865428 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.917325 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:28.943396 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:28.947034 31433 consensus_peers.cc:597] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:28.948019 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:28.985484 31507 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:29.048187 30223 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:29.238497 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:29.402597 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:29.403196 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 70500.2us
W20260709 12:25:29.450878 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:29.458633 31433 consensus_peers.cc:597] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:29.471728 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:29.475281 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:29.480448 31507 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:29.497666 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:29.552703 31324 debug-util.cc:398] Leaking SignalData structure 0x7b080033b060 after lost signal to thread 30226
W20260709 12:25:29.553900 31324 debug-util.cc:398] Leaking SignalData structure 0x7b0800324940 after lost signal to thread 31327
W20260709 12:25:29.555311 31324 debug-util.cc:398] Leaking SignalData structure 0x7b0800296840 after lost signal to thread 31494
W20260709 12:25:29.556525 31324 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5680 after lost signal to thread 31568
W20260709 12:25:29.557753 31324 debug-util.cc:398] Leaking SignalData structure 0x7b080033c180 after lost signal to thread 32108
W20260709 12:25:29.563000 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:29.731987 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:29.788075 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:29.871840 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:29.995385 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:30.048691 30223 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:30.078826 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:30.097970 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ab7bbda785db43a8a40b2bbd07b0c97a: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:30.104957 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:30.201104 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:30.229269 31507 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:30.249307 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:30.266716 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:30.480556 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:30.526687 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:30.612097 31507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 55582.7us
W20260709 12:25:30.629276 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:30.710186 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:30.748958 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:30.806748 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:30.814960 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:30.821069 31507 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:30.824844 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:30.882719 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:30.933727 31433 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:31.008721 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:31.025995 31507 consensus_peers.cc:597] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:31.029385 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:31.049422 30223 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:31.134897 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 796a9ec54e6448408ebf535a6f6a5d4f: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:31.160921 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:31.231693 31507 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:31.309245 31433 consensus_peers.cc:597] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:31.311245 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:31.347577 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:31.394891 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:31.401772 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:31.408648 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:31.459563 31433 consensus_peers.cc:597] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:31.473438 31433 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260709 12:25:31.471560 31507 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:31.474489 31507 consensus_peers.cc:597] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:31.504994 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:31.598654 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:31.671362 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:31.848737 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:31.915948 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:31.928539 31433 consensus_peers.cc:597] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:31.938715 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:31.964529 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.049923 30223 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:32.044636 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.082903 31507 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:32.113471 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.150946 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:32.162479 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.438882 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.517976 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.564884 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:32.684839 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:32.685982 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.739377 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.776743 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:32.779465 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:32.901953 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:32.953687 31507 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:32.974388 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.014683 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.041818 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:33.050396 30223 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:33.148859 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.219653 31507 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:33.315162 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:33.350829 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.366870 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.473249 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:33.507531 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.541072 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.570736 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.571554 31507 consensus_peers.cc:597] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:33.720346 31507 consensus_peers.cc:597] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:33.756489 31433 consensus_peers.cc:597] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:33.775482 31433 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:33.834976 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.837670 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:33.852825 31507 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:33.880249 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.895287 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:33.917651 31433 consensus_peers.cc:597] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:33.968454 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:33.972958 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:34.013425 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:34.050877 30223 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:34.054824 31507 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:34.134735 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:34.288003 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:34.304796 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:34.323263 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:34.572319 31433 consensus_peers.cc:597] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:34.590094 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:34.615157 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:35.051381 30223 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 31416)
W20260709 12:25:35.112663 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.134991 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.135669 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.137142 31507 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:35.137069 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:35.163527 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.164186 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.164896 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.219127 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:35.432550 31433 consensus_peers.cc:597] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:35.548928 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.579425 31507 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:35.691720 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.708544 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:35.803407 31433 consensus_peers.cc:597] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:35.871344 31433 consensus_peers.cc:597] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:35.909123 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:35.911281 31507 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:35.932895 31565 debug-util.cc:398] Leaking SignalData structure 0x7b0800328e60 after lost signal to thread 30226
W20260709 12:25:35.934078 31565 debug-util.cc:398] Leaking SignalData structure 0x7b0800110980 after lost signal to thread 31327
W20260709 12:25:35.935335 31565 debug-util.cc:398] Leaking SignalData structure 0x7b08001262e0 after lost signal to thread 31494
W20260709 12:25:35.936412 31565 debug-util.cc:398] Leaking SignalData structure 0x7b08001edca0 after lost signal to thread 31568
W20260709 12:25:35.937606 31565 debug-util.cc:398] Leaking SignalData structure 0x7b08003767e0 after lost signal to thread 32108
W20260709 12:25:35.973766 31433 consensus_peers.cc:597] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:36.019459 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:36.104431 31433 consensus_peers.cc:597] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:36.130177 31507 consensus_peers.cc:597] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:36.260675 31433 consensus_peers.cc:597] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:36.273392 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:36.274951 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:36.327502 31433 consensus_peers.cc:597] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:36.411132 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:36.417601 31433 consensus_peers.cc:597] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:36.418574 31507 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:36.505358 30223 tablet_server.cc:196] TabletServer@127.29.131.193:0 shutdown complete.
W20260709 12:25:36.515108 31507 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 12:25:36.522457 31433 consensus_peers.cc:597] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:36.526971 31507 consensus_peers.cc:597] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:36.554294 31433 consensus_peers.cc:597] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:36.604907 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:36.633044 31507 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:36.636230 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:36.652436 31433 consensus_peers.cc:597] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:36.776464 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:25:36.795739 30223 tablet_server.cc:179] TabletServer@127.29.131.194:0 shutting down...
W20260709 12:25:36.821940 32050 consensus_peers.cc:597] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.878710 31510 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.885741 31510 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.887354 32050 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.905210 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:36.908854 30223 tablet_replica.cc:333] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
W20260709 12:25:36.909998 31510 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.910120 30223 raft_consensus.cc:2243] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.911888 30223 raft_consensus.cc:2272] T 78881770eb254ce191fad6a8664b7430 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:36.915577 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:36.915711 30223 tablet_replica.cc:333] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.916764 30223 raft_consensus.cc:2243] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.917533 30223 raft_consensus.cc:2272] T 9489bc7325d849ad9c1aec0189f21268 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.920439 30223 tablet_replica.cc:333] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.921433 30223 raft_consensus.cc:2243] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.922098 30223 raft_consensus.cc:2272] T 0f0ffee11de74139a74b497dea5ab8fc P 842fbe33f4144fa69f1fd428652b6998 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:36.929282 31510 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.931635 30223 tablet_replica.cc:333] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.932597 30223 raft_consensus.cc:2243] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.933719 30223 raft_consensus.cc:2272] T 720e43702af64bf89bc425bfd0ad352e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.937839 30223 tablet_replica.cc:333] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.938671 30223 raft_consensus.cc:2243] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.939348 30223 raft_consensus.cc:2272] T a542644bc5014371a0403670d46545d9 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.946153 30223 tablet_replica.cc:333] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.947011 30223 raft_consensus.cc:2243] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.947751 30223 raft_consensus.cc:2272] T 75d99c62694f427cb30f713a2843eec8 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:36.951385 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:25:36.952960 30223 tablet_replica.cc:333] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.953904 30223 raft_consensus.cc:2243] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.955475 30223 raft_consensus.cc:2272] T a052dcb61f484ed39d373e82a7245551 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.958386 30223 tablet_replica.cc:333] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.959213 30223 raft_consensus.cc:2243] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.960243 30223 raft_consensus.cc:2272] T b119c4a56bea40fb9d13fc79732c5c7f P 842fbe33f4144fa69f1fd428652b6998 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:36.966279 31510 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.967438 30223 tablet_replica.cc:333] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
W20260709 12:25:36.976945 31507 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:36.977396 30223 raft_consensus.cc:2243] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.979171 30223 raft_consensus.cc:2272] T d762e82a994f48968e08b715c9df4a7a P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.981966 30223 tablet_replica.cc:333] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.982718 30223 raft_consensus.cc:2243] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.994014 30223 raft_consensus.cc:2272] T 8a818d01cfc443aea4e12b8ef804f14c P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.996928 30223 tablet_replica.cc:333] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:36.997749 30223 raft_consensus.cc:2243] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.998489 30223 raft_consensus.cc:2272] T 564dc334ebd54aa5baeadc07e099bada P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:37.005692 31510 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.006629 31510 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.008605 32050 consensus_peers.cc:597] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.012432 31510 consensus_peers.cc:597] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.012666 30223 tablet_replica.cc:333] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
W20260709 12:25:37.013108 31510 consensus_peers.cc:597] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.013551 30223 raft_consensus.cc:2243] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.015362 30223 raft_consensus.cc:2272] T 0db923f6154349d3ba9a88713b04d088 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.018664 30223 tablet_replica.cc:333] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.019541 30223 raft_consensus.cc:2243] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.020615 30223 raft_consensus.cc:2272] T e9371bed6dc240b6969ed373c14c9a75 P 842fbe33f4144fa69f1fd428652b6998 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.023337 30223 tablet_replica.cc:333] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.024202 30223 raft_consensus.cc:2243] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.025349 30223 raft_consensus.cc:2272] T f717dfc5b2ba4dcf876418eb16911078 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.028038 30223 tablet_replica.cc:333] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.028972 30223 raft_consensus.cc:2243] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.029613 30223 raft_consensus.cc:2272] T 41818a7a6f784af8b64045cfa65d7383 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.032210 30223 tablet_replica.cc:333] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.032964 30223 raft_consensus.cc:2243] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:37.033643 32050 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.033785 30223 raft_consensus.cc:2272] T d43fc3cfb135493da75cf9bdc7debaa9 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:37.035737 32050 consensus_peers.cc:597] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.036895 31510 consensus_peers.cc:597] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.051343 30223 tablet_replica.cc:333] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.052312 30223 raft_consensus.cc:2243] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.052970 30223 raft_consensus.cc:2272] T 4d2a9a290e1f42029551de25d5a7932a P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.055896 30223 tablet_replica.cc:333] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.056703 30223 raft_consensus.cc:2243] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.057878 30223 raft_consensus.cc:2272] T 27e02f01756e4d3397cca6128df3c644 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:37.059965 31510 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.060691 30223 tablet_replica.cc:333] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.061565 30223 raft_consensus.cc:2243] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.062222 30223 raft_consensus.cc:2272] T 05d891c1ae594a36bd0f372d87b398dd P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.064885 30223 tablet_replica.cc:333] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.065686 30223 raft_consensus.cc:2243] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.066339 30223 raft_consensus.cc:2272] T f5050cffdfb1414e9bf38e82277f43bd P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.068979 30223 tablet_replica.cc:333] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
W20260709 12:25:37.068873 32050 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.069726 32050 consensus_peers.cc:597] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.071331 30223 raft_consensus.cc:2243] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:37.071482 32050 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.072203 30223 raft_consensus.cc:2272] T b13f8c8324c04c879d0aa55e41fae892 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.074941 30223 tablet_replica.cc:333] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.075803 30223 raft_consensus.cc:2243] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.076404 30223 raft_consensus.cc:2272] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.079041 30223 tablet_replica.cc:333] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.079813 30223 raft_consensus.cc:2243] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.081135 30223 raft_consensus.cc:2272] T ab7bbda785db43a8a40b2bbd07b0c97a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.083902 30223 tablet_replica.cc:333] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
W20260709 12:25:37.083994 31510 consensus_peers.cc:597] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.084749 30223 raft_consensus.cc:2243] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.085587 30223 raft_consensus.cc:2272] T dbf61ba8f0cc44ee87136dd991354c89 P 842fbe33f4144fa69f1fd428652b6998 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.088068 30223 tablet_replica.cc:333] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.088876 30223 raft_consensus.cc:2243] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.089588 30223 raft_consensus.cc:2272] T 069da3737bb54ce19c27f8dcaa7fdf87 P 842fbe33f4144fa69f1fd428652b6998 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.092391 30223 tablet_replica.cc:333] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.093145 30223 raft_consensus.cc:2243] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.093786 30223 raft_consensus.cc:2272] T f84b503c7c204e5cb7b8dcf59fffdae6 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.096309 30223 tablet_replica.cc:333] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.097082 30223 raft_consensus.cc:2243] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.097821 30223 raft_consensus.cc:2272] T 27460804ee284848a7cc13b9117e52c7 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.100419 30223 tablet_replica.cc:333] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.101197 30223 raft_consensus.cc:2243] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.102311 30223 raft_consensus.cc:2272] T 46d997871e814deba55c8b52416644f9 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.104755 30223 tablet_replica.cc:333] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.105521 30223 raft_consensus.cc:2243] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.106158 30223 raft_consensus.cc:2272] T 0207be23688449b2931af8e5102e206e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.108893 30223 tablet_replica.cc:333] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.109661 30223 raft_consensus.cc:2243] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.110775 30223 raft_consensus.cc:2272] T 1433e6dfe06d41c7addfb5462c25ef76 P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.113487 30223 tablet_replica.cc:333] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
W20260709 12:25:37.113936 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:25:37.114307 30223 raft_consensus.cc:2243] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.115646 30223 raft_consensus.cc:2272] T ea09d8cfad9a493ebdab9d29ceaeedfc P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:37.119519 31510 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.120157 31510 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.121450 30223 tablet_replica.cc:333] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.122323 30223 raft_consensus.cc:2243] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.122953 30223 raft_consensus.cc:2272] T dd5214a2e2a24f0c93da1f05318d0380 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.125842 30223 tablet_replica.cc:333] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.126585 30223 raft_consensus.cc:2243] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.127218 30223 raft_consensus.cc:2272] T 5eaea245d9414f42b05616da46574eb4 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.129876 30223 tablet_replica.cc:333] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.130661 30223 raft_consensus.cc:2243] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.131736 30223 raft_consensus.cc:2272] T 796a9ec54e6448408ebf535a6f6a5d4f P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.134582 30223 tablet_replica.cc:333] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.135390 30223 raft_consensus.cc:2243] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.136492 30223 raft_consensus.cc:2272] T f85a739decfd445aac542c70782b537d P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.140854 30223 tablet_replica.cc:333] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.141594 30223 raft_consensus.cc:2243] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.142752 30223 raft_consensus.cc:2272] T 3d30d3a647c247fab04a1722a89b8818 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.145306 30223 tablet_replica.cc:333] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.146059 30223 raft_consensus.cc:2243] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.146714 30223 raft_consensus.cc:2272] T 74b96090004c463795628c0134d8ecac P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:37.147773 32050 consensus_peers.cc:597] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.148289 31510 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.149324 30223 tablet_replica.cc:333] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.150223 30223 raft_consensus.cc:2243] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:25:37.151342 32050 consensus_peers.cc:597] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.151960 30223 raft_consensus.cc:2272] T 5b00e106a7374108a1bb1bb841b5edaa P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.154517 30223 tablet_replica.cc:333] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.155293 30223 raft_consensus.cc:2243] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.155885 30223 raft_consensus.cc:2272] T 2673eb8b7e874dc68e3b56393a06a549 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.158429 30223 tablet_replica.cc:333] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.159159 30223 raft_consensus.cc:2243] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.160809 30223 raft_consensus.cc:2272] T 25e1632d46704126852887ade0b97386 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.163481 30223 tablet_replica.cc:333] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.164287 30223 raft_consensus.cc:2243] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.164992 30223 raft_consensus.cc:2272] T a6b935bf4ae0467a9564dbd51820ce7c P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.167706 30223 tablet_replica.cc:333] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.168501 30223 raft_consensus.cc:2243] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.169148 30223 raft_consensus.cc:2272] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 842fbe33f4144fa69f1fd428652b6998 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:37.169909 32050 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.171862 30223 tablet_replica.cc:333] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.172647 30223 raft_consensus.cc:2243] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.173256 30223 raft_consensus.cc:2272] T 6c4c1a36e3964960952aee6245d4560e P 842fbe33f4144fa69f1fd428652b6998 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.175874 30223 tablet_replica.cc:333] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.176582 30223 raft_consensus.cc:2243] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.177320 30223 raft_consensus.cc:2272] T c179546c46da4fa98f8b4fb61f9128b2 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.179849 30223 tablet_replica.cc:333] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.180531 30223 raft_consensus.cc:2243] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.181114 30223 raft_consensus.cc:2272] T d8d8c56f099c45638ca5f2f4da38bc89 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.187007 30223 tablet_replica.cc:333] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.193727 30223 raft_consensus.cc:2243] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.194564 30223 raft_consensus.cc:2272] T b3d5b01f306242f19825d56ac764bc69 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.197293 30223 tablet_replica.cc:333] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.197996 30223 raft_consensus.cc:2243] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.198719 30223 raft_consensus.cc:2272] T ebc2f1162c2a4dea82b0b11efc141c5a P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.201210 30223 tablet_replica.cc:333] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.201910 30223 raft_consensus.cc:2243] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:25:37.202435 32050 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.203122 30223 raft_consensus.cc:2272] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 842fbe33f4144fa69f1fd428652b6998 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.205888 30223 tablet_replica.cc:333] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
W20260709 12:25:37.210629 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:25:37.211470 30223 raft_consensus.cc:2243] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.212167 30223 raft_consensus.cc:2272] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P 842fbe33f4144fa69f1fd428652b6998 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.215019 30223 tablet_replica.cc:333] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998: stopping tablet replica
I20260709 12:25:37.215710 30223 raft_consensus.cc:2243] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.216352 30223 raft_consensus.cc:2272] T 739df497c0c147fa9da0afc2bb1c8873 P 842fbe33f4144fa69f1fd428652b6998 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:37.236119 32050 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.240622 31507 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:37.254335 32050 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.275745 31510 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.291074 31510 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.314196 31510 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.320945 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:37.332026 31507 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:37.345420 31507 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:37.349314 31510 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.350426 31510 consensus_peers.cc:597] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.351059 31510 consensus_peers.cc:597] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.368151 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:37.444880 31507 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:37.581621 31507 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:37.624250 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:37.635082 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:37.791224 31507 consensus_peers.cc:597] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:37.919322 31507 consensus_peers.cc:597] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:37.952713 31507 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:37.996856  3463 raft_consensus.cc:493] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:37.997542  3463 raft_consensus.cc:515] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:38.004257 31507 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:38.013160  3472 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.005807  3463 leader_election.cc:290] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:38.006467  3476 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.013792  3472 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.014564  3476 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.016244  3472 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:38.017061  3476 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:38.021665 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:38.022500 31535 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 8.
W20260709 12:25:38.025126 31507 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:38.025986 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:38.027493 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:38.028070 32076 raft_consensus.cc:2468] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 8.
I20260709 12:25:38.030037  3464 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:38.030411  3464 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.030755  3464 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:38.032158 32050 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
W20260709 12:25:38.026049 31510 leader_election.cc:336] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.035374 31510 leader_election.cc:304] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.036441  3463 raft_consensus.cc:2749] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.052809 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:38.053735  3463 raft_consensus.cc:2804] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:38.054332  3463 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.054857  3463 raft_consensus.cc:3060] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:38.063586 31510 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.063195  3463 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.075791  3464 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:38.082124 31510 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.082871  3463 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:38.086462 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:38.087203 32076 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b63f042a541248b88888cbd3049b38ca in current term 9: Already voted for candidate 8d38acb9ce494ceb917c8441666104c4 in this term.
I20260709 12:25:38.093987 31510 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:38.094872  3477 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:38.097584 32050 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.100139 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e43702af64bf89bc425bfd0ad352e" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:38.100920 31535 raft_consensus.cc:2393] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d38acb9ce494ceb917c8441666104c4 in current term 9: Already voted for candidate b63f042a541248b88888cbd3049b38ca in this term.
I20260709 12:25:38.102720 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:38.104754  3378 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.112607  3477 raft_consensus.cc:493] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.113129  3463 raft_consensus.cc:493] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.113734  3463 raft_consensus.cc:515] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:38.115221 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:25:38.116011  3463 leader_election.cc:290] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:38.113131  3477 raft_consensus.cc:515] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:38.129837  3477 leader_election.cc:290] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:38.137985 31507 leader_election.cc:336] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:38.142714  3464 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:38.144699 31510 leader_election.cc:336] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.147396 31510 leader_election.cc:304] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.148890  3463 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.149580  3463 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.150974  3477 raft_consensus.cc:2749] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:38.148025 31507 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:38.154492 31510 leader_election.cc:336] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.158218 31510 leader_election.cc:304] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.158766  3477 raft_consensus.cc:493] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.159853  3477 raft_consensus.cc:515] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
W20260709 12:25:38.161631 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:25:38.162009  3477 leader_election.cc:290] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:38.156046  3463 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:38.167817 31507 leader_election.cc:336] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:38.168910  3473 raft_consensus.cc:2749] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.172004 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
I20260709 12:25:38.185952  3472 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.186780  3472 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.188910  3472 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:38.191220 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
W20260709 12:25:38.204313 31507 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:38.210556 31510 leader_election.cc:336] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.215217 31510 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998, 8d38acb9ce494ceb917c8441666104c4
I20260709 12:25:38.213258  3477 raft_consensus.cc:493] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.216318  3477 raft_consensus.cc:515] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:38.220499  3477 leader_election.cc:290] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:38.220497 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:38.221100 32050 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.227615  3463 raft_consensus.cc:2749] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:38.227845 32050 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:38.228888 31510 leader_election.cc:336] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.229332  3464 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.232591 31510 leader_election.cc:304] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.233871  3477 raft_consensus.cc:2749] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:38.244225 31507 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:38.260982 31507 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:38.264408 31510 leader_election.cc:336] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.266057 31510 leader_election.cc:304] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.266877  3477 raft_consensus.cc:2749] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.278107  3477 raft_consensus.cc:493] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.278676  3477 raft_consensus.cc:515] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:38.281024  3477 leader_election.cc:290] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:38.286597 31507 leader_election.cc:336] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:38.298807 31510 leader_election.cc:336] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.305719 31510 leader_election.cc:304] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:38.305207 31507 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:38.306967  3477 raft_consensus.cc:2749] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.320808  3477 raft_consensus.cc:493] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.321386  3477 raft_consensus.cc:515] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:38.323807  3477 leader_election.cc:290] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:38.329741 31507 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:38.342978 31510 leader_election.cc:336] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.347440 31510 leader_election.cc:304] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.348322  3477 raft_consensus.cc:2749] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:38.365420  3463 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.366012  3463 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:38.367468 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:25:38.368719  3463 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:38.370208 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ab7bbda785db43a8a40b2bbd07b0c97a: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:38.373911 31507 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:38.390939 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:38.402354 31510 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.403461 31510 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.404280  3477 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.450667  3477 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.451216  3477 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.453938  3463 raft_consensus.cc:493] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.454517  3463 raft_consensus.cc:515] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:38.456580  3463 leader_election.cc:290] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:38.460286 31510 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.465363  3477 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
W20260709 12:25:38.466049 31510 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.470935 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4" is_pre_election: true
W20260709 12:25:38.471132 31507 leader_election.cc:336] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:38.471534 32075 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 10.
I20260709 12:25:38.471642 31507 leader_election.cc:304] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.472911  3477 raft_consensus.cc:2749] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.473711  3464 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.474363  3464 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.475519 31510 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.476459  3464 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:38.478142  3463 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:38.478565  3463 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.478955  3463 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.486971  3463 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:38.490322 32047 leader_election.cc:336] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:38.496434 32050 leader_election.cc:336] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.496886 32050 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.498363  3464 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:38.502808 31507 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:38.504446  3473 raft_consensus.cc:493] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.504954  3473 raft_consensus.cc:515] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } }
I20260709 12:25:38.507014  3473 leader_election.cc:290] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
I20260709 12:25:38.508561  3463 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196:40531)
I20260709 12:25:38.512296 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796a9ec54e6448408ebf535a6f6a5d4f" candidate_uuid: "b63f042a541248b88888cbd3049b38ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d38acb9ce494ceb917c8441666104c4"
I20260709 12:25:38.512867 32075 raft_consensus.cc:3060] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:38.516924 31510 leader_election.cc:336] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.520164 32075 raft_consensus.cc:2468] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63f042a541248b88888cbd3049b38ca in term 11.
I20260709 12:25:38.526737 31510 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
W20260709 12:25:38.535414 31507 leader_election.cc:336] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:38.535918 31507 leader_election.cc:304] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.537099  3463 raft_consensus.cc:2749] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:38.538249 31510 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.539217  3463 raft_consensus.cc:2804] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:38.540489  3463 raft_consensus.cc:697] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Becoming Leader. State: Replica: b63f042a541248b88888cbd3049b38ca, State: Running, Role: LEADER
I20260709 12:25:38.541579  3463 consensus_queue.cc:237] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:38.548671 31507 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:38.561726  3472 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.562288  3472 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.566594 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1632d46704126852887ade0b97386" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:38.567178 31535 raft_consensus.cc:2468] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:38.570887  3472 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:38.584594  3378 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.585148  3378 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:38.587216  3378 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:38.588121 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca" is_pre_election: true
I20260709 12:25:38.588730 31535 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 9.
I20260709 12:25:38.589818 32048 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 
I20260709 12:25:38.590569  3378 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:38.590929  3378 raft_consensus.cc:493] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.591259  3378 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.604102  3378 raft_consensus.cc:515] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:38.609272 32050 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
W20260709 12:25:38.610072 32050 leader_election.cc:336] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
W20260709 12:25:38.617487 32050 leader_election.cc:336] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.618754  3378 leader_election.cc:290] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Requested vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:38.619073 31291 catalog_manager.cc:5697] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca reported cstate change: term changed from 10 to 11, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to b63f042a541248b88888cbd3049b38ca (127.29.131.195). New cstate: current_term: 11 leader_uuid: "b63f042a541248b88888cbd3049b38ca" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.624115 31535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a739decfd445aac542c70782b537d" candidate_uuid: "8d38acb9ce494ceb917c8441666104c4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b63f042a541248b88888cbd3049b38ca"
I20260709 12:25:38.624823 31535 raft_consensus.cc:3060] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.631520  3378 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:38.632021  3378 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:38.632143 32047 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:38.633988  3378 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
I20260709 12:25:38.634061 32047 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.636842  3378 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:38.644479 32050 leader_election.cc:336] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:38.635767 31535 raft_consensus.cc:2468] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d38acb9ce494ceb917c8441666104c4 in term 10.
I20260709 12:25:38.652802 32048 leader_election.cc:304] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4, b63f042a541248b88888cbd3049b38ca; no voters: 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.654474  3464 raft_consensus.cc:2804] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.655128  3464 raft_consensus.cc:697] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Becoming Leader. State: Replica: 8d38acb9ce494ceb917c8441666104c4, State: Running, Role: LEADER
I20260709 12:25:38.656324  3464 consensus_queue.cc:237] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:38.663348 32047 leader_election.cc:336] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:38.663807 32047 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:38.664515  3378 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:38.680506 31507 consensus_peers.cc:597] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:38.697279 31292 catalog_manager.cc:5697] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 reported cstate change: term changed from 9 to 10, leader changed from 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194) to 8d38acb9ce494ceb917c8441666104c4 (127.29.131.196). New cstate: current_term: 10 leader_uuid: "8d38acb9ce494ceb917c8441666104c4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:38.924549 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:25:38.958400 32075 raft_consensus.cc:1275] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Refusing update from remote peer b63f042a541248b88888cbd3049b38ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:38.960702  3463 consensus_queue.cc:1048] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:39.042212 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:25:39.045295 31510 consensus_peers.cc:597] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.114799 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:39.139213 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:39.172001 31510 consensus_peers.cc:597] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.178994 31507 consensus_peers.cc:597] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:39.202689 30223 tablet_server.cc:196] TabletServer@127.29.131.194:0 shutdown complete.
W20260709 12:25:39.211872 32050 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.217222 31507 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:39.263444 31539 raft_consensus.cc:1275] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Refusing update from remote peer 8d38acb9ce494ceb917c8441666104c4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:25:39.265431 32050 consensus_peers.cc:597] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.268960  3378 consensus_queue.cc:1048] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:39.280023 31507 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:39.332244 31510 consensus_peers.cc:597] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.332806 31510 consensus_peers.cc:597] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.359050 31510 consensus_peers.cc:597] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.390516 31510 consensus_peers.cc:597] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.391422 32050 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.431488 31510 consensus_peers.cc:597] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.440135 31510 consensus_peers.cc:597] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.445537 30223 tablet_server.cc:179] TabletServer@127.29.131.195:0 shutting down...
W20260709 12:25:39.459718 31277 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 82508us
W20260709 12:25:39.461617 32048 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.462265 32048 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.462973 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 796a9ec54e6448408ebf535a6f6a5d4f: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:39.491839 32050 consensus_peers.cc:597] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.493360 31510 consensus_peers.cc:597] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.493983 31510 consensus_peers.cc:597] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.512184 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:25:39.513121 31510 consensus_peers.cc:597] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.513453 30223 tablet_replica.cc:333] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.514595 30223 raft_consensus.cc:2243] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.515476 30223 raft_consensus.cc:2272] T 1a937a8e153c40d396843c808354fb5b P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.518679 30223 tablet_replica.cc:333] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.519690 30223 raft_consensus.cc:2243] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.520968 30223 raft_consensus.cc:2272] T c179546c46da4fa98f8b4fb61f9128b2 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.523865 30223 tablet_replica.cc:333] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.524915 30223 raft_consensus.cc:2243] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.526011 30223 raft_consensus.cc:2272] T 78881770eb254ce191fad6a8664b7430 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.528734 30223 tablet_replica.cc:333] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.529639 30223 raft_consensus.cc:2243] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.530401 30223 raft_consensus.cc:2272] T 18ce134725c84d9782a48f1b1cb859c0 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.533227 30223 tablet_replica.cc:333] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.534189 30223 raft_consensus.cc:2243] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.535851 30223 raft_consensus.cc:2272] T 9489bc7325d849ad9c1aec0189f21268 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.536305 31510 consensus_peers.cc:597] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.539583 30223 tablet_replica.cc:333] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
W20260709 12:25:39.540397 32050 consensus_peers.cc:597] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.540494 30223 raft_consensus.cc:2243] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.541775 30223 raft_consensus.cc:2272] T 75d99c62694f427cb30f713a2843eec8 P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.544431 30223 tablet_replica.cc:333] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.545288 30223 raft_consensus.cc:2243] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.545990 30223 raft_consensus.cc:2272] T 720e43702af64bf89bc425bfd0ad352e P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.553586 32048 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.554736 31507 consensus_peers.cc:597] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:25:39.556916 30223 tablet_replica.cc:333] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.557919 30223 raft_consensus.cc:2243] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.558728 30223 raft_consensus.cc:2272] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P b63f042a541248b88888cbd3049b38ca [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.561839 30223 tablet_replica.cc:333] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.562731 30223 raft_consensus.cc:2243] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.563481 30223 raft_consensus.cc:2272] T b119c4a56bea40fb9d13fc79732c5c7f P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.566318 30223 tablet_replica.cc:333] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.568285 30223 raft_consensus.cc:2243] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.568879 30223 raft_consensus.cc:2272] T 8a818d01cfc443aea4e12b8ef804f14c P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.571580 30223 tablet_replica.cc:333] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
W20260709 12:25:39.571542 31510 consensus_peers.cc:597] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.572928 30223 raft_consensus.cc:2243] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.574124 30223 raft_consensus.cc:2272] T 564dc334ebd54aa5baeadc07e099bada P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.588075 32050 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.598091 31510 consensus_peers.cc:597] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.598565 32047 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:25:39.599710 32047 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:25:39.601653 30223 tablet_replica.cc:333] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.603490 30223 raft_consensus.cc:2243] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.604239 30223 raft_consensus.cc:2272] T 1fc04eb7c849448bba0b8d22faf8751a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.607475 31510 consensus_peers.cc:597] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.607600 30223 tablet_replica.cc:333] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.608560 30223 raft_consensus.cc:2243] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.609752 30223 raft_consensus.cc:2272] T a052dcb61f484ed39d373e82a7245551 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.610813 32050 consensus_peers.cc:597] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.611301 32050 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.612478 30223 tablet_replica.cc:333] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.613961 30223 raft_consensus.cc:2243] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.615077 30223 raft_consensus.cc:2272] T d762e82a994f48968e08b715c9df4a7a P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.617892 30223 tablet_replica.cc:333] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.618739 30223 raft_consensus.cc:2243] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.619439 30223 raft_consensus.cc:2272] T e9371bed6dc240b6969ed373c14c9a75 P b63f042a541248b88888cbd3049b38ca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.622287 30223 tablet_replica.cc:333] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.623165 30223 raft_consensus.cc:2243] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.624445 30223 raft_consensus.cc:2272] T 17b17789440044608d6b5d4f1b95d09c P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.627686 30223 tablet_replica.cc:333] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.628823 30223 raft_consensus.cc:2243] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.629633 30223 raft_consensus.cc:2272] T f5050cffdfb1414e9bf38e82277f43bd P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.629715 31510 consensus_peers.cc:597] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.634392 32050 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.635519 30223 tablet_replica.cc:333] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.636747 30223 raft_consensus.cc:2243] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.639420 30223 raft_consensus.cc:2272] T a25b6ccdad024914a1cfccf61addaad1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.652041 30223 tablet_replica.cc:333] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.652948 30223 raft_consensus.cc:2243] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.653599 30223 raft_consensus.cc:2272] T afa2173634bd428990b41e94ec873527 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.655197 32050 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.656599 30223 tablet_replica.cc:333] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.657625 30223 raft_consensus.cc:2243] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.658769 30223 raft_consensus.cc:2272] T 4d2a9a290e1f42029551de25d5a7932a P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.660554 31510 consensus_peers.cc:597] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.661589 32048 consensus_peers.cc:597] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.662850 32048 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:39.664602 30223 tablet_replica.cc:333] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.665529 30223 raft_consensus.cc:2243] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.666385 30223 raft_consensus.cc:2272] T 27e02f01756e4d3397cca6128df3c644 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.669109 30223 tablet_replica.cc:333] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.669996 30223 raft_consensus.cc:2243] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.671146 30223 raft_consensus.cc:2272] T 41818a7a6f784af8b64045cfa65d7383 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.673951 30223 tablet_replica.cc:333] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.674889 30223 raft_consensus.cc:2243] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.675611 30223 raft_consensus.cc:2272] T d43fc3cfb135493da75cf9bdc7debaa9 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.678565 30223 tablet_replica.cc:333] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.679553 30223 raft_consensus.cc:2243] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.681180 30223 raft_consensus.cc:2272] T 2038e3170e644e7e9fb1afa87e11d993 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.683908 30223 tablet_replica.cc:333] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.684805 30223 raft_consensus.cc:2243] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.685861 30223 raft_consensus.cc:2272] T f717dfc5b2ba4dcf876418eb16911078 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.688496 30223 tablet_replica.cc:333] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.689306 30223 raft_consensus.cc:2243] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.690246 30223 raft_consensus.cc:2272] T f84b503c7c204e5cb7b8dcf59fffdae6 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.690546 32050 consensus_peers.cc:597] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.693174 30223 tablet_replica.cc:333] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.693970 30223 raft_consensus.cc:2243] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.694653 30223 raft_consensus.cc:2272] T 46d997871e814deba55c8b52416644f9 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.697328 30223 tablet_replica.cc:333] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.698053 30223 raft_consensus.cc:2243] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.699072 30223 raft_consensus.cc:2272] T dbf61ba8f0cc44ee87136dd991354c89 P b63f042a541248b88888cbd3049b38ca [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.701897 30223 tablet_replica.cc:333] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.702663 30223 raft_consensus.cc:2243] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.703766 30223 raft_consensus.cc:2272] T ab7bbda785db43a8a40b2bbd07b0c97a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.704780 32050 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.706451 30223 tablet_replica.cc:333] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.707304 30223 raft_consensus.cc:2243] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.708410 30223 raft_consensus.cc:2272] T 0207be23688449b2931af8e5102e206e P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.710719 32050 consensus_peers.cc:597] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.711158 30223 tablet_replica.cc:333] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.711959 30223 raft_consensus.cc:2243] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.713032 30223 raft_consensus.cc:2272] T 27460804ee284848a7cc13b9117e52c7 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.715512 30223 tablet_replica.cc:333] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
W20260709 12:25:39.715998 31510 consensus_peers.cc:597] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.716353 30223 raft_consensus.cc:2243] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.717602 30223 raft_consensus.cc:2272] T d8d8c56f099c45638ca5f2f4da38bc89 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.720585 30223 tablet_replica.cc:333] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.721441 30223 raft_consensus.cc:2243] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.722349 30223 raft_consensus.cc:2272] T 25e1632d46704126852887ade0b97386 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.725008 30223 tablet_replica.cc:333] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.725823 30223 raft_consensus.cc:2243] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.726460 30223 raft_consensus.cc:2272] T a6b935bf4ae0467a9564dbd51820ce7c P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.729313 30223 tablet_replica.cc:333] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.730199 30223 raft_consensus.cc:2243] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.730971 30223 raft_consensus.cc:2272] T ea09d8cfad9a493ebdab9d29ceaeedfc P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.733997 30223 tablet_replica.cc:333] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.734771 30223 raft_consensus.cc:2243] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.735996 30223 raft_consensus.cc:2272] T dd5214a2e2a24f0c93da1f05318d0380 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.738843 30223 tablet_replica.cc:333] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.739688 30223 raft_consensus.cc:2243] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.740408 30223 raft_consensus.cc:2272] T 5eaea245d9414f42b05616da46574eb4 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.746345 30223 tablet_replica.cc:333] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.747100 30223 raft_consensus.cc:2243] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.747982 30223 raft_consensus.cc:2272] T 5a413d9092d14aea9490265eb7f932db P b63f042a541248b88888cbd3049b38ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.750798 30223 tablet_replica.cc:333] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.751577 30223 raft_consensus.cc:2243] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:25:39.752108 32048 consensus_peers.cc:597] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:39.753347 30223 raft_consensus.cc:2272] T 1433e6dfe06d41c7addfb5462c25ef76 P b63f042a541248b88888cbd3049b38ca [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.754922 32048 consensus_peers.cc:597] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:39.756240 30223 tablet_replica.cc:333] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.757164 30223 raft_consensus.cc:2243] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.758361 30223 raft_consensus.cc:2272] T 0b0ab2689b6649ac9fba57f55c7cd0f1 P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.761145 30223 tablet_replica.cc:333] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.761924 30223 raft_consensus.cc:2243] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.763078 30223 raft_consensus.cc:2272] T 739df497c0c147fa9da0afc2bb1c8873 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.765635 30223 tablet_replica.cc:333] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.766398 30223 raft_consensus.cc:2243] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.767876 30223 raft_consensus.cc:2272] T ebc2f1162c2a4dea82b0b11efc141c5a P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.770334 30223 tablet_replica.cc:333] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.771121 30223 raft_consensus.cc:2243] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.772599 30223 raft_consensus.cc:2272] T 796a9ec54e6448408ebf535a6f6a5d4f P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.775928 30223 tablet_replica.cc:333] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.776751 30223 raft_consensus.cc:2243] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.777376 30223 raft_consensus.cc:2272] T f85a739decfd445aac542c70782b537d P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.780756 30223 tablet_replica.cc:333] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.781553 30223 raft_consensus.cc:2243] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.782236 30223 raft_consensus.cc:2272] T 3d30d3a647c247fab04a1722a89b8818 P b63f042a541248b88888cbd3049b38ca [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.784714 30223 tablet_replica.cc:333] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.785483 30223 raft_consensus.cc:2243] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.786435 30223 raft_consensus.cc:2272] T 74b96090004c463795628c0134d8ecac P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.788830 30223 tablet_replica.cc:333] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.789496 30223 raft_consensus.cc:2243] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.790155 30223 raft_consensus.cc:2272] T 5b00e106a7374108a1bb1bb841b5edaa P b63f042a541248b88888cbd3049b38ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.792469 30223 tablet_replica.cc:333] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
W20260709 12:25:39.793008 32048 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:39.793179 30223 raft_consensus.cc:2243] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.794262 30223 raft_consensus.cc:2272] T b13f8c8324c04c879d0aa55e41fae892 P b63f042a541248b88888cbd3049b38ca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.796764 30223 tablet_replica.cc:333] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca: stopping tablet replica
I20260709 12:25:39.797359 30223 raft_consensus.cc:2243] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:39.798347 30223 raft_consensus.cc:2272] T 4cd5e95a0a4f4dca8f4b0e55fd24889e P b63f042a541248b88888cbd3049b38ca [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.800563 32048 consensus_peers.cc:597] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.809257 32048 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.828893 32048 consensus_peers.cc:597] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.834892 32047 consensus_peers.cc:597] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:25:39.840997  3378 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.841477  3378 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:39.843622  3378 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:39.846228 32050 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.849736 32050 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
W20260709 12:25:39.850198 32048 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:39.850605 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:39.851701  3378 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:39.868232 32048 consensus_peers.cc:597] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.892216 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:39.900516 32048 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.912317 32048 consensus_peers.cc:597] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:40.047446 32047 consensus_peers.cc:597] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:25:40.042940 32050 consensus_peers.cc:597] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:40.104773  3378 raft_consensus.cc:493] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:40.105247  3378 raft_consensus.cc:515] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:40.109484  3378 leader_election.cc:290] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963)
W20260709 12:25:40.131645 32047 leader_election.cc:336] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:40.133574 32050 leader_election.cc:336] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:40.134037 32050 leader_election.cc:304] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:40.135385  3378 raft_consensus.cc:2749] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:40.352517 32047 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:25:40.448668 32047 consensus_peers.cc:597] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:25:40.457228  3378 raft_consensus.cc:493] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:40.457716  3378 raft_consensus.cc:515] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } attrs { replace: true } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:40.462059  3378 leader_election.cc:290] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:40.472728 32047 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:40.486938 32050 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:40.487684 32050 leader_election.cc:304] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:40.488471  3378 raft_consensus.cc:2749] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:40.490595  3378 raft_consensus.cc:493] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 842fbe33f4144fa69f1fd428652b6998)
I20260709 12:25:40.491091  3378 raft_consensus.cc:515] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:40.495787  3378 leader_election.cc:290] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521)
W20260709 12:25:40.503357 32047 leader_election.cc:336] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:40.510056 32048 leader_election.cc:336] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
W20260709 12:25:40.517287 32050 leader_election.cc:336] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:40.518389 32050 leader_election.cc:304] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
I20260709 12:25:40.531422  3378 raft_consensus.cc:2749] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:40.633618 32047 consensus_peers.cc:597] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:25:40.676884 32047 consensus_peers.cc:597] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:25:40.720794 32047 consensus_peers.cc:597] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:25:40.747700  3378 raft_consensus.cc:493] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:40.749972  3491 raft_consensus.cc:493] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:40.750808  3491 raft_consensus.cc:515] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:40.761435 32050 leader_election.cc:336] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:40.762818  3491 leader_election.cc:290] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:40.775527 32048 leader_election.cc:336] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
I20260709 12:25:40.777262 32048 leader_election.cc:304] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:40.780872  3491 raft_consensus.cc:2749] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:40.748890  3378 raft_consensus.cc:515] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:40.784804  3378 leader_election.cc:290] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:40.789729 32050 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
W20260709 12:25:40.792425 32047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 44909.5us
I20260709 12:25:40.794210  3491 raft_consensus.cc:493] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:40.795094  3491 raft_consensus.cc:515] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:40.800163  3491 leader_election.cc:290] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:40.808487 32048 leader_election.cc:336] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
I20260709 12:25:40.808995 32048 leader_election.cc:304] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:40.811267  3491 raft_consensus.cc:2749] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:40.814165 32048 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
W20260709 12:25:40.819787 32047 leader_election.cc:336] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:40.820290 32047 leader_election.cc:304] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:40.821395  3499 raft_consensus.cc:2749] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:40.914002  3499 raft_consensus.cc:493] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:40.914923  3499 raft_consensus.cc:515] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:40.932787 32050 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:40.936906  3491 raft_consensus.cc:493] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:40.938056  3491 raft_consensus.cc:515] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:40.941342  3491 leader_election.cc:290] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:40.948894  3499 leader_election.cc:290] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:40.966148 32048 leader_election.cc:336] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
W20260709 12:25:40.971120 32047 leader_election.cc:336] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:40.971730 32047 leader_election.cc:304] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, b63f042a541248b88888cbd3049b38ca
W20260709 12:25:40.973337 32048 leader_election.cc:336] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
I20260709 12:25:40.975374 32048 leader_election.cc:304] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:40.975975  3499 raft_consensus.cc:2749] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.977723  3499 raft_consensus.cc:2749] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:41.039681  3499 raft_consensus.cc:493] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:41.040688  3499 raft_consensus.cc:515] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "503bef451a2b424fa35e8e46b8c06f29" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43521 } } peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } attrs { replace: true } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:41.050688  3499 leader_election.cc:290] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521), 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:41.057271 32047 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:41.067827 32050 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:41.069408 32050 leader_election.cc:304] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 503bef451a2b424fa35e8e46b8c06f29, 842fbe33f4144fa69f1fd428652b6998
W20260709 12:25:41.070488 32048 leader_election.cc:336] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
I20260709 12:25:41.073745  3499 raft_consensus.cc:2749] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:41.128448  3499 raft_consensus.cc:493] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b63f042a541248b88888cbd3049b38ca)
I20260709 12:25:41.129212  3499 raft_consensus.cc:515] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
W20260709 12:25:41.137867 32048 leader_election.cc:336] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
I20260709 12:25:41.138630  3499 leader_election.cc:290] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
W20260709 12:25:41.151422 32050 leader_election.cc:336] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:41.151922 32050 leader_election.cc:304] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:41.152642  3499 raft_consensus.cc:2749] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:41.262418 32047 consensus_peers.cc:597] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:25:41.521118 32047 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111) [suppressed 665 similar messages]
W20260709 12:25:41.571213 32047 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:25:41.726012 32047 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:25:41.728477 32047 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:25:41.774668 32050 consensus_peers.cc:597] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:41.778532 30223 tablet_server.cc:196] TabletServer@127.29.131.195:0 shutdown complete.
W20260709 12:25:41.804697 32047 consensus_peers.cc:597] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:25:41.822996 32050 consensus_peers.cc:597] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:41.850993 32048 consensus_peers.cc:597] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:41.951809 30223 tablet_server.cc:179] TabletServer@127.29.131.196:0 shutting down...
W20260709 12:25:41.958282 32050 consensus_peers.cc:597] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:42.014990 32048 consensus_peers.cc:597] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:42.022694 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:42.029942 30223 tablet_replica.cc:333] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.031097 30223 raft_consensus.cc:2243] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.033124 30223 raft_consensus.cc:2272] T f85a739decfd445aac542c70782b537d P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.037289 30223 tablet_replica.cc:333] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
W20260709 12:25:42.038003 32050 consensus_peers.cc:597] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:42.038264 30223 raft_consensus.cc:2243] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.039660 30223 raft_consensus.cc:2272] T 796a9ec54e6448408ebf535a6f6a5d4f P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.043424 30223 tablet_replica.cc:333] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.044647 30223 raft_consensus.cc:2243] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.046211 30223 raft_consensus.cc:2272] T ab7bbda785db43a8a40b2bbd07b0c97a P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.049405 30223 tablet_replica.cc:333] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.050393 30223 raft_consensus.cc:2243] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.051260 30223 raft_consensus.cc:2272] T 34b617a3dcc54fb4b4d2c6cda2c6cc55 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.054495 30223 tablet_replica.cc:333] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.055392 30223 raft_consensus.cc:2243] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:25:42.056576 32048 consensus_peers.cc:597] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 -> Peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Couldn't send request to peer b63f042a541248b88888cbd3049b38ca. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:42.057051 30223 raft_consensus.cc:2272] T 05d891c1ae594a36bd0f372d87b398dd P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.060258 30223 tablet_replica.cc:333] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.061364 30223 raft_consensus.cc:2243] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.062121 30223 raft_consensus.cc:2272] T 17b17789440044608d6b5d4f1b95d09c P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.065424 30223 tablet_replica.cc:333] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.066277 30223 raft_consensus.cc:2243] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.067096 30223 raft_consensus.cc:2272] T 2038e3170e644e7e9fb1afa87e11d993 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.070715 30223 tablet_replica.cc:333] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.071568 30223 raft_consensus.cc:2243] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.073200 30223 raft_consensus.cc:2272] T 4ede0de141bd4d8aafecf4cc1902f9f3 P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.074203 32050 consensus_peers.cc:597] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:42.076599 30223 tablet_replica.cc:333] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.077685 30223 raft_consensus.cc:2243] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.078896 30223 raft_consensus.cc:2272] T 2673eb8b7e874dc68e3b56393a06a549 P 8d38acb9ce494ceb917c8441666104c4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.082067 30223 tablet_replica.cc:333] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.082870 30223 raft_consensus.cc:2243] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.084110 30223 raft_consensus.cc:2272] T f5050cffdfb1414e9bf38e82277f43bd P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.085216  3499 raft_consensus.cc:493] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.085798  3499 raft_consensus.cc:515] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "842fbe33f4144fa69f1fd428652b6998" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 40963 } } peers { permanent_uuid: "b63f042a541248b88888cbd3049b38ca" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 37233 } } peers { permanent_uuid: "8d38acb9ce494ceb917c8441666104c4" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 40531 } attrs { promote: false } }
I20260709 12:25:42.088598 30223 tablet_replica.cc:333] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.089339  3499 leader_election.cc:290] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963), b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233)
I20260709 12:25:42.089529 30223 raft_consensus.cc:2243] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.093329 30223 raft_consensus.cc:2272] T 0db923f6154349d3ba9a88713b04d088 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.095484 32050 consensus_peers.cc:597] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:42.096021 32050 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111)
I20260709 12:25:42.096408 30223 tablet_replica.cc:333] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.097289 30223 raft_consensus.cc:2243] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.098708 30223 raft_consensus.cc:2272] T a25b6ccdad024914a1cfccf61addaad1 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.101691 30223 tablet_replica.cc:333] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.102558 30223 raft_consensus.cc:2243] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:25:42.102854 32048 leader_election.cc:336] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b63f042a541248b88888cbd3049b38ca (127.29.131.195:37233): Network error: Client connection negotiation failed: client connection to 127.29.131.195:37233: connect: Connection refused (error 111)
I20260709 12:25:42.103382 32048 leader_election.cc:304] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d38acb9ce494ceb917c8441666104c4; no voters: 842fbe33f4144fa69f1fd428652b6998, b63f042a541248b88888cbd3049b38ca
I20260709 12:25:42.103884 30223 raft_consensus.cc:2272] T 1a937a8e153c40d396843c808354fb5b P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.104691  3499 raft_consensus.cc:2749] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:42.105540 32050 consensus_peers.cc:597] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:42.106863 30223 tablet_replica.cc:333] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
W20260709 12:25:42.107583 32050 consensus_peers.cc:597] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 842fbe33f4144fa69f1fd428652b6998 (127.29.131.194:40963): Couldn't send request to peer 842fbe33f4144fa69f1fd428652b6998. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:40963: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:42.107694 30223 raft_consensus.cc:2243] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.108855 30223 raft_consensus.cc:2272] T afa2173634bd428990b41e94ec873527 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.110798 30223 tablet_replica.cc:333] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.111472 30223 raft_consensus.cc:2243] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.112320 30223 raft_consensus.cc:2272] T d762e82a994f48968e08b715c9df4a7a P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.114271 30223 tablet_replica.cc:333] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.114791 30223 raft_consensus.cc:2243] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.115763 30223 raft_consensus.cc:2272] T a542644bc5014371a0403670d46545d9 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.117851 30223 tablet_replica.cc:333] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.118680 30223 raft_consensus.cc:2243] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.119712 30223 raft_consensus.cc:2272] T 9489bc7325d849ad9c1aec0189f21268 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.121614 30223 tablet_replica.cc:333] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.122136 30223 raft_consensus.cc:2243] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.122843 30223 raft_consensus.cc:2272] T 1433e6dfe06d41c7addfb5462c25ef76 P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.124833 30223 tablet_replica.cc:333] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.125352 30223 raft_consensus.cc:2243] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.126264 30223 raft_consensus.cc:2272] T 5a413d9092d14aea9490265eb7f932db P 8d38acb9ce494ceb917c8441666104c4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.128300 30223 tablet_replica.cc:333] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.128803 30223 raft_consensus.cc:2243] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.129760 30223 raft_consensus.cc:2272] T b3d5b01f306242f19825d56ac764bc69 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.131721 30223 tablet_replica.cc:333] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.132252 30223 raft_consensus.cc:2243] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.133179 30223 raft_consensus.cc:2272] T 6c4c1a36e3964960952aee6245d4560e P 8d38acb9ce494ceb917c8441666104c4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.135151 30223 tablet_replica.cc:333] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.135718 30223 raft_consensus.cc:2243] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.136623 30223 raft_consensus.cc:2272] T 18ce134725c84d9782a48f1b1cb859c0 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.138484 30223 tablet_replica.cc:333] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.138999 30223 raft_consensus.cc:2243] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.139496 30223 raft_consensus.cc:2272] T dbf61ba8f0cc44ee87136dd991354c89 P 8d38acb9ce494ceb917c8441666104c4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.141206 30223 tablet_replica.cc:333] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.141728 30223 raft_consensus.cc:2243] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.142633 30223 raft_consensus.cc:2272] T a6b935bf4ae0467a9564dbd51820ce7c P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.144598 30223 tablet_replica.cc:333] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.145196 30223 raft_consensus.cc:2243] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.146252 30223 raft_consensus.cc:2272] T 74b96090004c463795628c0134d8ecac P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.148093 30223 tablet_replica.cc:333] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.148635 30223 raft_consensus.cc:2243] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.149675 30223 raft_consensus.cc:2272] T d43fc3cfb135493da75cf9bdc7debaa9 P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.151721 30223 tablet_replica.cc:333] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.152415 30223 raft_consensus.cc:2243] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.153483 30223 raft_consensus.cc:2272] T fcbeeb8bf3c34f9fad2c9e7cfc641146 P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.155993 30223 tablet_replica.cc:333] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.156638 30223 raft_consensus.cc:2243] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:25:42.156714 32047 consensus_peers.cc:597] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 -> Peer 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): Couldn't send request to peer 503bef451a2b424fa35e8e46b8c06f29. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:42.157761 30223 raft_consensus.cc:2272] T 5eaea245d9414f42b05616da46574eb4 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.159816 30223 tablet_replica.cc:333] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.160337 30223 raft_consensus.cc:2243] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.161264 30223 raft_consensus.cc:2272] T 069da3737bb54ce19c27f8dcaa7fdf87 P 8d38acb9ce494ceb917c8441666104c4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.163187 30223 tablet_replica.cc:333] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.163825 30223 raft_consensus.cc:2243] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.164433 30223 raft_consensus.cc:2272] T 25e1632d46704126852887ade0b97386 P 8d38acb9ce494ceb917c8441666104c4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.166579 30223 tablet_replica.cc:333] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.167040 30223 raft_consensus.cc:2243] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.167501 30223 raft_consensus.cc:2272] T 720e43702af64bf89bc425bfd0ad352e P 8d38acb9ce494ceb917c8441666104c4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.169340 30223 tablet_replica.cc:333] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.169826 30223 raft_consensus.cc:2243] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.170743 30223 raft_consensus.cc:2272] T 1fc04eb7c849448bba0b8d22faf8751a P 8d38acb9ce494ceb917c8441666104c4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.172710 30223 tablet_replica.cc:333] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4: stopping tablet replica
I20260709 12:25:42.173147 30223 raft_consensus.cc:2243] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.174072 30223 raft_consensus.cc:2272] T 0f0ffee11de74139a74b497dea5ab8fc P 8d38acb9ce494ceb917c8441666104c4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.545670 30223 tablet_server.cc:196] TabletServer@127.29.131.196:0 shutdown complete.
I20260709 12:25:42.605687 30223 master.cc:562] Master@127.29.131.254:36201 shutting down...
W20260709 12:25:42.654894 31341 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:25:42.655402 31341 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:25:42.655680 31341 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:25:54.780450 31277 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111) [suppressed 56 similar messages]
W20260709 12:25:54.784072 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ab7bbda785db43a8a40b2bbd07b0c97a: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
W20260709 12:25:55.866812 31277 catalog_manager.cc:4755] TS 503bef451a2b424fa35e8e46b8c06f29 (127.29.131.193:43521): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 796a9ec54e6448408ebf535a6f6a5d4f: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43521: connect: Connection refused (error 111)
I20260709 12:25:59.666549 30223 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.668064 30223 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.668448 30223 tablet_replica.cc:333] T 00000000000000000000000000000000 P 893a35e10f7f42ceb588211d8d9ba07f: stopping tablet replica
I20260709 12:25:59.816774 30223 master.cc:584] Master@127.29.131.254:36201 shutdown complete.
I20260709 12:25:59.871011 30223 test_util.cc:182] -----------------------------------------------
I20260709 12:25:59.871287 30223 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599722576063-30223-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (173346 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:25:59.874832 30223 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.131.254:37927
I20260709 12:25:59.876034 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:59.881971  3509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:59.882021  3508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:59.883139  3511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:59.884042 30223 server_base.cc:1061] running on GCE node
I20260709 12:25:59.886454 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:59.886636 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:59.886750 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599959886740 us; error 0 us; skew 500 ppm
I20260709 12:25:59.887209 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:59.889621 30223 webserver.cc:533] Webserver started at http://127.29.131.254:43415/ using document root <none> and password file <none>
I20260709 12:25:59.890072 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:59.890232 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:59.890493 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:59.891875 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/master-0-root/instance:
uuid: "25d93ee0e30a4073a1f48aef29ef7a23"
format_stamp: "Formatted at 2026-07-09 12:25:59 on dist-test-slave-n640"
I20260709 12:25:59.896571 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:25:59.900099  3516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:59.900885 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:59.901193 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/master-0-root
uuid: "25d93ee0e30a4073a1f48aef29ef7a23"
format_stamp: "Formatted at 2026-07-09 12:25:59 on dist-test-slave-n640"
I20260709 12:25:59.901477 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:59.916877 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:59.918579 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:59.959890 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.254:37927
I20260709 12:25:59.959995  3567 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.254:37927 every 8 connection(s)
I20260709 12:25:59.964289  3568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:59.975395  3568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23: Bootstrap starting.
I20260709 12:25:59.980365  3568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.984753  3568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23: No bootstrap required, opened a new log
I20260709 12:25:59.986960  3568 raft_consensus.cc:359] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25d93ee0e30a4073a1f48aef29ef7a23" member_type: VOTER }
I20260709 12:25:59.987473  3568 raft_consensus.cc:385] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.987654  3568 raft_consensus.cc:740] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d93ee0e30a4073a1f48aef29ef7a23, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.988171  3568 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25d93ee0e30a4073a1f48aef29ef7a23" member_type: VOTER }
I20260709 12:25:59.988584  3568 raft_consensus.cc:399] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:59.988790  3568 raft_consensus.cc:493] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:59.989001  3568 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.993724  3568 raft_consensus.cc:515] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25d93ee0e30a4073a1f48aef29ef7a23" member_type: VOTER }
I20260709 12:25:59.994200  3568 leader_election.cc:304] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25d93ee0e30a4073a1f48aef29ef7a23; no voters: 
I20260709 12:25:59.995307  3568 leader_election.cc:290] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:59.995733  3571 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.997157  3571 raft_consensus.cc:697] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 1 LEADER]: Becoming Leader. State: Replica: 25d93ee0e30a4073a1f48aef29ef7a23, State: Running, Role: LEADER
I20260709 12:25:59.998144  3571 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25d93ee0e30a4073a1f48aef29ef7a23" member_type: VOTER }
I20260709 12:25:59.998446  3568 sys_catalog.cc:565] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:00.005071  3573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25d93ee0e30a4073a1f48aef29ef7a23. Latest consensus state: current_term: 1 leader_uuid: "25d93ee0e30a4073a1f48aef29ef7a23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25d93ee0e30a4073a1f48aef29ef7a23" member_type: VOTER } }
I20260709 12:26:00.004902  3572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25d93ee0e30a4073a1f48aef29ef7a23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25d93ee0e30a4073a1f48aef29ef7a23" member_type: VOTER } }
I20260709 12:26:00.005813  3573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:00.005885  3572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:00.007925  3579 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:00.013805  3579 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:00.015373 30223 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:00.022701  3579 catalog_manager.cc:1383] Generated new cluster ID: 417e8f1dbfaf4f798c1fa3faea5fe2ea
I20260709 12:26:00.022990  3579 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:00.036245  3579 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:00.037508  3579 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:00.061646  3579 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23: Generated new TSK 0
I20260709 12:26:00.062287  3579 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:00.082077 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:00.088482  3589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.090045  3590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.092110  3592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.092710 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:00.094868 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:00.095103 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:00.095314 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599960095296 us; error 0 us; skew 500 ppm
I20260709 12:26:00.095968 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:00.098306 30223 webserver.cc:533] Webserver started at http://127.29.131.193:41357/ using document root <none> and password file <none>
I20260709 12:26:00.098795 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:00.099004 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:00.099341 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:00.100643 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/instance:
uuid: "a423544d890d41e7870787a3a92aaf58"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:00.105835 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:26:00.109297  3597 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.110105 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:00.110407 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "a423544d890d41e7870787a3a92aaf58"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:00.110718 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:00.129570 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:00.130808 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:00.132392 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:00.134740 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:00.134958 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.135197 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:00.135447 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:26:00.179010 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:42391
I20260709 12:26:00.179126  3659 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:42391 every 8 connection(s)
I20260709 12:26:00.184840 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:00.193145  3664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.193797  3665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.197300  3668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.199204  3660 heartbeater.cc:344] Connected to a master server at 127.29.131.254:37927
I20260709 12:26:00.199571 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:00.199697  3660 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:00.200822  3660 heartbeater.cc:507] Master 127.29.131.254:37927 requested a full tablet report, sending...
I20260709 12:26:00.202034 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:00.202355 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:00.202582 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599960202563 us; error 0 us; skew 500 ppm
I20260709 12:26:00.203300 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:00.203557  3533 ts_manager.cc:194] Registered new tserver with Master: a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:00.205823 30223 webserver.cc:533] Webserver started at http://127.29.131.194:42379/ using document root <none> and password file <none>
I20260709 12:26:00.206008  3533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51898
I20260709 12:26:00.206521 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:00.206804 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:00.207079 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:00.208523 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/instance:
uuid: "051d745694ff46a5a8911cb9e20adf3f"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:00.213435 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:26:00.217128  3672 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.217876 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:26:00.218200 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-1-root
uuid: "051d745694ff46a5a8911cb9e20adf3f"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:00.218489 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:00.230490 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:00.231786 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:00.233177 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:00.235404 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:00.235622 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.235860 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:00.236028 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.276017 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.194:41805
I20260709 12:26:00.276227  3734 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.194:41805 every 8 connection(s)
I20260709 12:26:00.281558 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:00.289242  3739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.290679  3741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.290927  3738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.291721 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:00.292901 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:00.293133 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:00.293332 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599960293297 us; error 0 us; skew 500 ppm
I20260709 12:26:00.294037 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:00.295730  3735 heartbeater.cc:344] Connected to a master server at 127.29.131.254:37927
I20260709 12:26:00.296078  3735 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:00.296844 30223 webserver.cc:533] Webserver started at http://127.29.131.195:41355/ using document root <none> and password file <none>
I20260709 12:26:00.297042  3735 heartbeater.cc:507] Master 127.29.131.254:37927 requested a full tablet report, sending...
I20260709 12:26:00.297417 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:00.297684 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:00.297953 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:00.299216  3533 ts_manager.cc:194] Registered new tserver with Master: 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:00.299667 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/instance:
uuid: "19f38997c19c4127b1162e94bf40b902"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:00.301105  3533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51902
I20260709 12:26:00.305250 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:26:00.308773  3746 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.309679 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:26:00.309971 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-2-root
uuid: "19f38997c19c4127b1162e94bf40b902"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:00.310201 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:00.327498 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:00.328693 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:00.330122 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:00.332430 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:00.332638 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.332912 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:00.333055 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.375748 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.195:36779
I20260709 12:26:00.375862  3808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.195:36779 every 8 connection(s)
I20260709 12:26:00.380766 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:00.387907  3812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.391083  3813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.398368 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:00.398761  3809 heartbeater.cc:344] Connected to a master server at 127.29.131.254:37927
W20260709 12:26:00.398661  3815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.399506  3809 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:00.400527 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:00.400874 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:00.400837  3809 heartbeater.cc:507] Master 127.29.131.254:37927 requested a full tablet report, sending...
I20260709 12:26:00.401328 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599960401306 us; error 0 us; skew 500 ppm
I20260709 12:26:00.402213 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:00.403683  3533 ts_manager.cc:194] Registered new tserver with Master: 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:00.405248 30223 webserver.cc:533] Webserver started at http://127.29.131.196:42955/ using document root <none> and password file <none>
I20260709 12:26:00.405776  3533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51912
I20260709 12:26:00.405985 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:00.406369 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:00.406666 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:00.408131 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-3-root/instance:
uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:00.413841 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:26:00.417534  3820 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.418407 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:00.418784 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-3-root
uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:00.419052 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:00.439389 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:00.440687 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:00.442188 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:00.444528 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:00.444710 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.444994 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:00.445132 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.489447 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.196:38747
I20260709 12:26:00.489542  3882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.196:38747 every 8 connection(s)
I20260709 12:26:00.503782  3883 heartbeater.cc:344] Connected to a master server at 127.29.131.254:37927
I20260709 12:26:00.504240  3883 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:00.505126  3883 heartbeater.cc:507] Master 127.29.131.254:37927 requested a full tablet report, sending...
I20260709 12:26:00.507332  3533 ts_manager.cc:194] Registered new tserver with Master: 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:00.507762 30223 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014908571s
I20260709 12:26:00.509085  3533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51922
I20260709 12:26:00.535953  3533 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51930:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:26:00.816721  3625 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2959359ba431d92762be286820259 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:00.817515  3622 tablet_service.cc:1511] Processing CreateTablet for tablet 34c5bf947f1b451a8b65819c4700b91a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:00.817637  3624 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba6adad7c22449a8dfb5592173972d1 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:00.816722  3623 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8454c8322445ccac78d42179633d56 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:00.821416  3625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2959359ba431d92762be286820259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.822520  3621 tablet_service.cc:1511] Processing CreateTablet for tablet e30c018ecf2b4878a97e2a3a13d2a260 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:00.823792  3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8454c8322445ccac78d42179633d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.825464  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c5bf947f1b451a8b65819c4700b91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.827186  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba6adad7c22449a8dfb5592173972d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.828758  3774 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2959359ba431d92762be286820259 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:00.828986  3620 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9268ae2fd54d36b9af1530c630e41a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:00.830348  3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2959359ba431d92762be286820259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.831777  3620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9268ae2fd54d36b9af1530c630e41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.832450  3621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30c018ecf2b4878a97e2a3a13d2a260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.835458  3619 tablet_service.cc:1511] Processing CreateTablet for tablet 14ccc6a9ef1244c1a196f31efb3d727b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:00.836987  3619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ccc6a9ef1244c1a196f31efb3d727b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.841456  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 57c2564f8ed8426c86a221202e92fec9 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:00.843008  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c2564f8ed8426c86a221202e92fec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.851107  3617 tablet_service.cc:1511] Processing CreateTablet for tablet 306d9965a9184c46bbcc8fb8b12d0887 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:00.852607  3617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306d9965a9184c46bbcc8fb8b12d0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.857213  3773 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8454c8322445ccac78d42179633d56 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:00.858716  3773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8454c8322445ccac78d42179633d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.859138  3770 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9268ae2fd54d36b9af1530c630e41a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:00.862924  3769 tablet_service.cc:1511] Processing CreateTablet for tablet db1ec401d95f483b988f72f1db907352 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:00.860612  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9268ae2fd54d36b9af1530c630e41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.864180  3771 tablet_service.cc:1511] Processing CreateTablet for tablet 34c5bf947f1b451a8b65819c4700b91a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:00.865556  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c5bf947f1b451a8b65819c4700b91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.862962  3772 tablet_service.cc:1511] Processing CreateTablet for tablet 609c12edc1ed4c239ab26204b6a14f54 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:00.868708  3772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609c12edc1ed4c239ab26204b6a14f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.862957  3768 tablet_service.cc:1511] Processing CreateTablet for tablet 14ccc6a9ef1244c1a196f31efb3d727b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:00.877640  3769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1ec401d95f483b988f72f1db907352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.880077  3768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ccc6a9ef1244c1a196f31efb3d727b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.917550  3767 tablet_service.cc:1511] Processing CreateTablet for tablet 306d9965a9184c46bbcc8fb8b12d0887 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:00.920549  3767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306d9965a9184c46bbcc8fb8b12d0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.917552  3616 tablet_service.cc:1511] Processing CreateTablet for tablet 82eee5011c1e428baf96889e563c5913 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:00.923389  3766 tablet_service.cc:1511] Processing CreateTablet for tablet 61b8f4bd05ad4d3bb5289e38f6ba5a61 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:00.924911  3766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b8f4bd05ad4d3bb5289e38f6ba5a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.925060  3616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82eee5011c1e428baf96889e563c5913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.945412  3765 tablet_service.cc:1511] Processing CreateTablet for tablet 82eee5011c1e428baf96889e563c5913 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:00.946806  3847 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8454c8322445ccac78d42179633d56 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:00.945397  3848 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba6adad7c22449a8dfb5592173972d1 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:00.948475  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8454c8322445ccac78d42179633d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.949314  3765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82eee5011c1e428baf96889e563c5913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.950004  3846 tablet_service.cc:1511] Processing CreateTablet for tablet 609c12edc1ed4c239ab26204b6a14f54 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:00.952354  3845 tablet_service.cc:1511] Processing CreateTablet for tablet e30c018ecf2b4878a97e2a3a13d2a260 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:00.954815  3844 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9268ae2fd54d36b9af1530c630e41a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:00.957163  3843 tablet_service.cc:1511] Processing CreateTablet for tablet db1ec401d95f483b988f72f1db907352 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:00.959602  3842 tablet_service.cc:1511] Processing CreateTablet for tablet 57c2564f8ed8426c86a221202e92fec9 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:00.961984  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 306d9965a9184c46bbcc8fb8b12d0887 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:00.966665  3840 tablet_service.cc:1511] Processing CreateTablet for tablet 61b8f4bd05ad4d3bb5289e38f6ba5a61 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:00.969079  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 34086c6e095d4c1db4b41a140eb4db42 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:00.972242  3903 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:00.974102  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34086c6e095d4c1db4b41a140eb4db42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.974988  3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609c12edc1ed4c239ab26204b6a14f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.975838  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1ec401d95f483b988f72f1db907352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.976661  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b8f4bd05ad4d3bb5289e38f6ba5a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.979693  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306d9965a9184c46bbcc8fb8b12d0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.980520  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9268ae2fd54d36b9af1530c630e41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.987594  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba6adad7c22449a8dfb5592173972d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.988463  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30c018ecf2b4878a97e2a3a13d2a260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.991842  3842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c2564f8ed8426c86a221202e92fec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.002135  3771 tablet_service.cc:1511] Processing CreateTablet for tablet a1a72b5e7b494de79530011f65394787 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:01.005496  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 34086c6e095d4c1db4b41a140eb4db42 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:01.006883  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34086c6e095d4c1db4b41a140eb4db42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:01.011430  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:01.030732  3700 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2959359ba431d92762be286820259 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:01.031193  3699 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba6adad7c22449a8dfb5592173972d1 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:01.032943  3699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba6adad7c22449a8dfb5592173972d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.033608  3692 tablet_service.cc:1511] Processing CreateTablet for tablet 61b8f4bd05ad4d3bb5289e38f6ba5a61 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:01.036628  3698 tablet_service.cc:1511] Processing CreateTablet for tablet 609c12edc1ed4c239ab26204b6a14f54 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:01.037102  3691 tablet_service.cc:1511] Processing CreateTablet for tablet 82eee5011c1e428baf96889e563c5913 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:01.035084  3692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b8f4bd05ad4d3bb5289e38f6ba5a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.039208  3697 tablet_service.cc:1511] Processing CreateTablet for tablet 34c5bf947f1b451a8b65819c4700b91a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:01.040627  3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c5bf947f1b451a8b65819c4700b91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.044541  3696 tablet_service.cc:1511] Processing CreateTablet for tablet e30c018ecf2b4878a97e2a3a13d2a260 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:01.045928  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30c018ecf2b4878a97e2a3a13d2a260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.048539  3695 tablet_service.cc:1511] Processing CreateTablet for tablet db1ec401d95f483b988f72f1db907352 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:01.049962  3695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1ec401d95f483b988f72f1db907352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.052728  3694 tablet_service.cc:1511] Processing CreateTablet for tablet 14ccc6a9ef1244c1a196f31efb3d727b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:01.054096  3694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ccc6a9ef1244c1a196f31efb3d727b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.056505  3693 tablet_service.cc:1511] Processing CreateTablet for tablet 57c2564f8ed8426c86a221202e92fec9 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:01.057942  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c2564f8ed8426c86a221202e92fec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.063436  3774 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad37609bcd442cc90fc2ca70381c4b1 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:01.067584  3624 tablet_service.cc:1511] Processing CreateTablet for tablet a1a72b5e7b494de79530011f65394787 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:01.069056  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a72b5e7b494de79530011f65394787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.074273  3622 tablet_service.cc:1511] Processing CreateTablet for tablet 97a9c64911b442eda89bd4c07b1e6d86 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:01.079793  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a72b5e7b494de79530011f65394787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.084555  3691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82eee5011c1e428baf96889e563c5913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.085857  3700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2959359ba431d92762be286820259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.087723  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609c12edc1ed4c239ab26204b6a14f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.098062  3904 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:01.105397  3904 tablet_bootstrap.cc:654] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.123607  3903 tablet_bootstrap.cc:700] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902: Time spent opening tablet: real 0.137s	user 0.000s	sys 0.004s
I20260709 12:26:01.159875  3903 tablet_bootstrap.cc:654] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.127751  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a9c64911b442eda89bd4c07b1e6d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.127832  3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad37609bcd442cc90fc2ca70381c4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.148681  3619 tablet_service.cc:1511] Processing CreateTablet for tablet c4c991e10e24485baedfe7c04d91c638 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:01.144245  3697 tablet_service.cc:1511] Processing CreateTablet for tablet 34086c6e095d4c1db4b41a140eb4db42 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:01.164413  3770 tablet_service.cc:1511] Processing CreateTablet for tablet 97a9c64911b442eda89bd4c07b1e6d86 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:01.175776  3695 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad37609bcd442cc90fc2ca70381c4b1 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:01.177326  3695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad37609bcd442cc90fc2ca70381c4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.189988  3844 tablet_service.cc:1511] Processing CreateTablet for tablet a1a72b5e7b494de79530011f65394787 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:01.191567  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a9c64911b442eda89bd4c07b1e6d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.193220  3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34086c6e095d4c1db4b41a140eb4db42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.203459  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad37609bcd442cc90fc2ca70381c4b1 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:01.211802  3660 heartbeater.cc:499] Master 127.29.131.254:37927 was elected leader, sending a full tablet report...
I20260709 12:26:01.211992  3905 tablet_bootstrap.cc:492] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:01.213122  3619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c991e10e24485baedfe7c04d91c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.209434  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a72b5e7b494de79530011f65394787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.220062  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad37609bcd442cc90fc2ca70381c4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.224215  3695 tablet_service.cc:1511] Processing CreateTablet for tablet 97a9c64911b442eda89bd4c07b1e6d86 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:01.221402  3698 tablet_service.cc:1511] Processing CreateTablet for tablet c4c991e10e24485baedfe7c04d91c638 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:01.226051  3695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a9c64911b442eda89bd4c07b1e6d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.228662  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c991e10e24485baedfe7c04d91c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.229650  3904 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:01.230242  3904 ts_tablet_manager.cc:1403] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.133s	user 0.003s	sys 0.010s
I20260709 12:26:01.232415  3905 tablet_bootstrap.cc:654] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.232708  3903 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:01.233218  3903 ts_tablet_manager.cc:1403] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.261s	user 0.006s	sys 0.007s
I20260709 12:26:01.237118  3903 raft_consensus.cc:359] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.238227  3903 raft_consensus.cc:385] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.238597  3903 raft_consensus.cc:740] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.239535  3903 consensus_queue.cc:260] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.243371  3906 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:01.248122  3843 tablet_service.cc:1511] Processing CreateTablet for tablet c4c991e10e24485baedfe7c04d91c638 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:01.249450  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c991e10e24485baedfe7c04d91c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.249984  3904 raft_consensus.cc:359] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.253188  3848 tablet_service.cc:1511] Processing CreateTablet for tablet e10e736dd5544291bdec126ebb6bcea2 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:01.255645  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10e736dd5544291bdec126ebb6bcea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.257191  3624 tablet_service.cc:1511] Processing CreateTablet for tablet e10e736dd5544291bdec126ebb6bcea2 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:01.258522  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10e736dd5544291bdec126ebb6bcea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.240547  3771 tablet_service.cc:1511] Processing CreateTablet for tablet e10e736dd5544291bdec126ebb6bcea2 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:01.268532  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10e736dd5544291bdec126ebb6bcea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.250970  3904 raft_consensus.cc:385] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.284811  3770 tablet_service.cc:1511] Processing CreateTablet for tablet c3e785fdbe084aef961fc9cf1821b023 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:01.286728  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e785fdbe084aef961fc9cf1821b023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.278790  3904 raft_consensus.cc:740] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.288445  3904 consensus_queue.cc:260] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.307085  3735 heartbeater.cc:499] Master 127.29.131.254:37927 was elected leader, sending a full tablet report...
I20260709 12:26:01.307608  3809 heartbeater.cc:499] Master 127.29.131.254:37927 was elected leader, sending a full tablet report...
I20260709 12:26:01.319496  3624 tablet_service.cc:1511] Processing CreateTablet for tablet a51088fec97844cc94645e93babc0f1a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:01.321246  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51088fec97844cc94645e93babc0f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.324373  3903 ts_tablet_manager.cc:1434] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.027s
I20260709 12:26:01.325587  3903 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:01.334821  3697 tablet_service.cc:1511] Processing CreateTablet for tablet a51088fec97844cc94645e93babc0f1a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:01.335472  3904 ts_tablet_manager.cc:1434] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.105s	user 0.011s	sys 0.015s
I20260709 12:26:01.336423  3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51088fec97844cc94645e93babc0f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.342392  3841 tablet_service.cc:1511] Processing CreateTablet for tablet a1bfda24e32c4fd597a2a4aad2ca9d23 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:01.344486  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bfda24e32c4fd597a2a4aad2ca9d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.350857  3622 tablet_service.cc:1511] Processing CreateTablet for tablet a1bfda24e32c4fd597a2a4aad2ca9d23 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:01.352368  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bfda24e32c4fd597a2a4aad2ca9d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.358573  3909 raft_consensus.cc:493] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.359215  3909 raft_consensus.cc:515] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.314879  3693 tablet_service.cc:1511] Processing CreateTablet for tablet c3e785fdbe084aef961fc9cf1821b023 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:01.367358  3771 tablet_service.cc:1511] Processing CreateTablet for tablet a51088fec97844cc94645e93babc0f1a (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:01.368227  3696 tablet_service.cc:1511] Processing CreateTablet for tablet a1bfda24e32c4fd597a2a4aad2ca9d23 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:01.368701  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51088fec97844cc94645e93babc0f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.370338  3904 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:01.377918  3848 tablet_service.cc:1511] Processing CreateTablet for tablet c3e785fdbe084aef961fc9cf1821b023 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:01.379359  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e785fdbe084aef961fc9cf1821b023. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:01.380623  3810 tablet.cc:2406] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:01.381052  3909 leader_election.cc:290] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:01.388899  3770 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8e3462410045018dfb0c45ce4ac3bf (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:01.390618  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8e3462410045018dfb0c45ce4ac3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.394634  3905 tablet_bootstrap.cc:492] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:01.395288  3905 ts_tablet_manager.cc:1403] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.184s	user 0.021s	sys 0.012s
I20260709 12:26:01.395515  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e785fdbe084aef961fc9cf1821b023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.398810  3903 tablet_bootstrap.cc:654] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.399564  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bfda24e32c4fd597a2a4aad2ca9d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.398516  3905 raft_consensus.cc:359] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:01.406693  3905 raft_consensus.cc:385] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.388860  3906 tablet_bootstrap.cc:654] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.407119  3905 raft_consensus.cc:740] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.421276  3904 tablet_bootstrap.cc:654] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.415895  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8e3462410045018dfb0c45ce4ac3bf (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:01.415891  3905 consensus_queue.cc:260] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:01.421093  3698 tablet_service.cc:1511] Processing CreateTablet for tablet 13785e12812d4092839867d05c4bdd56 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:01.423384  3774 tablet_service.cc:1511] Processing CreateTablet for tablet 13785e12812d4092839867d05c4bdd56 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:01.424674  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13785e12812d4092839867d05c4bdd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.424777  3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13785e12812d4092839867d05c4bdd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.426424  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8e3462410045018dfb0c45ce4ac3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.420879  3844 tablet_service.cc:1511] Processing CreateTablet for tablet 13785e12812d4092839867d05c4bdd56 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:01.428345  3624 tablet_service.cc:1511] Processing CreateTablet for tablet 4afd7a503cf84f9c8d8418173f48aa05 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:01.435712  3619 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8e3462410045018dfb0c45ce4ac3bf (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:01.459888  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afd7a503cf84f9c8d8418173f48aa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.465870  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13785e12812d4092839867d05c4bdd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.466456  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:01.467772  3619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8e3462410045018dfb0c45ce4ac3bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:01.468585  3749 leader_election.cc:343] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.473310  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:01.475210  3747 leader_election.cc:343] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.475728  3747 leader_election.cc:304] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:01.476562  3909 raft_consensus.cc:2749] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.478796  3906 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:01.479527  3906 ts_tablet_manager.cc:1403] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.237s	user 0.007s	sys 0.009s
I20260709 12:26:01.484833  3905 ts_tablet_manager.cc:1434] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.002s
I20260709 12:26:01.485293  3769 tablet_service.cc:1511] Processing CreateTablet for tablet 4afd7a503cf84f9c8d8418173f48aa05 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:01.485922  3905 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:01.486588  3769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afd7a503cf84f9c8d8418173f48aa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.488308  3622 tablet_service.cc:1511] Processing CreateTablet for tablet 24ba08d139f04994b6a33aeb45d32d89 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:01.489634  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ba08d139f04994b6a33aeb45d32d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.493953  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 24ba08d139f04994b6a33aeb45d32d89 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:01.495339  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ba08d139f04994b6a33aeb45d32d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.498613  3904 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:01.499197  3904 ts_tablet_manager.cc:1403] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.000s
I20260709 12:26:01.502509  3904 raft_consensus.cc:359] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.509264  3696 tablet_service.cc:1511] Processing CreateTablet for tablet 4afd7a503cf84f9c8d8418173f48aa05 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:01.512567  3883 heartbeater.cc:499] Master 127.29.131.254:37927 was elected leader, sending a full tablet report...
I20260709 12:26:01.513290  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afd7a503cf84f9c8d8418173f48aa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.503414  3906 raft_consensus.cc:359] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.519804  3906 raft_consensus.cc:385] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.520140  3906 raft_consensus.cc:740] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.520903  3903 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:01.521490  3903 ts_tablet_manager.cc:1403] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.018s
I20260709 12:26:01.521108  3906 consensus_queue.cc:260] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.524647  3905 tablet_bootstrap.cc:654] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.530268  3771 tablet_service.cc:1511] Processing CreateTablet for tablet 26ff0fe6aa744a2ba04e3a9fe25f8a72 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:01.531646  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ff0fe6aa744a2ba04e3a9fe25f8a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.532691  3624 tablet_service.cc:1511] Processing CreateTablet for tablet 26ff0fe6aa744a2ba04e3a9fe25f8a72 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:01.532792  3903 raft_consensus.cc:359] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.533667  3903 raft_consensus.cc:385] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.533998  3903 raft_consensus.cc:740] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.534909  3903 consensus_queue.cc:260] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.536737  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ff0fe6aa744a2ba04e3a9fe25f8a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.541062  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 26ff0fe6aa744a2ba04e3a9fe25f8a72 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:01.542361  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ff0fe6aa744a2ba04e3a9fe25f8a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.544456  3698 tablet_service.cc:1511] Processing CreateTablet for tablet 24ba08d139f04994b6a33aeb45d32d89 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:01.545755  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ba08d139f04994b6a33aeb45d32d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.503707  3904 raft_consensus.cc:385] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.546268  3904 raft_consensus.cc:740] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.547122  3904 consensus_queue.cc:260] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.549652  3904 ts_tablet_manager.cc:1434] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:26:01.557016  3904 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:01.551739  3903 ts_tablet_manager.cc:1434] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:26:01.564474  3903 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:01.568195  3693 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4bf7a09d4943c2a597b74475baa619 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:01.569479  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4bf7a09d4943c2a597b74475baa619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.576057  3919 raft_consensus.cc:493] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.576642  3919 raft_consensus.cc:515] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.578585  3906 ts_tablet_manager.cc:1434] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.099s	user 0.003s	sys 0.007s
I20260709 12:26:01.579835  3906 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:01.581075  3903 tablet_bootstrap.cc:654] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.582470  3910 raft_consensus.cc:493] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.583204  3910 raft_consensus.cc:515] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.586717  3910 leader_election.cc:290] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:01.587690  3909 raft_consensus.cc:493] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.588392  3909 raft_consensus.cc:515] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.591881  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:01.592626  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:01.593315  3747 leader_election.cc:343] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:01.594609  3749 leader_election.cc:343] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.595086  3749 leader_election.cc:304] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:01.596278  3909 leader_election.cc:290] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:01.597031  3909 raft_consensus.cc:2749] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.607281  3774 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4bf7a09d4943c2a597b74475baa619 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:01.608656  3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4bf7a09d4943c2a597b74475baa619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.612692  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4bf7a09d4943c2a597b74475baa619 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:01.614106  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4bf7a09d4943c2a597b74475baa619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.615159  3696 tablet_service.cc:1511] Processing CreateTablet for tablet 18de4c84f23a4190a5a0ac7d94128717 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:01.616432  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18de4c84f23a4190a5a0ac7d94128717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.623324  3770 tablet_service.cc:1511] Processing CreateTablet for tablet 18de4c84f23a4190a5a0ac7d94128717 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:01.624724  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18de4c84f23a4190a5a0ac7d94128717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.625926  3622 tablet_service.cc:1511] Processing CreateTablet for tablet 18de4c84f23a4190a5a0ac7d94128717 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:01.626585  3915 raft_consensus.cc:493] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.631506  3915 raft_consensus.cc:515] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:01.634322  3915 leader_election.cc:290] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:01.634845  3919 leader_election.cc:290] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:01.629487  3905 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:01.630366  3906 tablet_bootstrap.cc:654] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.638835  3905 ts_tablet_manager.cc:1403] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.009s
I20260709 12:26:01.650343  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18de4c84f23a4190a5a0ac7d94128717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.652354  3624 tablet_service.cc:1511] Processing CreateTablet for tablet 85b9d18e76b34cc9968c3e9925c80b96 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:01.653649  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b9d18e76b34cc9968c3e9925c80b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.640168  3848 tablet_service.cc:1511] Processing CreateTablet for tablet 85b9d18e76b34cc9968c3e9925c80b96 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:01.653936  3905 raft_consensus.cc:359] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.654613  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b9d18e76b34cc9968c3e9925c80b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.654693  3905 raft_consensus.cc:385] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.655105  3905 raft_consensus.cc:740] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.655942  3905 consensus_queue.cc:260] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.657482  3903 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:01.657460  3904 tablet_bootstrap.cc:654] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.663533  3903 ts_tablet_manager.cc:1403] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.005s
I20260709 12:26:01.664565  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34086c6e095d4c1db4b41a140eb4db42" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:01.665477  3905 ts_tablet_manager.cc:1434] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 12:26:01.681615  3905 tablet_bootstrap.cc:492] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:01.681209  3903 raft_consensus.cc:359] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:01.682226  3903 raft_consensus.cc:385] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.682610  3903 raft_consensus.cc:740] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.674700  3910 raft_consensus.cc:493] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.687520  3910 raft_consensus.cc:515] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.692334  3698 tablet_service.cc:1511] Processing CreateTablet for tablet 85b9d18e76b34cc9968c3e9925c80b96 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:01.693641  3905 tablet_bootstrap.cc:654] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.693733  3910 leader_election.cc:290] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:01.703153  3624 tablet_service.cc:1511] Processing CreateTablet for tablet 0f073e484776458c93ec7bacbea4bf62 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:01.705127  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f073e484776458c93ec7bacbea4bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.703544  3696 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4342bbb0ea4e338952846096527efc (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:26:01.722242  3821 leader_election.cc:343] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.717193  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b9d18e76b34cc9968c3e9925c80b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.730647  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 0f073e484776458c93ec7bacbea4bf62 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:01.732746  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f073e484776458c93ec7bacbea4bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.683597  3903 consensus_queue.cc:260] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:01.741618  3903 ts_tablet_manager.cc:1434] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 12:26:01.746847  3771 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4342bbb0ea4e338952846096527efc (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:01.748240  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4342bbb0ea4e338952846096527efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.750015  3769 tablet_service.cc:1511] Processing CreateTablet for tablet 0f073e484776458c93ec7bacbea4bf62 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:01.751374  3769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f073e484776458c93ec7bacbea4bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.756428  3619 tablet_service.cc:1511] Processing CreateTablet for tablet 4e20fad02c8a4e359367d7da0a247760 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:01.757768  3619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e20fad02c8a4e359367d7da0a247760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.743093  3903 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:01.778303  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4342bbb0ea4e338952846096527efc (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:01.779899  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4342bbb0ea4e338952846096527efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.781279  3906 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:01.781863  3906 ts_tablet_manager.cc:1403] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.202s	user 0.010s	sys 0.004s
I20260709 12:26:01.778297  3693 tablet_service.cc:1511] Processing CreateTablet for tablet 4e20fad02c8a4e359367d7da0a247760 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:01.774977  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4342bbb0ea4e338952846096527efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.793815  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e20fad02c8a4e359367d7da0a247760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.799463  3844 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c9a2da48a44e29f55803f43d316b4 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:01.800904  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c9a2da48a44e29f55803f43d316b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.800671  3767 tablet_service.cc:1511] Processing CreateTablet for tablet 4e20fad02c8a4e359367d7da0a247760 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:01.802433  3767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e20fad02c8a4e359367d7da0a247760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.802513  3906 raft_consensus.cc:359] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:01.823957  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:01.830281  3624 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c9a2da48a44e29f55803f43d316b4 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:01.831578  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c9a2da48a44e29f55803f43d316b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:01.836913  3600 leader_election.cc:343] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.837015  3697 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c9a2da48a44e29f55803f43d316b4 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:01.838470  3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c9a2da48a44e29f55803f43d316b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.838992  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
W20260709 12:26:01.840692  3600 leader_election.cc:343] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.842329  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:01.844298  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:01.845685  3600 leader_election.cc:343] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.846158  3600 leader_election.cc:304] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:01.846993  3910 raft_consensus.cc:2749] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:01.848217  3600 leader_election.cc:343] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.848651  3600 leader_election.cc:304] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:01.849427  3910 raft_consensus.cc:2749] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.857692  3770 tablet_service.cc:1511] Processing CreateTablet for tablet e02443dd35484cd7bb5d7dccce65cc66 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:01.859117  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e02443dd35484cd7bb5d7dccce65cc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.862342  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34086c6e095d4c1db4b41a140eb4db42" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:01.864043  3823 leader_election.cc:343] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.864553  3823 leader_election.cc:304] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:01.865710  3919 raft_consensus.cc:2749] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.819643  3906 raft_consensus.cc:385] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.867480  3906 raft_consensus.cc:740] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.868222  3906 consensus_queue.cc:260] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:01.870415  3906 ts_tablet_manager.cc:1434] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 12:26:01.879397  3903 tablet_bootstrap.cc:654] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.892714  3906 tablet_bootstrap.cc:492] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:01.899854  3624 tablet_service.cc:1511] Processing CreateTablet for tablet e02443dd35484cd7bb5d7dccce65cc66 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:01.901103  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e02443dd35484cd7bb5d7dccce65cc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.900938  3693 tablet_service.cc:1511] Processing CreateTablet for tablet c72c02611ee24affaa7740ab42bc482b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:01.902714  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c02611ee24affaa7740ab42bc482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.911201  3905 tablet_bootstrap.cc:492] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:01.894850  3841 tablet_service.cc:1511] Processing CreateTablet for tablet e02443dd35484cd7bb5d7dccce65cc66 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:01.911777  3905 ts_tablet_manager.cc:1403] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.230s	user 0.020s	sys 0.030s
I20260709 12:26:01.912331  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e02443dd35484cd7bb5d7dccce65cc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.915372  3909 raft_consensus.cc:493] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.915824  3909 raft_consensus.cc:515] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:01.921510  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306d9965a9184c46bbcc8fb8b12d0887" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:01.925551  3747 leader_election.cc:343] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.928347  3904 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:01.929452  3904 ts_tablet_manager.cc:1403] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.373s	user 0.011s	sys 0.018s
I20260709 12:26:01.918226  3909 leader_election.cc:290] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:01.932931  3904 raft_consensus.cc:359] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.933645  3904 raft_consensus.cc:385] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.933957  3904 raft_consensus.cc:740] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.914958  3905 raft_consensus.cc:359] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:01.939376  3905 raft_consensus.cc:385] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.939396  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306d9965a9184c46bbcc8fb8b12d0887" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:01.939833  3905 raft_consensus.cc:740] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.940174  3858 raft_consensus.cc:2468] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:01.941008  3906 tablet_bootstrap.cc:654] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.940814  3905 consensus_queue.cc:260] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:01.941620  3749 leader_election.cc:304] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:01.942795  3909 raft_consensus.cc:2804] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.943176  3909 raft_consensus.cc:493] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.943569  3909 raft_consensus.cc:3060] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.945578  3903 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:01.946137  3903 ts_tablet_manager.cc:1403] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.008s
I20260709 12:26:01.949193  3903 raft_consensus.cc:359] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:01.949949  3903 raft_consensus.cc:385] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.950259  3903 raft_consensus.cc:740] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.952071  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:01.954576  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:01.955044  3675 leader_election.cc:343] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.934690  3904 consensus_queue.cc:260] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:01.957557  3622 tablet_service.cc:1511] Processing CreateTablet for tablet b765c44a140f4bba917eb47eac69b8d0 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:01.958185  3904 ts_tablet_manager.cc:1434] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.004s
I20260709 12:26:01.959952  3904 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:01.960474  3771 tablet_service.cc:1511] Processing CreateTablet for tablet c72c02611ee24affaa7740ab42bc482b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:01.961874  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c02611ee24affaa7740ab42bc482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.963760  3696 tablet_service.cc:1511] Processing CreateTablet for tablet b765c44a140f4bba917eb47eac69b8d0 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:01.965060  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b765c44a140f4bba917eb47eac69b8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.971362  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b765c44a140f4bba917eb47eac69b8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.971253  3909 raft_consensus.cc:515] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:01.951030  3903 consensus_queue.cc:260] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:01.975419  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306d9965a9184c46bbcc8fb8b12d0887" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:01.976107  3858 raft_consensus.cc:3060] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:01.972079  3675 leader_election.cc:343] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.978458  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 547fe2b2ec4f42d4b2386ea1c9a7d2b9 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:01.984208  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547fe2b2ec4f42d4b2386ea1c9a7d2b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.986295  3904 tablet_bootstrap.cc:654] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.978948  3675 leader_election.cc:304] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:01.987737  3915 raft_consensus.cc:2749] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.988256  3844 tablet_service.cc:1511] Processing CreateTablet for tablet c72c02611ee24affaa7740ab42bc482b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:01.988974  3915 raft_consensus.cc:493] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.989558  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c02611ee24affaa7740ab42bc482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.989506  3915 raft_consensus.cc:515] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:01.972122  3905 ts_tablet_manager.cc:1434] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
I20260709 12:26:01.980636  3903 ts_tablet_manager.cc:1434] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 12:26:01.995332  3905 tablet_bootstrap.cc:492] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:01.974400  3770 tablet_service.cc:1511] Processing CreateTablet for tablet b765c44a140f4bba917eb47eac69b8d0 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:01.995661  3903 tablet_bootstrap.cc:492] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:02.006820  3624 tablet_service.cc:1511] Processing CreateTablet for tablet 547fe2b2ec4f42d4b2386ea1c9a7d2b9 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:02.007470  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b765c44a140f4bba917eb47eac69b8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.011744  3693 tablet_service.cc:1511] Processing CreateTablet for tablet 547fe2b2ec4f42d4b2386ea1c9a7d2b9 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:02.013016  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547fe2b2ec4f42d4b2386ea1c9a7d2b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:02.014032  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:02.016768  3767 tablet_service.cc:1511] Processing CreateTablet for tablet e2a7b9b8ce0d41fb9a7871b4b85ec07b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:02.017498  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306d9965a9184c46bbcc8fb8b12d0887" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:02.018046  3767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a7b9b8ce0d41fb9a7871b4b85ec07b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:02.018822  3747 leader_election.cc:343] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.020043  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547fe2b2ec4f42d4b2386ea1c9a7d2b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.017170  3903 tablet_bootstrap.cc:654] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.028594  3843 tablet_service.cc:1511] Processing CreateTablet for tablet e2a7b9b8ce0d41fb9a7871b4b85ec07b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:02.029942  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a7b9b8ce0d41fb9a7871b4b85ec07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.035804  3698 tablet_service.cc:1511] Processing CreateTablet for tablet 2aa16bd4043348ff99dd99e5d01ffa01 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:02.037147  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa16bd4043348ff99dd99e5d01ffa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.037626  3858 raft_consensus.cc:2468] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:02.038992  3749 leader_election.cc:304] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:02.039670  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:02.040114  3926 raft_consensus.cc:2804] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.040257  3619 tablet_service.cc:1511] Processing CreateTablet for tablet e2a7b9b8ce0d41fb9a7871b4b85ec07b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:02.041589  3619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a7b9b8ce0d41fb9a7871b4b85ec07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.043728  3915 leader_election.cc:290] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
W20260709 12:26:02.043998  3673 leader_election.cc:343] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.002887  3909 leader_election.cc:290] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:02.047187  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:02.047956  3784 raft_consensus.cc:2468] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:02.049611  3675 leader_election.cc:304] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:02.050829  3915 raft_consensus.cc:2804] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.051246  3915 raft_consensus.cc:493] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.051587  3915 raft_consensus.cc:3060] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.059026  3771 tablet_service.cc:1511] Processing CreateTablet for tablet 2aa16bd4043348ff99dd99e5d01ffa01 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:02.060547  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa16bd4043348ff99dd99e5d01ffa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.061986  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 52472aa8d3c5489dadf9bea4ae265693 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:02.071460  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 2aa16bd4043348ff99dd99e5d01ffa01 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:02.073170  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa16bd4043348ff99dd99e5d01ffa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.071210  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52472aa8d3c5489dadf9bea4ae265693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.077754  3770 tablet_service.cc:1511] Processing CreateTablet for tablet 52472aa8d3c5489dadf9bea4ae265693 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:02.079810  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52472aa8d3c5489dadf9bea4ae265693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.093647  3903 tablet_bootstrap.cc:492] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:02.094250  3903 ts_tablet_manager.cc:1403] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.000s
I20260709 12:26:02.096782  3905 tablet_bootstrap.cc:654] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.100780  3903 raft_consensus.cc:359] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.100651  3696 tablet_service.cc:1511] Processing CreateTablet for tablet 52472aa8d3c5489dadf9bea4ae265693 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:02.107872  3848 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7981cc37ba4740aaf2fbba50d6f1cc (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:02.109292  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7981cc37ba4740aaf2fbba50d6f1cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.110057  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7981cc37ba4740aaf2fbba50d6f1cc (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:02.111359  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7981cc37ba4740aaf2fbba50d6f1cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.102886  3903 raft_consensus.cc:385] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.113428  3903 raft_consensus.cc:740] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.114728  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52472aa8d3c5489dadf9bea4ae265693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.121973  3906 tablet_bootstrap.cc:492] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:02.122233  3904 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:02.122529  3906 ts_tablet_manager.cc:1403] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.251s	user 0.020s	sys 0.017s
I20260709 12:26:02.122779  3904 ts_tablet_manager.cc:1403] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.011s
I20260709 12:26:02.122480  3693 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7981cc37ba4740aaf2fbba50d6f1cc (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:02.124125  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7981cc37ba4740aaf2fbba50d6f1cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.125912  3906 raft_consensus.cc:359] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.126314  3904 raft_consensus.cc:359] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:02.126662  3906 raft_consensus.cc:385] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.117303  3926 raft_consensus.cc:697] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:02.133356  3842 tablet_service.cc:1511] Processing CreateTablet for tablet ff2f247912a248ed8aee1a67922b1b22 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:02.134626  3842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2f247912a248ed8aee1a67922b1b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.137245  3910 raft_consensus.cc:493] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.119647  3915 raft_consensus.cc:515] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:02.137764  3910 raft_consensus.cc:515] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.139945  3910 leader_election.cc:290] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:02.140048  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:02.141280  3624 tablet_service.cc:1511] Processing CreateTablet for tablet ff2f247912a248ed8aee1a67922b1b22 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:02.142468  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2f247912a248ed8aee1a67922b1b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.143345  3926 consensus_queue.cc:237] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.145283  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:02.145831  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:02.146768  3600 leader_election.cc:343] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.127948  3904 raft_consensus.cc:385] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.147475  3904 raft_consensus.cc:740] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.128026  3903 consensus_queue.cc:260] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.148317  3904 consensus_queue.cc:260] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:02.149160  3903 ts_tablet_manager.cc:1434] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 12:26:02.149284  3635 raft_consensus.cc:3060] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.137290  3905 tablet_bootstrap.cc:492] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:02.156018  3905 ts_tablet_manager.cc:1403] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.161s	user 0.010s	sys 0.005s
I20260709 12:26:02.128789  3906 raft_consensus.cc:740] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.159080  3905 raft_consensus.cc:359] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
W20260709 12:26:02.159531  3600 leader_election.cc:343] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.159958  3905 raft_consensus.cc:385] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.160066  3906 consensus_queue.cc:260] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.162562  3906 ts_tablet_manager.cc:1434] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:26:02.160176  3600 leader_election.cc:304] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:02.160359  3905 raft_consensus.cc:740] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.164408  3910 raft_consensus.cc:2749] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.164422  3905 consensus_queue.cc:260] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.165692  3915 leader_election.cc:290] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:02.166328  3915 raft_consensus.cc:493] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.166801  3915 raft_consensus.cc:515] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.167320  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:02.167930  3784 raft_consensus.cc:3060] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.168790  3767 tablet_service.cc:1511] Processing CreateTablet for tablet ff2f247912a248ed8aee1a67922b1b22 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:02.177906  3767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2f247912a248ed8aee1a67922b1b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.150317  3903 tablet_bootstrap.cc:492] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:02.171495  3635 raft_consensus.cc:2468] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:02.172995  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ec401d95f483b988f72f1db907352" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:02.182567  3858 raft_consensus.cc:2468] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:02.174413  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ec401d95f483b988f72f1db907352" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
W20260709 12:26:02.184947  3675 leader_election.cc:343] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.185691  3675 leader_election.cc:304] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:02.187467  3904 ts_tablet_manager.cc:1434] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.003s
I20260709 12:26:02.188109  3941 raft_consensus.cc:493] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.188573  3904 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:02.188674  3941 raft_consensus.cc:515] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.191952  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:02.193032  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:02.193596  3749 leader_election.cc:343] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:02.194592  3747 leader_election.cc:343] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.195027  3747 leader_election.cc:304] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:02.195837  3909 raft_consensus.cc:2749] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.195911  3941 leader_election.cc:290] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:02.169236  3915 leader_election.cc:290] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:02.205825  3915 raft_consensus.cc:2804] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.206185  3915 raft_consensus.cc:493] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.206521  3915 raft_consensus.cc:3060] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.209621  3673 leader_election.cc:304] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:02.211803  3906 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:02.218917  3906 tablet_bootstrap.cc:654] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.222645  3905 ts_tablet_manager.cc:1434] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.006s
I20260709 12:26:02.223856  3905 tablet_bootstrap.cc:492] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:02.229805  3771 tablet_service.cc:1511] Processing CreateTablet for tablet fe6c38732d3b4d4a92be8805b1e20070 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:02.230777  3905 tablet_bootstrap.cc:654] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.231027  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6c38732d3b4d4a92be8805b1e20070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.238425  3944 raft_consensus.cc:2804] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.239024  3944 raft_consensus.cc:697] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:02.239543  3698 tablet_service.cc:1511] Processing CreateTablet for tablet fe6c38732d3b4d4a92be8805b1e20070 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:02.240015  3944 consensus_queue.cc:237] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:02.240952  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6c38732d3b4d4a92be8805b1e20070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.241318  3903 tablet_bootstrap.cc:654] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.244287  3784 raft_consensus.cc:2468] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:02.248535  3915 raft_consensus.cc:515] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.255810  3697 tablet_service.cc:1511] Processing CreateTablet for tablet 18f2315d32f6457b80884480feef6a4b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:02.259733  3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f2315d32f6457b80884480feef6a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.260766  3622 tablet_service.cc:1511] Processing CreateTablet for tablet 18f2315d32f6457b80884480feef6a4b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:02.262007  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f2315d32f6457b80884480feef6a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.267592  3767 tablet_service.cc:1511] Processing CreateTablet for tablet 18f2315d32f6457b80884480feef6a4b (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:02.268143  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 1d58d259e3e44cdda99987f566b1716e (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:02.269004  3767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f2315d32f6457b80884480feef6a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.269287  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d58d259e3e44cdda99987f566b1716e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.268671  3532 catalog_manager.cc:5697] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.263813  3844 tablet_service.cc:1511] Processing CreateTablet for tablet fe6c38732d3b4d4a92be8805b1e20070 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:02.272127  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6c38732d3b4d4a92be8805b1e20070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.275529  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ec401d95f483b988f72f1db907352" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
W20260709 12:26:02.276988  3675 leader_election.cc:343] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.278977  3904 tablet_bootstrap.cc:654] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.283787  3693 tablet_service.cc:1511] Processing CreateTablet for tablet 1d58d259e3e44cdda99987f566b1716e (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:02.285080  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d58d259e3e44cdda99987f566b1716e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.297292  3915 leader_election.cc:290] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:02.298393  3906 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:02.297920  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ec401d95f483b988f72f1db907352" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:02.299165  3906 ts_tablet_manager.cc:1403] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.008s
I20260709 12:26:02.299263  3858 raft_consensus.cc:3060] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.306043  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 34817477e5034d50bf4b2f435a675a97 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:02.307260  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34817477e5034d50bf4b2f435a675a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.307821  3696 tablet_service.cc:1511] Processing CreateTablet for tablet e0ff54594fa04818823d814a68d333dd (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:02.309082  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ff54594fa04818823d814a68d333dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.308732  3848 tablet_service.cc:1511] Processing CreateTablet for tablet e0ff54594fa04818823d814a68d333dd (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:02.310030  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ff54594fa04818823d814a68d333dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.311307  3771 tablet_service.cc:1511] Processing CreateTablet for tablet 34817477e5034d50bf4b2f435a675a97 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:02.312444  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34817477e5034d50bf4b2f435a675a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.315446  3770 tablet_service.cc:1511] Processing CreateTablet for tablet e0ff54594fa04818823d814a68d333dd (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:02.316589  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ff54594fa04818823d814a68d333dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.317008  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 1d58d259e3e44cdda99987f566b1716e (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:02.320071  3624 tablet_service.cc:1511] Processing CreateTablet for tablet 34817477e5034d50bf4b2f435a675a97 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:02.321398  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34817477e5034d50bf4b2f435a675a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.304284  3531 catalog_manager.cc:5697] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.348126  3623 tablet_service.cc:1511] Processing CreateTablet for tablet 2759a53f472748538672660088f60cf4 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:02.348165  3619 tablet_service.cc:1511] Processing CreateTablet for tablet ee89e0b191e547c2ac8538c9895b1539 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:02.352733  3774 tablet_service.cc:1511] Processing CreateTablet for tablet ee89e0b191e547c2ac8538c9895b1539 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:02.353998  3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee89e0b191e547c2ac8538c9895b1539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.355455  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 2759a53f472748538672660088f60cf4 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:02.356603  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2759a53f472748538672660088f60cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.356729  3695 tablet_service.cc:1511] Processing CreateTablet for tablet 2759a53f472748538672660088f60cf4 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:02.358071  3695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2759a53f472748538672660088f60cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.358594  3926 raft_consensus.cc:493] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.359141  3926 raft_consensus.cc:515] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.360000  3625 tablet_service.cc:1511] Processing CreateTablet for tablet 85f4ad9284704c3891115e913b314323 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:02.361279  3926 leader_election.cc:290] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:02.350312  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d58d259e3e44cdda99987f566b1716e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.368906  3693 tablet_service.cc:1511] Processing CreateTablet for tablet ee89e0b191e547c2ac8538c9895b1539 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:02.369062  3771 tablet_service.cc:1511] Processing CreateTablet for tablet 85f4ad9284704c3891115e913b314323 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:02.370157  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f4ad9284704c3891115e913b314323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.375216  3842 tablet_service.cc:1511] Processing CreateTablet for tablet 85f4ad9284704c3891115e913b314323 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:02.402694  3905 tablet_bootstrap.cc:492] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:02.404522  3842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f4ad9284704c3891115e913b314323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.404655  3905 ts_tablet_manager.cc:1403] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.003s
I20260709 12:26:02.370136  3693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee89e0b191e547c2ac8538c9895b1539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.370764  3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2759a53f472748538672660088f60cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.417032  3843 tablet_service.cc:1511] Processing CreateTablet for tablet eda50c71ab424bb597fbc66cc9bb5169 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:02.372080  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:02.418422  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda50c71ab424bb597fbc66cc9bb5169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.398047  3903 tablet_bootstrap.cc:492] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:02.351527  3906 raft_consensus.cc:359] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.377115  3699 tablet_service.cc:1511] Processing CreateTablet for tablet eda50c71ab424bb597fbc66cc9bb5169 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:02.370862  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:02.427318  3906 raft_consensus.cc:385] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.437646  3770 tablet_service.cc:1511] Processing CreateTablet for tablet eda50c71ab424bb597fbc66cc9bb5169 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:02.449435  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda50c71ab424bb597fbc66cc9bb5169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.435817  3903 ts_tablet_manager.cc:1403] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.286s	user 0.014s	sys 0.036s
I20260709 12:26:02.443866  3625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f4ad9284704c3891115e913b314323. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:02.436262  3749 leader_election.cc:343] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.435695  3915 raft_consensus.cc:493] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.448086  3906 raft_consensus.cc:740] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.435510  3710 raft_consensus.cc:2468] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:02.455686  3699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda50c71ab424bb597fbc66cc9bb5169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.466670  3904 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:02.467200  3904 ts_tablet_manager.cc:1403] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.279s	user 0.015s	sys 0.010s
I20260709 12:26:02.468017  3903 raft_consensus.cc:359] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.468784  3903 raft_consensus.cc:385] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.469069  3903 raft_consensus.cc:740] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.469842  3903 consensus_queue.cc:260] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.470227  3904 raft_consensus.cc:359] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.470960  3904 raft_consensus.cc:385] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.471277  3904 raft_consensus.cc:740] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.472097  3904 consensus_queue.cc:260] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.474575  3904 ts_tablet_manager.cc:1434] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:26:02.475617  3904 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:02.473110  3624 tablet_service.cc:1511] Processing CreateTablet for tablet f651c75d6a434e50a9e9e0e36543be65 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:02.462713  3915 raft_consensus.cc:515] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.478350  3910 raft_consensus.cc:493] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.484928  3910 raft_consensus.cc:515] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.487874  3749 leader_election.cc:304] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:02.488811  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:02.490056  3858 raft_consensus.cc:2468] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:02.491427  3675 leader_election.cc:304] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:02.491727  3910 leader_election.cc:290] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:02.492267  3944 raft_consensus.cc:2804] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:02.492435  3600 leader_election.cc:343] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.492818  3944 raft_consensus.cc:697] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:02.493763  3944 consensus_queue.cc:237] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.489085  3926 raft_consensus.cc:2804] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.495802  3926 raft_consensus.cc:493] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.496192  3926 raft_consensus.cc:3060] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.496416  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:02.498262  3903 ts_tablet_manager.cc:1434] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.003s
I20260709 12:26:02.499280  3698 tablet_service.cc:1511] Processing CreateTablet for tablet f651c75d6a434e50a9e9e0e36543be65 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:02.500660  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f651c75d6a434e50a9e9e0e36543be65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.483613  3906 consensus_queue.cc:260] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
W20260709 12:26:02.503080  3600 leader_election.cc:343] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.503582  3600 leader_election.cc:304] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:02.503968  3619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee89e0b191e547c2ac8538c9895b1539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.504686  3910 raft_consensus.cc:2749] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.506500  3915 leader_election.cc:290] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:02.506862  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
W20260709 12:26:02.508780  3675 leader_election.cc:343] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.499395  3903 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:02.509810  3906 ts_tablet_manager.cc:1434] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.210s	user 0.009s	sys 0.012s
I20260709 12:26:02.510253  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:02.510968  3906 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
W20260709 12:26:02.511582  3675 leader_election.cc:343] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.512439  3675 leader_election.cc:304] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:02.515947  3915 raft_consensus.cc:2749] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.516992  3903 tablet_bootstrap.cc:654] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.520622  3622 tablet_service.cc:1511] Processing CreateTablet for tablet 220f9aead41d420995c59bc0f03e4cc6 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:02.522486  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220f9aead41d420995c59bc0f03e4cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.464249  3905 raft_consensus.cc:359] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.525274  3905 raft_consensus.cc:385] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.525614  3905 raft_consensus.cc:740] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.527590  3696 tablet_service.cc:1511] Processing CreateTablet for tablet 220f9aead41d420995c59bc0f03e4cc6 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:02.512995  3926 raft_consensus.cc:515] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.528805  3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220f9aead41d420995c59bc0f03e4cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.532845  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f651c75d6a434e50a9e9e0e36543be65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.532758  3770 tablet_service.cc:1511] Processing CreateTablet for tablet f651c75d6a434e50a9e9e0e36543be65 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:02.534337  3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f651c75d6a434e50a9e9e0e36543be65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.550230  3771 tablet_service.cc:1511] Processing CreateTablet for tablet b62f9c73102a4b07a57947eb81059e1e (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:02.551900  3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62f9c73102a4b07a57947eb81059e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.552819  3926 leader_election.cc:290] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:02.526445  3905 consensus_queue.cc:260] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.557947  3905 ts_tablet_manager.cc:1434] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.153s	user 0.004s	sys 0.003s
I20260709 12:26:02.572223  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:02.572861  3710 raft_consensus.cc:3060] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.574015  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:02.576215  3842 tablet_service.cc:1511] Processing CreateTablet for tablet 220f9aead41d420995c59bc0f03e4cc6 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:02.577589  3842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220f9aead41d420995c59bc0f03e4cc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:02.578074  3749 leader_election.cc:343] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.580260  3710 raft_consensus.cc:2468] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:02.592320  3749 leader_election.cc:304] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:02.594340  3941 raft_consensus.cc:2804] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.595073  3941 raft_consensus.cc:697] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:02.600327  3941 consensus_queue.cc:237] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.608204  3848 tablet_service.cc:1511] Processing CreateTablet for tablet b62f9c73102a4b07a57947eb81059e1e (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:02.610530  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62f9c73102a4b07a57947eb81059e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.611796  3623 tablet_service.cc:1511] Processing CreateTablet for tablet b62f9c73102a4b07a57947eb81059e1e (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:02.613140  3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62f9c73102a4b07a57947eb81059e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.615432  3905 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:02.624320  3926 consensus_queue.cc:1048] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.625375  3906 tablet_bootstrap.cc:654] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.629259  3904 tablet_bootstrap.cc:654] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.651207  3903 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:02.651891  3903 ts_tablet_manager.cc:1403] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.153s	user 0.048s	sys 0.059s
I20260709 12:26:02.654979  3903 raft_consensus.cc:359] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.655898  3903 raft_consensus.cc:385] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.656262  3903 raft_consensus.cc:740] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.657197  3903 consensus_queue.cc:260] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.658496  3909 raft_consensus.cc:493] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.659183  3909 raft_consensus.cc:515] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.662217  3909 leader_election.cc:290] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:02.665637  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b8f4bd05ad4d3bb5289e38f6ba5a61" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:02.666265  3903 ts_tablet_manager.cc:1434] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:26:02.666486  3710 raft_consensus.cc:2468] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:02.667495  3903 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:02.671756  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b8f4bd05ad4d3bb5289e38f6ba5a61" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:02.673553  3749 leader_election.cc:343] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.674368  3749 leader_election.cc:304] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:02.665445  3695 tablet_service.cc:1511] Processing CreateTablet for tablet b07cd2a3e0cb4de9a4e366ccadc47722 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:02.685518  3905 tablet_bootstrap.cc:654] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.687482  3903 tablet_bootstrap.cc:654] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.688274  3767 tablet_service.cc:1511] Processing CreateTablet for tablet b07cd2a3e0cb4de9a4e366ccadc47722 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:02.690936  3695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07cd2a3e0cb4de9a4e366ccadc47722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.688474  3941 raft_consensus.cc:2804] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.693473  3941 raft_consensus.cc:493] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.693575  3844 tablet_service.cc:1511] Processing CreateTablet for tablet b07cd2a3e0cb4de9a4e366ccadc47722 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:02.693782  3699 tablet_service.cc:1511] Processing CreateTablet for tablet 5e083cdabbfa42638fed2591051bc9d6 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:02.693989  3941 raft_consensus.cc:3060] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.694973  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07cd2a3e0cb4de9a4e366ccadc47722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.696731  3774 tablet_service.cc:1511] Processing CreateTablet for tablet 5e083cdabbfa42638fed2591051bc9d6 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:02.694973  3699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e083cdabbfa42638fed2591051bc9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.691826  3767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07cd2a3e0cb4de9a4e366ccadc47722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.712227  3622 tablet_service.cc:1511] Processing CreateTablet for tablet 5e083cdabbfa42638fed2591051bc9d6 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:02.713658  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e083cdabbfa42638fed2591051bc9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.716176  3623 tablet_service.cc:1511] Processing CreateTablet for tablet 6bff8ced4a7c47afba587ccdac4e1487 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:02.717199  3698 tablet_service.cc:1511] Processing CreateTablet for tablet 6bff8ced4a7c47afba587ccdac4e1487 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:02.717608  3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bff8ced4a7c47afba587ccdac4e1487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.718366  3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bff8ced4a7c47afba587ccdac4e1487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.730409  3769 tablet_service.cc:1511] Processing CreateTablet for tablet 6c7676fe61bd4afb9d0d823e5ecde357 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:02.731827  3769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c7676fe61bd4afb9d0d823e5ecde357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.735051  3941 raft_consensus.cc:515] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.737833  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 6c7676fe61bd4afb9d0d823e5ecde357 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:02.739078  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c7676fe61bd4afb9d0d823e5ecde357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.744170  3941 leader_election.cc:290] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:02.740063  3944 consensus_queue.cc:1048] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.741120  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b8f4bd05ad4d3bb5289e38f6ba5a61" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:02.748932  3710 raft_consensus.cc:3060] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.742676  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b8f4bd05ad4d3bb5289e38f6ba5a61" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
W20260709 12:26:02.752739  3749 leader_election.cc:343] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.753415  3915 consensus_queue.cc:1048] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:02.771714  3747 consensus_peers.cc:597] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.784621  3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e083cdabbfa42638fed2591051bc9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.715487  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 6bff8ced4a7c47afba587ccdac4e1487 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:02.800613  3905 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:02.801209  3905 ts_tablet_manager.cc:1403] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.242s	user 0.007s	sys 0.010s
I20260709 12:26:02.806011  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 6c7676fe61bd4afb9d0d823e5ecde357 (DEFAULT_TABLE table=test-workload [id=5543eda43a174b498994e568ae773b8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:02.807703  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c7676fe61bd4afb9d0d823e5ecde357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.807802  3710 raft_consensus.cc:2468] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:02.810436  3905 raft_consensus.cc:359] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.811218  3905 raft_consensus.cc:385] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.811547  3905 raft_consensus.cc:740] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.811642  3906 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:02.812233  3906 ts_tablet_manager.cc:1403] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.301s	user 0.013s	sys 0.000s
I20260709 12:26:02.818773  3749 leader_election.cc:304] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:02.820779  3926 raft_consensus.cc:2804] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.822247  3904 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:02.824965  3926 raft_consensus.cc:697] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:02.825871  3926 consensus_queue.cc:237] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.822757  3904 ts_tablet_manager.cc:1403] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.347s	user 0.031s	sys 0.012s
I20260709 12:26:02.833078  3905 consensus_queue.cc:260] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.833951  3909 raft_consensus.cc:493] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.835217  3903 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:02.835911  3903 ts_tablet_manager.cc:1403] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.169s	user 0.007s	sys 0.011s
I20260709 12:26:02.836930  3909 raft_consensus.cc:515] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.840716  3909 leader_election.cc:290] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:02.842340  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8454c8322445ccac78d42179633d56" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:02.843487  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bff8ced4a7c47afba587ccdac4e1487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.844591  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8454c8322445ccac78d42179633d56" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:02.846045  3747 leader_election.cc:343] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:02.847117  3749 leader_election.cc:343] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.847625  3749 leader_election.cc:304] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:02.844580  3906 raft_consensus.cc:359] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.848934  3906 raft_consensus.cc:385] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.849438  3909 raft_consensus.cc:2749] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.853653  3904 raft_consensus.cc:359] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.854419  3904 raft_consensus.cc:385] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.854717  3904 raft_consensus.cc:740] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.849453  3906 raft_consensus.cc:740] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.855477  3904 consensus_queue.cc:260] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.855989  3906 consensus_queue.cc:260] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.871311  3905 ts_tablet_manager.cc:1434] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 12:26:02.872402  3905 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:02.873158  3531 catalog_manager.cc:5697] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.881547  3906 ts_tablet_manager.cc:1434] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 12:26:02.881315  3903 raft_consensus.cc:359] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:02.882825  3903 raft_consensus.cc:385] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.883330  3903 raft_consensus.cc:740] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.885677  3903 consensus_queue.cc:260] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:02.887122  3904 ts_tablet_manager.cc:1434] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 12:26:02.887768  3903 ts_tablet_manager.cc:1434] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:26:02.888728  3903 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:02.889458  3905 tablet_bootstrap.cc:654] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.892015  3904 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:02.904335  3533 catalog_manager.cc:5697] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.909420  3906 tablet_bootstrap.cc:492] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:02.908411  3533 catalog_manager.cc:5697] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.915117  3919 raft_consensus.cc:493] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.915792  3919 raft_consensus.cc:515] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.919170  3919 leader_election.cc:290] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:02.920558  3904 tablet_bootstrap.cc:654] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.927521  3906 tablet_bootstrap.cc:654] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.921743  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:02.930169  3634 raft_consensus.cc:2468] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:02.931809  3821 leader_election.cc:304] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:02.932699  3919 raft_consensus.cc:2804] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.933059  3919 raft_consensus.cc:493] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.933375  3919 raft_consensus.cc:3060] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.954358  3903 tablet_bootstrap.cc:654] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.956429  3905 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:02.957243  3905 ts_tablet_manager.cc:1403] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.017s
I20260709 12:26:02.965528  3905 raft_consensus.cc:359] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.966336  3905 raft_consensus.cc:385] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.966667  3905 raft_consensus.cc:740] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.967479  3905 consensus_queue.cc:260] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:02.969875  3905 ts_tablet_manager.cc:1434] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.001s
W20260709 12:26:02.975422  3675 consensus_peers.cc:597] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f -> Peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Couldn't send request to peer 19f38997c19c4127b1162e94bf40b902. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.977125  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:02.978086  3784 raft_consensus.cc:2468] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:02.979873  3905 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:02.990438  3906 tablet_bootstrap.cc:492] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:02.991084  3906 ts_tablet_manager.cc:1403] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.082s	user 0.033s	sys 0.022s
I20260709 12:26:02.992606  3904 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:02.993144  3904 ts_tablet_manager.cc:1403] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.004s
I20260709 12:26:02.994717  3906 raft_consensus.cc:359] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.995607  3906 raft_consensus.cc:385] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.986721  3919 raft_consensus.cc:515] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.995944  3906 raft_consensus.cc:740] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.996851  3906 consensus_queue.cc:260] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:02.998459  3905 tablet_bootstrap.cc:654] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.000767  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.001367  3634 raft_consensus.cc:3060] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.999660  3919 leader_election.cc:290] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:03.002578  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:03.003122  3784 raft_consensus.cc:3060] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.004733  3969 consensus_queue.cc:1048] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:03.006572  3906 ts_tablet_manager.cc:1434] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:26:03.007746  3906 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:03.010821  3784 raft_consensus.cc:2468] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:03.012050  3823 leader_election.cc:304] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:03.016024  3906 tablet_bootstrap.cc:654] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.016466  3634 raft_consensus.cc:2468] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
W20260709 12:26:03.018285  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:03.020298  3919 raft_consensus.cc:2804] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.021314  3919 raft_consensus.cc:697] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:03.022722  3919 consensus_queue.cc:237] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:02.999028  3904 raft_consensus.cc:359] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.028425  3904 raft_consensus.cc:385] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.030098  3915 consensus_queue.cc:1048] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:03.033743  3904 raft_consensus.cc:740] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.036463  3904 consensus_queue.cc:260] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.038686  3904 ts_tablet_manager.cc:1434] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 12:26:03.039963  3904 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.047554  3906 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:03.048324  3906 ts_tablet_manager.cc:1403] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.004s
I20260709 12:26:03.048687  3904 tablet_bootstrap.cc:654] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.054685  3531 catalog_manager.cc:5697] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.057822  3906 raft_consensus.cc:359] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.058692  3906 raft_consensus.cc:385] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.059006  3906 raft_consensus.cc:740] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.059872  3906 consensus_queue.cc:260] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.062371  3906 ts_tablet_manager.cc:1434] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:26:03.063517  3906 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:03.070184  3904 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.070747  3904 ts_tablet_manager.cc:1403] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
I20260709 12:26:03.073040  3905 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.073571  3905 ts_tablet_manager.cc:1403] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.014s
I20260709 12:26:03.074855  3906 tablet_bootstrap.cc:654] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.075352  3857 raft_consensus.cc:3060] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.076539  3905 raft_consensus.cc:359] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.077248  3905 raft_consensus.cc:385] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.077481  3905 raft_consensus.cc:740] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.080168  3903 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:03.080650  3903 ts_tablet_manager.cc:1403] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.192s	user 0.031s	sys 0.026s
I20260709 12:26:03.080493  3905 consensus_queue.cc:260] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.082643  3905 ts_tablet_manager.cc:1434] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:26:03.083699  3905 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:03.087837  3906 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:03.088371  3906 ts_tablet_manager.cc:1403] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.005s
I20260709 12:26:03.088917  3905 tablet_bootstrap.cc:654] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.092008  3904 raft_consensus.cc:359] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.092283  3903 raft_consensus.cc:359] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.092724  3904 raft_consensus.cc:385] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.092905  3903 raft_consensus.cc:385] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.093006  3904 raft_consensus.cc:740] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.093247  3903 raft_consensus.cc:740] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.093883  3904 consensus_queue.cc:260] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.093957  3903 consensus_queue.cc:260] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.096063  3903 ts_tablet_manager.cc:1434] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 12:26:03.096133  3906 raft_consensus.cc:359] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.097013  3906 raft_consensus.cc:385] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.097332  3906 raft_consensus.cc:740] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.097574  3941 consensus_queue.cc:1048] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:03.098189  3906 consensus_queue.cc:260] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.100512  3906 ts_tablet_manager.cc:1434] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:26:03.101747  3906 tablet_bootstrap.cc:492] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:03.105273  3919 raft_consensus.cc:493] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.106037  3904 ts_tablet_manager.cc:1434] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:26:03.105852  3919 raft_consensus.cc:515] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.106818  3903 tablet_bootstrap.cc:492] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:03.107024  3904 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.108246  3906 tablet_bootstrap.cc:654] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.111596  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.112401  3634 raft_consensus.cc:2468] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.114060  3941 raft_consensus.cc:493] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.114657  3941 raft_consensus.cc:515] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.115340  3905 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.115265  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.116148  3905 ts_tablet_manager.cc:1403] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.005s
I20260709 12:26:03.116250  3710 raft_consensus.cc:2468] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.118876  3904 tablet_bootstrap.cc:654] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.119818  3919 leader_election.cc:290] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.118854  3821 leader_election.cc:304] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.122596  3919 raft_consensus.cc:2804] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.123064  3906 tablet_bootstrap.cc:492] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:03.123454  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.123739  3906 ts_tablet_manager.cc:1403] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:26:03.124230  3634 raft_consensus.cc:2468] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:03.124099  3905 raft_consensus.cc:359] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.124910  3905 raft_consensus.cc:385] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.125204  3905 raft_consensus.cc:740] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.125615  3747 leader_election.cc:304] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.125963  3905 consensus_queue.cc:260] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.126595  3909 raft_consensus.cc:2804] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.127024  3909 raft_consensus.cc:493] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.127490  3909 raft_consensus.cc:3060] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.127137  3906 raft_consensus.cc:359] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.128057  3906 raft_consensus.cc:385] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.128384  3906 raft_consensus.cc:740] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.128374  3905 ts_tablet_manager.cc:1434] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:26:03.130759  3905 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:03.129171  3906 consensus_queue.cc:260] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.132668  3906 ts_tablet_manager.cc:1434] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:03.133594  3906 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:03.136924  3905 tablet_bootstrap.cc:654] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.139582  3906 tablet_bootstrap.cc:654] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.123050  3919 raft_consensus.cc:493] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.142503  3919 raft_consensus.cc:3060] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.143383  3904 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.144021  3904 ts_tablet_manager.cc:1403] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 12:26:03.146070  3941 leader_election.cc:290] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.147362  3904 raft_consensus.cc:359] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.147666  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.148052  3904 raft_consensus.cc:385] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.148411  3904 raft_consensus.cc:740] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.148727  3905 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.149082  3904 consensus_queue.cc:260] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.149626  3905 ts_tablet_manager.cc:1403] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:26:03.151552  3904 ts_tablet_manager.cc:1434] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:03.152487  3904 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.152623  3905 raft_consensus.cc:359] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.153496  3905 raft_consensus.cc:385] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.153817  3905 raft_consensus.cc:740] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.154656  3905 consensus_queue.cc:260] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.155354  3919 raft_consensus.cc:515] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.157334  3905 ts_tablet_manager.cc:1434] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:03.157852  3919 leader_election.cc:290] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.120968  3903 tablet_bootstrap.cc:654] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.159586  3904 tablet_bootstrap.cc:654] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.158375  3905 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:03.160563  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:03.162813  3709 raft_consensus.cc:3060] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.158865  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.164780  3634 raft_consensus.cc:3060] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.161957  3710 raft_consensus.cc:2468] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:03.149557  3909 raft_consensus.cc:515] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.170002  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.170310  3906 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:03.170603  3635 raft_consensus.cc:3060] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.171031  3906 ts_tablet_manager.cc:1403] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.004s
I20260709 12:26:03.177446  3906 raft_consensus.cc:359] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.178030  3905 tablet_bootstrap.cc:654] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.178150  3906 raft_consensus.cc:385] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.178746  3906 raft_consensus.cc:740] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.179556  3906 consensus_queue.cc:260] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.180701  3709 raft_consensus.cc:2468] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:03.181756  3906 ts_tablet_manager.cc:1434] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 12:26:03.182858  3906 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:03.185551  3905 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.186225  3905 ts_tablet_manager.cc:1403] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.002s
I20260709 12:26:03.183429  3823 leader_election.cc:304] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:03.187628  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:03.188234  3710 raft_consensus.cc:3060] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.188705  3979 raft_consensus.cc:2804] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.189042  3906 tablet_bootstrap.cc:654] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.189211  3979 raft_consensus.cc:697] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:03.189715  3905 raft_consensus.cc:359] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.190140  3979 consensus_queue.cc:237] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.191015  3905 raft_consensus.cc:385] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.191331  3909 leader_election.cc:290] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.185582  3635 raft_consensus.cc:2468] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:03.191505  3905 raft_consensus.cc:740] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.192880  3747 leader_election.cc:304] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.193213  3904 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.192955  3905 consensus_queue.cc:260] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.193723  3904 ts_tablet_manager.cc:1403] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.001s
I20260709 12:26:03.195416  3909 raft_consensus.cc:2804] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.195667  3905 ts_tablet_manager.cc:1434] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:03.196779  3905 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:03.196730  3909 raft_consensus.cc:697] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:03.196583  3904 raft_consensus.cc:359] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.197463  3904 raft_consensus.cc:385] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.197774  3904 raft_consensus.cc:740] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.198585  3904 consensus_queue.cc:260] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.201697  3904 ts_tablet_manager.cc:1434] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:03.202690  3904 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.205495  3905 tablet_bootstrap.cc:654] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.212729  3909 consensus_queue.cc:237] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.219214  3710 raft_consensus.cc:2468] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:03.221951  3903 tablet_bootstrap.cc:492] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:03.222436  3903 ts_tablet_manager.cc:1403] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.005s
I20260709 12:26:03.225332  3903 raft_consensus.cc:359] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.211720  3634 raft_consensus.cc:2468] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:03.226823  3904 tablet_bootstrap.cc:654] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.225984  3903 raft_consensus.cc:385] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.233104  3903 raft_consensus.cc:740] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.234135  3903 consensus_queue.cc:260] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.236831  3919 raft_consensus.cc:493] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.237370  3919 raft_consensus.cc:515] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.237885  3904 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.238572  3904 ts_tablet_manager.cc:1403] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 12:26:03.239742  3919 leader_election.cc:290] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.240298  3903 ts_tablet_manager.cc:1434] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:26:03.241304  3903 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:03.242305  3904 raft_consensus.cc:359] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.247287  3904 raft_consensus.cc:385] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.247673  3904 raft_consensus.cc:740] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.248755  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.248565  3904 consensus_queue.cc:260] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.251579  3904 ts_tablet_manager.cc:1434] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.005s
I20260709 12:26:03.253018  3904 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.252689  3529 catalog_manager.cc:5697] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.256093  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.257822  3823 leader_election.cc:304] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:03.269384  3904 tablet_bootstrap.cc:654] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.271809  3979 raft_consensus.cc:493] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.272327  3979 raft_consensus.cc:515] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.280575  3944 raft_consensus.cc:493] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.281154  3944 raft_consensus.cc:515] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.283516  3910 raft_consensus.cc:493] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.284180  3903 tablet_bootstrap.cc:654] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.283991  3910 raft_consensus.cc:515] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.286227  3910 leader_election.cc:290] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.288426  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.289314  3784 raft_consensus.cc:2468] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:03.292444  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.293290  3634 raft_consensus.cc:2468] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:03.294966  3600 leader_election.cc:304] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.296831  3673 leader_election.cc:304] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.298130  3945 raft_consensus.cc:2804] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.298576  3945 raft_consensus.cc:493] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.299000  3945 raft_consensus.cc:3060] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.304919  3944 leader_election.cc:290] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.305100  3919 raft_consensus.cc:493] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.305766  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.306499  3784 raft_consensus.cc:2468] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:03.305580  3919 raft_consensus.cc:515] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.313589  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.314428  3710 raft_consensus.cc:2468] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.315342  3919 leader_election.cc:290] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.316532  3823 leader_election.cc:304] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:03.319487  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.320556  3634 raft_consensus.cc:2468] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.321308  3635 raft_consensus.cc:3060] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.320701  4004 raft_consensus.cc:2804] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.322721  4004 raft_consensus.cc:493] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.323652  3919 raft_consensus.cc:2804] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.324323  3919 raft_consensus.cc:493] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.324007  4004 raft_consensus.cc:3060] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.324852  3919 raft_consensus.cc:3060] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.327840  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.334183  3909 raft_consensus.cc:493] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.334771  3909 raft_consensus.cc:515] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.336100  4005 raft_consensus.cc:493] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.338217  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.345010  3710 raft_consensus.cc:2468] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:03.338646  3909 leader_election.cc:290] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.337924  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.346542  3905 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.346812  3906 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:03.347762  3905 ts_tablet_manager.cc:1403] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.151s	user 0.027s	sys 0.057s
I20260709 12:26:03.348471  3906 ts_tablet_manager.cc:1403] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.166s	user 0.033s	sys 0.068s
I20260709 12:26:03.346700  3749 leader_election.cc:304] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:03.352160  3909 raft_consensus.cc:2804] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.352643  3909 raft_consensus.cc:493] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.353092  3909 raft_consensus.cc:3060] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.344347  4005 raft_consensus.cc:515] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.356309  3919 raft_consensus.cc:515] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.357307  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.357937  3710 raft_consensus.cc:2468] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:03.359217  3600 leader_election.cc:304] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.359443  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.360076  3633 raft_consensus.cc:3060] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.360285  4006 raft_consensus.cc:2804] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.360684  4006 raft_consensus.cc:493] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.361029  4006 raft_consensus.cc:3060] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.362978  3979 leader_election.cc:290] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.364027  3632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.364709  3632 raft_consensus.cc:2468] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.362995  3944 raft_consensus.cc:493] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.365918  3944 raft_consensus.cc:515] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.345801  3945 raft_consensus.cc:515] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.367676  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.368131  3944 leader_election.cc:290] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:03.368435  3709 raft_consensus.cc:2393] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a423544d890d41e7870787a3a92aaf58 in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:03.368408  3710 raft_consensus.cc:2468] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.369388  3945 leader_election.cc:290] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.369753  3823 leader_election.cc:304] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:03.369949  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:03.370594  3856 raft_consensus.cc:2468] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:03.372574  4006 raft_consensus.cc:515] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.373521  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:03.374873  4005 leader_election.cc:290] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.375484  3784 raft_consensus.cc:3060] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.376578  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.377452  3675 leader_election.cc:304] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:03.377977  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.378961  3632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.379628  3632 raft_consensus.cc:2468] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:03.373602  3905 raft_consensus.cc:359] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.381910  3905 raft_consensus.cc:385] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.382412  3905 raft_consensus.cc:740] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.383909  3856 raft_consensus.cc:3060] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.385635  3904 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.385656  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:03.386288  3904 ts_tablet_manager.cc:1403] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.134s	user 0.035s	sys 0.032s
I20260709 12:26:03.386363  3710 raft_consensus.cc:3060] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.381522  3979 raft_consensus.cc:2804] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.389173  3904 raft_consensus.cc:359] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.389571  3979 raft_consensus.cc:493] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.389866  3904 raft_consensus.cc:385] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.390254  3904 raft_consensus.cc:740] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.390219  3979 raft_consensus.cc:3060] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.391706  3634 raft_consensus.cc:2393] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:03.394079  3710 raft_consensus.cc:2468] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:03.396153  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:03.383602  4004 raft_consensus.cc:515] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.403505  3631 raft_consensus.cc:2393] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:03.404721  3823 leader_election.cc:304] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:03.402431  3709 raft_consensus.cc:3060] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.405709  4001 raft_consensus.cc:2804] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.397842  3633 raft_consensus.cc:2468] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:03.398396  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:03.398877  4006 leader_election.cc:290] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.399194  3904 consensus_queue.cc:260] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.400229  3919 leader_election.cc:290] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.401685  3906 raft_consensus.cc:359] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.382498  3945 raft_consensus.cc:2804] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.406965  3905 consensus_queue.cc:260] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.417677  3906 raft_consensus.cc:385] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.425974  3906 raft_consensus.cc:740] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.430645  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:03.432544  3904 ts_tablet_manager.cc:1434] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.003s
I20260709 12:26:03.433733  3904 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.437114  4005 raft_consensus.cc:493] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.426973  3945 raft_consensus.cc:493] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.436372  3906 consensus_queue.cc:260] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.447281  3905 ts_tablet_manager.cc:1434] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.002s
I20260709 12:26:03.437626  4005 raft_consensus.cc:515] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.448824  3905 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:03.450289  4005 leader_election.cc:290] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:03.452358  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a72b5e7b494de79530011f65394787" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:03.454949  3915 raft_consensus.cc:493] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.455703  3915 raft_consensus.cc:515] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.456544  3782 raft_consensus.cc:3060] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.458675  3915 leader_election.cc:290] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:03.462585  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34086c6e095d4c1db4b41a140eb4db42" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:03.463717  3600 leader_election.cc:343] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.464201  3633 raft_consensus.cc:2468] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:03.466007  3926 consensus_queue.cc:1048] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:03.464717  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a72b5e7b494de79530011f65394787" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.468047  3784 raft_consensus.cc:2468] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:03.469139  4004 leader_election.cc:290] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.446447  3945 raft_consensus.cc:3060] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.473408  4011 raft_consensus.cc:493] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:03.470434  3600 leader_election.cc:343] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.474195  4011 raft_consensus.cc:515] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.446269  4001 raft_consensus.cc:697] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:03.493782  3910 raft_consensus.cc:493] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 19f38997c19c4127b1162e94bf40b902)
I20260709 12:26:03.478459  3600 leader_election.cc:304] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:03.507804  3997 raft_consensus.cc:2749] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.504415  3910 raft_consensus.cc:515] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.511866  3919 raft_consensus.cc:493] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.512377  3919 raft_consensus.cc:515] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.513626  3910 leader_election.cc:290] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:03.495954  3675 leader_election.cc:304] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:03.514876  3919 leader_election.cc:290] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.515019  3915 raft_consensus.cc:2804] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.515650  3915 raft_consensus.cc:697] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:03.516187  3945 raft_consensus.cc:515] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.516495  3915 consensus_queue.cc:237] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.518167  3945 leader_election.cc:290] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
W20260709 12:26:03.518603  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:36779, user_credentials={real_user=slave}} blocked reactor thread for 49267.1us
I20260709 12:26:03.519057  4001 consensus_queue.cc:237] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.519836  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b8f4bd05ad4d3bb5289e38f6ba5a61" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.504017  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34086c6e095d4c1db4b41a140eb4db42" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:03.521589  3858 raft_consensus.cc:2468] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:03.498515  3673 leader_election.cc:304] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.522557  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306d9965a9184c46bbcc8fb8b12d0887" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:03.523090  3909 raft_consensus.cc:515] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.523728  3905 tablet_bootstrap.cc:654] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.524340  3783 raft_consensus.cc:2393] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a423544d890d41e7870787a3a92aaf58 in current term 1: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:03.524991  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b8f4bd05ad4d3bb5289e38f6ba5a61" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.526301  3903 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:03.526784  3903 ts_tablet_manager.cc:1403] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.286s	user 0.062s	sys 0.056s
I20260709 12:26:03.527202  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:03.527843  3909 leader_election.cc:290] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.529246  3600 leader_election.cc:304] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:03.530092  3904 tablet_bootstrap.cc:654] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.529739  3903 raft_consensus.cc:359] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.530508  3903 raft_consensus.cc:385] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.530812  3903 raft_consensus.cc:740] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.531206  4010 raft_consensus.cc:2749] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:03.531924  4010 raft_consensus.cc:2749] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:03.526784  3906 ts_tablet_manager.cc:1434] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.178s	user 0.011s	sys 0.006s
I20260709 12:26:03.533465  3906 tablet_bootstrap.cc:492] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:03.533978  3823 leader_election.cc:304] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:03.529835  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:03.538861  3979 raft_consensus.cc:515] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.518188  4011 leader_election.cc:290] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:03.540093  3854 raft_consensus.cc:2393] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in this term.
I20260709 12:26:03.540712  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.531924  3903 consensus_queue.cc:260] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.541492  3633 raft_consensus.cc:2393] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:03.536038  3709 raft_consensus.cc:2468] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:03.541888  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.542550  3635 raft_consensus.cc:3060] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.539803  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306d9965a9184c46bbcc8fb8b12d0887" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.547317  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:03.548280  3709 raft_consensus.cc:2393] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:03.548548  3600 leader_election.cc:304] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:03.550172  3600 leader_election.cc:304] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:03.550987  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8454c8322445ccac78d42179633d56" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.543097  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8454c8322445ccac78d42179633d56" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.553594  3783 raft_consensus.cc:2468] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.567107  3823 leader_election.cc:304] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:03.568145  4015 raft_consensus.cc:2804] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.568051  3749 leader_election.cc:304] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:03.568750  4015 raft_consensus.cc:493] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.569129  4015 raft_consensus.cc:3060] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.570158  3926 raft_consensus.cc:2749] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:03.572557  4013 raft_consensus.cc:2749] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.550995  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:03.574779  3709 raft_consensus.cc:2393] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:03.553320  3910 raft_consensus.cc:2804] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.576104  3910 raft_consensus.cc:697] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:03.577180  3910 consensus_queue.cc:237] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.552599  3633 raft_consensus.cc:2468] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.579030  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2564f8ed8426c86a221202e92fec9" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.562721  4010 raft_consensus.cc:2749] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.581516  3903 ts_tablet_manager.cc:1434] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:26:03.582487  3903 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:03.552716  3909 consensus_queue.cc:1048] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:26:03.556568  3945 raft_consensus.cc:2804] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.553627  3979 leader_election.cc:290] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.592006  3945 raft_consensus.cc:493] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.597733  4012 raft_consensus.cc:493] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.590167  4011 consensus_queue.cc:1048] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:03.594537  4015 raft_consensus.cc:515] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.603200  3904 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.603747  4015 leader_election.cc:290] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:03.603834  3904 ts_tablet_manager.cc:1403] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.007s
I20260709 12:26:03.603832  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8454c8322445ccac78d42179633d56" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:03.605026  3783 raft_consensus.cc:3060] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.600442  4012 raft_consensus.cc:515] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.606829  3904 raft_consensus.cc:359] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.607192  4012 leader_election.cc:290] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:03.607540  3904 raft_consensus.cc:385] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.607833  3904 raft_consensus.cc:740] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.608460  3904 consensus_queue.cc:260] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.609011  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.554829  3529 catalog_manager.cc:5697] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:03.610659  3823 leader_election.cc:343] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.612017  3532 catalog_manager.cc:5697] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.613318  3635 raft_consensus.cc:2468] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:03.615327  3821 leader_election.cc:304] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:03.617136  3904 ts_tablet_manager.cc:1434] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:26:03.618149  3904 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.600024  3945 raft_consensus.cc:3060] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.621032  4012 raft_consensus.cc:2749] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:03.619644  4011 consensus_queue.cc:1048] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:26:03.633395  3905 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.634089  3905 ts_tablet_manager.cc:1403] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.186s	user 0.016s	sys 0.003s
I20260709 12:26:03.626073  3673 leader_election.cc:304] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:03.653180  3905 raft_consensus.cc:359] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.654343  3903 tablet_bootstrap.cc:654] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.655170  3905 raft_consensus.cc:385] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.656672  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.655622  3905 raft_consensus.cc:740] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.652786  4012 consensus_queue.cc:1048] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:26:03.663587  3944 raft_consensus.cc:2804] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.664178  3944 raft_consensus.cc:697] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:03.664443  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8454c8322445ccac78d42179633d56" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.665038  3635 raft_consensus.cc:3060] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.665079  3944 consensus_queue.cc:237] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.668849  3905 consensus_queue.cc:260] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.675657  3905 ts_tablet_manager.cc:1434] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:26:03.676983  3905 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:03.678889  3906 tablet_bootstrap.cc:654] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.662067  3531 catalog_manager.cc:5697] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.684867  3529 catalog_manager.cc:5697] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.652494  3783 raft_consensus.cc:2468] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:03.716535  3905 tablet_bootstrap.cc:654] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.717406  3904 tablet_bootstrap.cc:654] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.722359  3823 leader_election.cc:304] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:03.723410  4012 raft_consensus.cc:2804] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.723979  3635 raft_consensus.cc:2468] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:03.723935  4012 raft_consensus.cc:697] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:03.727897  4012 consensus_queue.cc:237] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
W20260709 12:26:03.718418  3821 leader_election.cc:343] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.749657  3903 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:03.750280  3903 ts_tablet_manager.cc:1403] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.010s
I20260709 12:26:03.753077  3903 raft_consensus.cc:359] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.753811  3903 raft_consensus.cc:385] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.754127  3903 raft_consensus.cc:740] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.754868  3903 consensus_queue.cc:260] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.757155  3903 ts_tablet_manager.cc:1434] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:26:03.758277  4020 log.cc:927] Time spent T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:26:03.758395  3903 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:03.760967  3821 leader_election.cc:304] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:03.761852  3979 raft_consensus.cc:2749] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:03.762017  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:42391, user_credentials={real_user=slave}} blocked reactor thread for 44045.8us
I20260709 12:26:03.769723  3919 consensus_queue.cc:1048] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.770642  3945 raft_consensus.cc:515] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.777500  3903 tablet_bootstrap.cc:654] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.788605  3904 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.789113  3904 ts_tablet_manager.cc:1403] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.004s
I20260709 12:26:03.800482  3529 catalog_manager.cc:5697] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.804458  3945 leader_election.cc:290] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:03.791802  3904 raft_consensus.cc:359] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.805446  3904 raft_consensus.cc:385] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.805513  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34086c6e095d4c1db4b41a140eb4db42" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:03.805792  3904 raft_consensus.cc:740] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.806195  3631 raft_consensus.cc:3060] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.806700  3941 consensus_queue.cc:1048] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.808079  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34086c6e095d4c1db4b41a140eb4db42" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:03.808696  3854 raft_consensus.cc:3060] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.814510  3631 raft_consensus.cc:2468] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:03.806653  3904 consensus_queue.cc:260] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.815042  3905 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.815626  3673 leader_election.cc:304] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.815991  3905 ts_tablet_manager.cc:1403] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.003s
I20260709 12:26:03.816550  3945 raft_consensus.cc:2804] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.817226  3945 raft_consensus.cc:697] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:03.818315  3904 ts_tablet_manager.cc:1434] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:26:03.818037  3945 consensus_queue.cc:237] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.818687  3905 raft_consensus.cc:359] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.819368  3905 raft_consensus.cc:385] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.819677  3905 raft_consensus.cc:740] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.820577  3905 consensus_queue.cc:260] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.822710  3905 ts_tablet_manager.cc:1434] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:03.823314  3903 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:03.823668  3905 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:03.823823  3903 ts_tablet_manager.cc:1403] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.006s
I20260709 12:26:03.825781  3903 raft_consensus.cc:359] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.826203  3903 raft_consensus.cc:385] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.826361  3903 raft_consensus.cc:740] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.826767  3903 consensus_queue.cc:260] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.828392  3903 ts_tablet_manager.cc:1434] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:03.829231  3903 tablet_bootstrap.cc:492] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:03.819330  3904 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.834206  3903 tablet_bootstrap.cc:654] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.839462  3905 tablet_bootstrap.cc:654] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.841231  3904 tablet_bootstrap.cc:654] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.841369  3533 catalog_manager.cc:5697] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.853119  3854 raft_consensus.cc:2468] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:03.862231  3903 tablet_bootstrap.cc:492] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:03.859081  3941 consensus_queue.cc:1048] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.863029  3903 ts_tablet_manager.cc:1403] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.001s
I20260709 12:26:03.856463  3906 tablet_bootstrap.cc:492] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:03.864418  3906 ts_tablet_manager.cc:1403] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.331s	user 0.015s	sys 0.027s
I20260709 12:26:03.868530  3903 raft_consensus.cc:359] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.869366  3903 raft_consensus.cc:385] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.869719  3903 raft_consensus.cc:740] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.870512  3903 consensus_queue.cc:260] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.873937  3903 ts_tablet_manager.cc:1434] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:03.878050  3906 raft_consensus.cc:359] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.878768  3906 raft_consensus.cc:385] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.879045  3906 raft_consensus.cc:740] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.881506  3905 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.882021  3905 ts_tablet_manager.cc:1403] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.059s	user 0.000s	sys 0.012s
I20260709 12:26:03.882014  3906 consensus_queue.cc:260] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.884610  3906 ts_tablet_manager.cc:1434] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:03.885506  3906 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:03.885252  3905 raft_consensus.cc:359] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.885901  3905 raft_consensus.cc:385] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.886152  3905 raft_consensus.cc:740] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.886765  3905 consensus_queue.cc:260] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.888809  3905 ts_tablet_manager.cc:1434] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:03.888945  3904 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.889487  3904 ts_tablet_manager.cc:1403] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.021s
I20260709 12:26:03.889797  3905 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:03.890225  3903 tablet_bootstrap.cc:492] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:03.892192  3906 tablet_bootstrap.cc:654] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.892163  3904 raft_consensus.cc:359] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.892970  3904 raft_consensus.cc:385] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.893268  3904 raft_consensus.cc:740] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.894116  3904 consensus_queue.cc:260] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.896425  3904 ts_tablet_manager.cc:1434] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:03.897013  3903 tablet_bootstrap.cc:654] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.897360  3904 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.897403  3533 catalog_manager.cc:5697] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.906189  3904 tablet_bootstrap.cc:654] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.916363  3910 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.917049  3910 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.919750  3910 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.920598  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.920833  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:03.921559  3708 raft_consensus.cc:2468] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:03.923430  3904 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:03.923918  3904 ts_tablet_manager.cc:1403] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.007s
I20260709 12:26:03.926363  3600 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.927312  3910 raft_consensus.cc:2804] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.927601  3926 raft_consensus.cc:493] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.927800  3904 raft_consensus.cc:359] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.927724  3905 tablet_bootstrap.cc:654] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.928507  3904 raft_consensus.cc:385] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.929101  3904 raft_consensus.cc:740] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.929806  3904 consensus_queue.cc:260] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:03.931342  3906 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:03.931737  3904 ts_tablet_manager.cc:1434] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:03.927753  3910 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.933710  3910 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.928102  3926 raft_consensus.cc:515] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.928618  3909 raft_consensus.cc:493] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:03.932659  3600 leader_election.cc:343] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.933806  3906 ts_tablet_manager.cc:1403] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.023s
I20260709 12:26:03.938835  3926 leader_election.cc:290] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:03.940352  3906 raft_consensus.cc:359] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.941385  3906 raft_consensus.cc:385] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.941772  3906 raft_consensus.cc:740] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.940886  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a9c64911b442eda89bd4c07b1e6d86" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.942984  3909 raft_consensus.cc:515] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.943584  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a9c64911b442eda89bd4c07b1e6d86" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.944537  3708 raft_consensus.cc:2468] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:03.945163  3909 leader_election.cc:290] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:03.943579  3633 raft_consensus.cc:2468] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:03.947512  3747 leader_election.cc:304] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.948917  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a72b5e7b494de79530011f65394787" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:03.949546  3633 raft_consensus.cc:2468] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:03.949987  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a72b5e7b494de79530011f65394787" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:03.950778  3747 leader_election.cc:304] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:03.943001  3906 consensus_queue.cc:260] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.951872  3969 raft_consensus.cc:2804] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.952041  3854 raft_consensus.cc:2468] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:03.952286  3969 raft_consensus.cc:493] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.952674  3969 raft_consensus.cc:3060] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.954908  4012 raft_consensus.cc:493] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.955705  4012 raft_consensus.cc:515] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.957662  3906 ts_tablet_manager.cc:1434] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:26:03.959075  3906 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:03.959316  4012 leader_election.cc:290] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.961063  3904 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:03.950826  3909 raft_consensus.cc:2804] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.964150  3909 raft_consensus.cc:493] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.964493  3909 raft_consensus.cc:3060] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.964401  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
W20260709 12:26:03.966274  3823 leader_election.cc:343] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.967585  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:03.968272  3708 raft_consensus.cc:2468] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:03.968740  3906 tablet_bootstrap.cc:654] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.969486  3823 leader_election.cc:304] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:03.970755  4012 raft_consensus.cc:2804] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.971223  4012 raft_consensus.cc:493] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.970981  3910 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:03.971750  4012 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.974408  3910 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:03.975988  3904 tablet_bootstrap.cc:654] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.979847  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
W20260709 12:26:03.981576  3600 leader_election.cc:343] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.988147  3969 raft_consensus.cc:515] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:03.990280  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:03.991166  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a72b5e7b494de79530011f65394787" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:03.991947  3854 raft_consensus.cc:3060] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.994161  3903 tablet_bootstrap.cc:492] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:03.994903  3903 ts_tablet_manager.cc:1403] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.019s
I20260709 12:26:03.997174  3905 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:03.997663  3905 ts_tablet_manager.cc:1403] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.108s	user 0.037s	sys 0.033s
I20260709 12:26:03.998750  3903 raft_consensus.cc:359] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:03.999902  3903 raft_consensus.cc:385] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.000236  3903 raft_consensus.cc:740] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.001325  3969 leader_election.cc:290] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:04.003670  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a72b5e7b494de79530011f65394787" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:04.002461  3926 raft_consensus.cc:493] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.012755  3926 raft_consensus.cc:515] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.014086  3854 raft_consensus.cc:2468] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:04.011981  3633 raft_consensus.cc:3060] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.001346  3903 consensus_queue.cc:260] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.015419  3749 leader_election.cc:304] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:04.016538  3941 raft_consensus.cc:2804] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.016710  3910 raft_consensus.cc:493] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.017074  3941 raft_consensus.cc:697] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:04.017496  3903 ts_tablet_manager.cc:1434] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:26:04.017274  3910 raft_consensus.cc:515] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.017982  3941 consensus_queue.cc:237] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.018925  3903 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:04.019534  3910 leader_election.cc:290] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.033020  3945 consensus_queue.cc:1048] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.038461  3910 raft_consensus.cc:493] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.039453  3708 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.040442  3945 raft_consensus.cc:493] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.041038  3945 raft_consensus.cc:515] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.041668  3904 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:04.042151  3904 ts_tablet_manager.cc:1403] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.081s	user 0.033s	sys 0.035s
I20260709 12:26:04.020340  3926 leader_election.cc:290] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:04.022022  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:04.043399  3903 tablet_bootstrap.cc:654] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.026507  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.043949  3710 raft_consensus.cc:2468] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:04.027060  3905 raft_consensus.cc:359] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.044839  3905 raft_consensus.cc:385] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.045192  3905 raft_consensus.cc:740] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.028076  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.045001  3904 raft_consensus.cc:359] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.045946  3855 raft_consensus.cc:2468] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:04.045047  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.046061  3905 consensus_queue.cc:260] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.024365  3909 raft_consensus.cc:515] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.047305  3600 leader_election.cc:304] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:04.048121  4010 raft_consensus.cc:2804] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.048502  4010 raft_consensus.cc:493] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.048839  4010 raft_consensus.cc:3060] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.049015  3909 leader_election.cc:290] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.051162  3905 ts_tablet_manager.cc:1434] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
W20260709 12:26:04.051965  3675 leader_election.cc:343] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.052214  3905 tablet_bootstrap.cc:492] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:04.053100  3904 raft_consensus.cc:385] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.057096  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a9c64911b442eda89bd4c07b1e6d86" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:04.057699  3635 raft_consensus.cc:3060] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.060055  3749 leader_election.cc:304] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:04.061563  3909 raft_consensus.cc:2804] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.061941  3909 raft_consensus.cc:493] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.062321  3909 raft_consensus.cc:3060] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.062245  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a9c64911b442eda89bd4c07b1e6d86" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:04.063053  3710 raft_consensus.cc:3060] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.066011  4013 consensus_queue.cc:1048] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.069458  3909 raft_consensus.cc:515] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.053543  3904 raft_consensus.cc:740] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.071791  3904 consensus_queue.cc:260] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.080124  3635 raft_consensus.cc:2468] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:04.081516  3747 leader_election.cc:304] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:04.076145  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:04.039187  3910 raft_consensus.cc:515] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.091215  3909 leader_election.cc:290] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:04.075397  3710 raft_consensus.cc:2468] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:04.090757  3904 ts_tablet_manager.cc:1434] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 12:26:04.095417  3904 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:04.096243  3633 raft_consensus.cc:2468] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:04.097563  3632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:04.100338  3635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:04.084172  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.095499  3941 raft_consensus.cc:2804] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.113680  3631 raft_consensus.cc:2468] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:04.094515  3945 leader_election.cc:290] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:04.084793  3915 consensus_queue.cc:1048] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:26:04.098320  3857 raft_consensus.cc:3060] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.097954  4012 raft_consensus.cc:515] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.117228  4004 consensus_queue.cc:1048] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:26:04.132910  3600 leader_election.cc:343] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.133008  3979 consensus_queue.cc:1048] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.133920  3903 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:04.134435  3903 ts_tablet_manager.cc:1403] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.009s
I20260709 12:26:04.138119  3903 raft_consensus.cc:359] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.138908  3903 raft_consensus.cc:385] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.139454  3903 raft_consensus.cc:740] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.122172  3910 leader_election.cc:290] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
W20260709 12:26:04.123281  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:04.146965  3904 tablet_bootstrap.cc:654] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.125006  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:04.126449  4013 consensus_queue.cc:1048] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.140635  3903 consensus_queue.cc:260] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.144263  3708 raft_consensus.cc:2468] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:04.123484  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.129844  3941 raft_consensus.cc:697] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:04.153877  3903 ts_tablet_manager.cc:1434] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:26:04.154659  3903 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:04.151469  3969 raft_consensus.cc:493] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.157594  3969 raft_consensus.cc:515] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.158799  3941 consensus_queue.cc:237] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.159978  3969 leader_election.cc:290] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.162238  4010 raft_consensus.cc:515] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.164806  3857 raft_consensus.cc:2468] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:04.153584  3782 raft_consensus.cc:2393] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a423544d890d41e7870787a3a92aaf58 in current term 1: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:04.170607  3905 tablet_bootstrap.cc:654] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.171944  4012 leader_election.cc:290] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:04.176043  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:04.177146  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:04.178032  4053 consensus_queue.cc:1048] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.175781  3600 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:04.188046  3707 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.194731  3632 raft_consensus.cc:2393] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:04.199259  3673 leader_election.cc:304] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:04.193328  3783 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.200086  3910 consensus_queue.cc:1048] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.199435  4004 raft_consensus.cc:2804] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.201681  4004 raft_consensus.cc:697] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:04.202528  4004 consensus_queue.cc:237] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.179055  3915 consensus_queue.cc:1048] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:26:04.205327  4053 raft_consensus.cc:3060] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.199275  3600 leader_election.cc:304] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.210778  3903 tablet_bootstrap.cc:654] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.212888  3910 raft_consensus.cc:3060] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.220901  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
W20260709 12:26:04.222312  3600 leader_election.cc:343] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.224836  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:04.226418  4010 leader_election.cc:290] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.230311  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e785fdbe084aef961fc9cf1821b023" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.233650  4052 raft_consensus.cc:493] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.234155  4052 raft_consensus.cc:515] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.237330  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:04.238379  3783 raft_consensus.cc:2468] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
W20260709 12:26:04.238725  3747 leader_election.cc:343] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.239553  4052 leader_election.cc:290] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:04.258424  3910 raft_consensus.cc:2749] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.266927  3906 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:04.267472  3906 ts_tablet_manager.cc:1403] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.309s	user 0.021s	sys 0.006s
I20260709 12:26:04.269433  4053 raft_consensus.cc:2749] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.270218  3906 raft_consensus.cc:359] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.271070  3906 raft_consensus.cc:385] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.271360  3906 raft_consensus.cc:740] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.271998  3906 consensus_queue.cc:260] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.272380  3823 leader_election.cc:304] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:04.274084  3906 ts_tablet_manager.cc:1434] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:04.274359  4001 raft_consensus.cc:2804] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.274999  3906 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:04.274912  4001 raft_consensus.cc:697] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:04.280220  3915 consensus_queue.cc:1048] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:04.276271  4013 raft_consensus.cc:493] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.283792  4013 raft_consensus.cc:515] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.286531  4013 leader_election.cc:290] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.275544  4009 consensus_queue.cc:1048] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:26:04.276685  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e785fdbe084aef961fc9cf1821b023" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.291672  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bfda24e32c4fd597a2a4aad2ca9d23" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:04.291684  3706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bfda24e32c4fd597a2a4aad2ca9d23" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.295869  4001 consensus_queue.cc:237] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.298309  3706 raft_consensus.cc:2468] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:04.299634  3823 leader_election.cc:304] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:04.300187  3915 consensus_queue.cc:1048] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.301378  3633 raft_consensus.cc:2468] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:04.300581  4009 raft_consensus.cc:2804] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.305116  4009 raft_consensus.cc:493] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.289592  3749 leader_election.cc:304] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
W20260709 12:26:04.307180  4055 log.cc:927] Time spent T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:26:04.340330  4061 log.cc:927] Time spent T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:26:04.308826  3749 leader_election.cc:343] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.311103  4052 raft_consensus.cc:2804] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.307500  4009 raft_consensus.cc:3060] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.337304  3708 raft_consensus.cc:2468] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:04.356938  3905 tablet_bootstrap.cc:492] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:04.358496  3905 ts_tablet_manager.cc:1403] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.306s	user 0.015s	sys 0.010s
W20260709 12:26:04.354717  3749 leader_election.cc:343] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.341547  3707 raft_consensus.cc:2468] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:04.360703  3749 leader_election.cc:304] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.364593  3906 tablet_bootstrap.cc:654] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.364748  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.365284  3969 raft_consensus.cc:2749] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.369787  3600 leader_election.cc:304] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.371418  4004 raft_consensus.cc:2804] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.371923  4004 raft_consensus.cc:697] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:04.372763  4004 consensus_queue.cc:237] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.373826  3903 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:04.374290  3903 ts_tablet_manager.cc:1403] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.220s	user 0.013s	sys 0.013s
I20260709 12:26:04.374457  3904 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:04.374926  3904 ts_tablet_manager.cc:1403] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.280s	user 0.008s	sys 0.016s
I20260709 12:26:04.351850  4052 raft_consensus.cc:697] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:04.377291  4052 consensus_queue.cc:237] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.381639  3903 raft_consensus.cc:359] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.382934  3903 raft_consensus.cc:385] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.383287  3903 raft_consensus.cc:740] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.384109  3903 consensus_queue.cc:260] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.377383  3904 raft_consensus.cc:359] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.385831  3904 raft_consensus.cc:385] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.386081  3904 raft_consensus.cc:740] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.386379  3903 ts_tablet_manager.cc:1434] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:26:04.386777  3904 consensus_queue.cc:260] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.387403  3903 tablet_bootstrap.cc:492] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:04.388742  3904 ts_tablet_manager.cc:1434] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:26:04.389688  3904 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
W20260709 12:26:04.396507  3749 leader_election.cc:343] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.396998  3749 leader_election.cc:304] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:04.397251  3904 tablet_bootstrap.cc:654] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.398592  3941 raft_consensus.cc:2749] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.395051  3905 raft_consensus.cc:359] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.403702  3905 raft_consensus.cc:385] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.404078  3905 raft_consensus.cc:740] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.408612  3905 consensus_queue.cc:260] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.421033  3532 catalog_manager.cc:5697] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.428313  3944 raft_consensus.cc:493] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.428542  3906 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:04.429009  3906 ts_tablet_manager.cc:1403] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.012s
I20260709 12:26:04.428851  3944 raft_consensus.cc:515] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.433184  3906 raft_consensus.cc:359] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.433881  3906 raft_consensus.cc:385] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.434168  3906 raft_consensus.cc:740] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.434819  3906 consensus_queue.cc:260] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.435010  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e785fdbe084aef961fc9cf1821b023" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:04.439389  3782 raft_consensus.cc:2468] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:04.440735  3675 leader_election.cc:304] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:04.431497  3944 leader_election.cc:290] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.441964  3944 raft_consensus.cc:2804] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.442317  3944 raft_consensus.cc:493] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.442634  3944 raft_consensus.cc:3060] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.445397  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e785fdbe084aef961fc9cf1821b023" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:04.446856  3675 leader_election.cc:343] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.449792  3903 tablet_bootstrap.cc:654] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.450089  3906 ts_tablet_manager.cc:1434] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:26:04.451356  3906 tablet_bootstrap.cc:492] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:04.457003  4013 raft_consensus.cc:493] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.457562  4013 raft_consensus.cc:515] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.459858  4013 leader_election.cc:290] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.461426  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:04.461448  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.462733  3710 raft_consensus.cc:2393] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:04.463018  3905 ts_tablet_manager.cc:1434] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260709 12:26:04.463804  3906 tablet_bootstrap.cc:654] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.464108  3905 tablet_bootstrap.cc:492] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:04.464367  3823 leader_election.cc:304] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:04.465847  4013 raft_consensus.cc:3060] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.480396  3944 raft_consensus.cc:515] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.484512  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e785fdbe084aef961fc9cf1821b023" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:04.485376  3783 raft_consensus.cc:3060] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.492980  3903 tablet_bootstrap.cc:492] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:04.493706  3903 ts_tablet_manager.cc:1403] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.000s
I20260709 12:26:04.495469  3944 leader_election.cc:290] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.496884  4009 raft_consensus.cc:515] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.496961  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e785fdbe084aef961fc9cf1821b023" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:04.498803  3904 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:04.499338  3904 ts_tablet_manager.cc:1403] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.110s	user 0.032s	sys 0.056s
I20260709 12:26:04.501008  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bfda24e32c4fd597a2a4aad2ca9d23" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:04.501765  3633 raft_consensus.cc:3060] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.502343  3905 tablet_bootstrap.cc:654] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.501945  3904 raft_consensus.cc:359] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.502743  3904 raft_consensus.cc:385] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.503032  3904 raft_consensus.cc:740] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.504045  3904 consensus_queue.cc:260] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.504570  4013 raft_consensus.cc:2749] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.506155  3904 ts_tablet_manager.cc:1434] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 12:26:04.507804  3675 leader_election.cc:343] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.507977  3904 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:04.509017  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bfda24e32c4fd597a2a4aad2ca9d23" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:04.509649  3710 raft_consensus.cc:3060] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.506633  3903 raft_consensus.cc:359] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.512065  3903 raft_consensus.cc:385] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.512346  3903 raft_consensus.cc:740] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.513094  3903 consensus_queue.cc:260] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.515460  3903 ts_tablet_manager.cc:1434] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:26:04.516388  3903 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:04.518023  3710 raft_consensus.cc:2468] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:04.519330  3823 leader_election.cc:304] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:04.520304  4013 raft_consensus.cc:2804] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.521445  4009 leader_election.cc:290] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.520923  4013 raft_consensus.cc:697] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:04.523808  3904 tablet_bootstrap.cc:654] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.523892  3906 tablet_bootstrap.cc:492] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:04.524461  3906 ts_tablet_manager.cc:1403] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.010s
I20260709 12:26:04.524250  4013 consensus_queue.cc:237] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.525262  4004 raft_consensus.cc:493] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.525767  4004 raft_consensus.cc:515] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.527338  3633 raft_consensus.cc:2468] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:04.527878  4004 leader_election.cc:290] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.527004  3783 raft_consensus.cc:2468] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:04.529433  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.539330  3903 tablet_bootstrap.cc:654] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.530191  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:04.540318  3782 raft_consensus.cc:2468] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:04.527420  3906 raft_consensus.cc:359] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.541540  3906 raft_consensus.cc:385] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.541819  3906 raft_consensus.cc:740] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.541745  3530 catalog_manager.cc:5697] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.542761  3906 consensus_queue.cc:260] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.544664  3903 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:04.544934  3906 ts_tablet_manager.cc:1434] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:26:04.545156  3903 ts_tablet_manager.cc:1403] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.003s
I20260709 12:26:04.545845  3906 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:04.546072  3531 catalog_manager.cc:5697] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.547555  4052 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.548019  4052 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
W20260709 12:26:04.541555  3600 leader_election.cc:343] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.549206  3600 leader_election.cc:304] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.550169  4052 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.550397  3675 leader_election.cc:304] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.550761  4004 raft_consensus.cc:2804] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.551187  4004 raft_consensus.cc:493] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.551546  4004 raft_consensus.cc:3060] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.551542  3944 raft_consensus.cc:2804] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.549157  3530 catalog_manager.cc:5697] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.555771  3944 raft_consensus.cc:697] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:04.556667  3944 consensus_queue.cc:237] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.559084  3904 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:04.559567  3904 ts_tablet_manager.cc:1403] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 12:26:04.560247  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:04.562307  3904 raft_consensus.cc:359] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.562989  3904 raft_consensus.cc:385] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.563285  3904 raft_consensus.cc:740] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.563416  3905 tablet_bootstrap.cc:492] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:04.557184  3906 tablet_bootstrap.cc:654] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.564066  3904 consensus_queue.cc:260] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.566535  3904 ts_tablet_manager.cc:1434] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:04.567500  3904 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:04.569661  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.564043  3905 ts_tablet_manager.cc:1403] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.000s
I20260709 12:26:04.570483  3710 raft_consensus.cc:2393] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:04.571736  3749 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:04.572929  4052 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.574388  3905 raft_consensus.cc:359] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.580300  3905 raft_consensus.cc:385] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.576313  3910 raft_consensus.cc:493] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.580706  3905 raft_consensus.cc:740] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.580868  3910 raft_consensus.cc:515] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.581645  3905 consensus_queue.cc:260] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.582954  3910 leader_election.cc:290] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:04.568471  4004 raft_consensus.cc:515] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.584681  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afd7a503cf84f9c8d8418173f48aa05" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:04.585588  4004 leader_election.cc:290] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.586668  3903 raft_consensus.cc:359] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.587021  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:04.587373  3903 raft_consensus.cc:385] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.587668  3903 raft_consensus.cc:740] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.588259  3903 consensus_queue.cc:260] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.590327  3903 ts_tablet_manager.cc:1434] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
W20260709 12:26:04.591570  3600 leader_election.cc:343] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.593272  3532 catalog_manager.cc:5697] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.595489  4052 raft_consensus.cc:2749] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.578347  3904 tablet_bootstrap.cc:654] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.597162  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:04.601476  3903 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:04.603380  3906 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:04.603852  3906 ts_tablet_manager.cc:1403] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.027s
I20260709 12:26:04.606594  3906 raft_consensus.cc:359] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.607256  3906 raft_consensus.cc:385] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.607510  3906 raft_consensus.cc:740] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.607978  3903 tablet_bootstrap.cc:654] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.608316  3906 consensus_queue.cc:260] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.609504  3904 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:04.609968  3904 ts_tablet_manager.cc:1403] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.004s
I20260709 12:26:04.611145  3906 ts_tablet_manager.cc:1434] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:04.612804  3906 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:04.612617  3904 raft_consensus.cc:359] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.614481  3904 raft_consensus.cc:385] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.614758  3904 raft_consensus.cc:740] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.615419  3904 consensus_queue.cc:260] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.617620  3904 ts_tablet_manager.cc:1434] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:04.618467  3904 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:04.621519  3906 tablet_bootstrap.cc:654] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.625967  3904 tablet_bootstrap.cc:654] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.629974  3903 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:04.630441  3903 ts_tablet_manager.cc:1403] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.006s
I20260709 12:26:04.633220  3903 raft_consensus.cc:359] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.633888  3903 raft_consensus.cc:385] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.634128  3903 raft_consensus.cc:740] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.634776  3903 consensus_queue.cc:260] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.597803  3783 raft_consensus.cc:3060] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.638551  3903 ts_tablet_manager.cc:1434] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:04.643965  4052 consensus_queue.cc:1048] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:04.645115  3600 leader_election.cc:343] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.646111  4004 consensus_queue.cc:1048] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.658087  3903 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:04.657637  3530 catalog_manager.cc:5697] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.667352  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afd7a503cf84f9c8d8418173f48aa05" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.664675  3903 tablet_bootstrap.cc:654] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:04.670869  3600 leader_election.cc:343] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.671463  3600 leader_election.cc:304] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:04.672372  4004 raft_consensus.cc:2749] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.677897  3783 raft_consensus.cc:2468] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:04.678984  3905 ts_tablet_manager.cc:1434] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.000s
I20260709 12:26:04.679145  4004 raft_consensus.cc:493] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.679654  4004 raft_consensus.cc:515] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.681094  3926 consensus_queue.cc:1048] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.681756  3906 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:04.682291  3906 ts_tablet_manager.cc:1403] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.010s
I20260709 12:26:04.682194  4004 leader_election.cc:290] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.684053  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.684710  3854 raft_consensus.cc:2468] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:04.685233  3906 raft_consensus.cc:359] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.685932  3906 raft_consensus.cc:385] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.686229  3906 raft_consensus.cc:740] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.687052  3903 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:04.686892  3906 consensus_queue.cc:260] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.687602  3903 ts_tablet_manager.cc:1403] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 12:26:04.690367  3906 ts_tablet_manager.cc:1434] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:04.691352  3906 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:04.690794  3529 catalog_manager.cc:5697] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.693679  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:04.695676  3600 leader_election.cc:343] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.697607  3904 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:04.697696  3910 consensus_queue.cc:1048] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.698184  3904 ts_tablet_manager.cc:1403] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.015s
I20260709 12:26:04.701149  3904 raft_consensus.cc:359] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.701848  3904 raft_consensus.cc:385] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.702131  3904 raft_consensus.cc:740] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.702526  3600 leader_election.cc:304] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.703645  3910 raft_consensus.cc:2804] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.704146  3910 raft_consensus.cc:697] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:04.705610  3906 tablet_bootstrap.cc:654] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.705163  3941 consensus_queue.cc:1048] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.666972  3532 catalog_manager.cc:5697] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.705265  3910 consensus_queue.cc:237] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.702809  3904 consensus_queue.cc:260] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.711804  3904 ts_tablet_manager.cc:1434] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:26:04.712838  3904 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:04.713266  4004 raft_consensus.cc:493] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.713879  4004 raft_consensus.cc:515] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.680053  3905 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:04.718153  3600 leader_election.cc:304] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f
I20260709 12:26:04.719012  4010 raft_consensus.cc:2804] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.719446  4010 raft_consensus.cc:493] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.719823  4010 raft_consensus.cc:3060] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.723109  4004 leader_election.cc:290] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.724876  3903 raft_consensus.cc:359] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.725893  3903 raft_consensus.cc:385] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.726240  3903 raft_consensus.cc:740] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.726990  3903 consensus_queue.cc:260] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.729197  3903 ts_tablet_manager.cc:1434] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:26:04.729854  3941 consensus_queue.cc:1048] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.730261  4010 raft_consensus.cc:515] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.737080  3903 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:04.742461  4010 leader_election.cc:290] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.743450  3969 raft_consensus.cc:493] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.744143  3969 raft_consensus.cc:515] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.744864  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:04.745491  3855 raft_consensus.cc:3060] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.746591  3969 leader_election.cc:290] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.747581  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.748077  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13785e12812d4092839867d05c4bdd56" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.748592  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13785e12812d4092839867d05c4bdd56" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:04.748724  3708 raft_consensus.cc:2468] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
W20260709 12:26:04.749140  3600 leader_election.cc:343] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.749820  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
W20260709 12:26:04.750586  3749 leader_election.cc:343] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:04.753206  3600 leader_election.cc:343] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.753909  3749 leader_election.cc:304] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.755178  4052 raft_consensus.cc:2804] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.755692  4052 raft_consensus.cc:493] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.756009  4052 raft_consensus.cc:3060] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.756295  4013 consensus_queue.cc:1048] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.759064  3905 tablet_bootstrap.cc:654] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.759999  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:04.771440  3782 raft_consensus.cc:2468] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:04.773854  3903 tablet_bootstrap.cc:654] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.785310  3600 leader_election.cc:304] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.792760  3910 raft_consensus.cc:2804] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.799990  3910 raft_consensus.cc:493] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.800418  3910 raft_consensus.cc:3060] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.817248  3906 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:04.817675  3906 ts_tablet_manager.cc:1403] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.001s
I20260709 12:26:04.825492  3904 tablet_bootstrap.cc:654] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.830148  3906 raft_consensus.cc:359] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.830931  3906 raft_consensus.cc:385] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.831246  3906 raft_consensus.cc:740] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.831882  3906 consensus_queue.cc:260] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.832765  3910 raft_consensus.cc:515] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.835651  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:04.836174  3855 raft_consensus.cc:2468] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:04.837729  4052 raft_consensus.cc:515] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.838435  3600 leader_election.cc:304] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f
I20260709 12:26:04.839330  4004 raft_consensus.cc:2804] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.836665  3782 raft_consensus.cc:3060] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.839846  4004 raft_consensus.cc:697] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:04.840814  4004 consensus_queue.cc:237] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.836247  3969 consensus_queue.cc:1048] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.845736  3941 raft_consensus.cc:493] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.846248  3941 raft_consensus.cc:515] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.847515  4052 leader_election.cc:290] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.848161  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13785e12812d4092839867d05c4bdd56" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:04.848408  3941 leader_election.cc:290] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.850455  3903 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:04.851161  3903 ts_tablet_manager.cc:1403] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.015s
I20260709 12:26:04.853610  3632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afd7a503cf84f9c8d8418173f48aa05" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:04.854909  3906 ts_tablet_manager.cc:1434] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:26:04.854264  3632 raft_consensus.cc:2468] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:04.856132  3906 tablet_bootstrap.cc:492] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:04.857144  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:04.857810  3854 raft_consensus.cc:3060] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.861595  3747 leader_election.cc:304] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:04.863173  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afd7a503cf84f9c8d8418173f48aa05" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.865286  3941 raft_consensus.cc:2804] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.865648  4009 consensus_queue.cc:1048] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.863269  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13785e12812d4092839867d05c4bdd56" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:04.866972  4010 raft_consensus.cc:493] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.867146  3906 tablet_bootstrap.cc:654] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.867311  3707 raft_consensus.cc:3060] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.867532  4010 raft_consensus.cc:515] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:04.876935  4010 leader_election.cc:290] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:04.865685  3941 raft_consensus.cc:493] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.878166  3941 raft_consensus.cc:3060] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:04.865685  3749 leader_election.cc:343] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.883057  3707 raft_consensus.cc:2468] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
W20260709 12:26:04.883778  3749 leader_election.cc:343] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.884645  3749 leader_election.cc:304] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.885352  4052 raft_consensus.cc:2804] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.885857  4052 raft_consensus.cc:697] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:04.886690  4052 consensus_queue.cc:237] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.887872  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b9d18e76b34cc9968c3e9925c80b96" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:04.893378  3600 leader_election.cc:343] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.894405  4010 consensus_queue.cc:1048] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.898451  3903 raft_consensus.cc:359] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.899181  3903 raft_consensus.cc:385] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.899710  3903 raft_consensus.cc:740] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.903724  4059 consensus_queue.cc:1048] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.853791  3910 leader_election.cc:290] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:04.875324  3532 catalog_manager.cc:5697] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.905691  3903 consensus_queue.cc:260] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.936617  3854 raft_consensus.cc:2468] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:04.941849  3600 leader_election.cc:304] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:04.943019  4004 raft_consensus.cc:2804] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.943766  4004 raft_consensus.cc:697] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:04.944890  4004 consensus_queue.cc:237] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.953138  3903 ts_tablet_manager.cc:1434] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.001s
I20260709 12:26:04.953924  3903 tablet_bootstrap.cc:492] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:04.957733  4013 raft_consensus.cc:493] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.958247  4013 raft_consensus.cc:515] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:04.960283  4013 leader_election.cc:290] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:04.963641  3905 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:04.964151  3905 ts_tablet_manager.cc:1403] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.284s	user 0.017s	sys 0.010s
I20260709 12:26:04.952618  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b9d18e76b34cc9968c3e9925c80b96" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:04.951817  3782 raft_consensus.cc:2468] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:04.972174  3904 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:04.972684  3904 ts_tablet_manager.cc:1403] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.260s	user 0.014s	sys 0.007s
I20260709 12:26:04.971020  3941 raft_consensus.cc:515] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.977006  4052 consensus_queue.cc:1048] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.977955  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afd7a503cf84f9c8d8418173f48aa05" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:04.978667  3634 raft_consensus.cc:3060] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.978786  3905 raft_consensus.cc:359] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.979657  3905 raft_consensus.cc:385] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.977841  3904 raft_consensus.cc:359] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:04.980165  3905 raft_consensus.cc:740] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.980413  3904 raft_consensus.cc:385] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.980908  3904 raft_consensus.cc:740] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.984098  3904 consensus_queue.cc:260] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
W20260709 12:26:04.987135  3600 leader_election.cc:343] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.987718  3600 leader_election.cc:304] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:04.988659  4059 raft_consensus.cc:2749] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.987093  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e785fdbe084aef961fc9cf1821b023" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:04.989814  3782 raft_consensus.cc:2393] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:04.992197  3904 ts_tablet_manager.cc:1434] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:26:04.994064  3905 consensus_queue.cc:260] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:04.993046  4052 raft_consensus.cc:493] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.999946  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afd7a503cf84f9c8d8418173f48aa05" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:05.008900  3707 raft_consensus.cc:3060] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.004138  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e785fdbe084aef961fc9cf1821b023" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.005028  3905 ts_tablet_manager.cc:1434] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:26:05.014159  3905 tablet_bootstrap.cc:492] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:04.998662  3941 leader_election.cc:290] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:05.013803  4052 raft_consensus.cc:515] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.022858  4052 leader_election.cc:290] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:05.023612  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18de4c84f23a4190a5a0ac7d94128717" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:05.024070  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18de4c84f23a4190a5a0ac7d94128717" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.025509  3905 tablet_bootstrap.cc:654] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:05.025628  3749 leader_election.cc:343] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:05.026132  3747 leader_election.cc:343] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.026635  3747 leader_election.cc:304] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:05.027616  3941 raft_consensus.cc:2749] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.030114  4013 consensus_queue.cc:1048] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.033084  3823 leader_election.cc:304] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:05.033885  3904 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:05.037292  3906 tablet_bootstrap.cc:492] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:05.037837  3906 ts_tablet_manager.cc:1403] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.182s	user 0.009s	sys 0.003s
I20260709 12:26:05.037467  3903 tablet_bootstrap.cc:654] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.044659  3904 tablet_bootstrap.cc:654] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.034248  4013 raft_consensus.cc:3060] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.054483  3634 raft_consensus.cc:2468] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:05.057621  3707 raft_consensus.cc:2468] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:05.063319  3747 leader_election.cc:304] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:05.064545  3941 raft_consensus.cc:2804] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.065928  3941 raft_consensus.cc:697] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:05.067085  3941 consensus_queue.cc:237] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.068663  4009 consensus_queue.cc:1048] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.068886  3531 catalog_manager.cc:5697] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.075096  4013 raft_consensus.cc:2749] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.079349  4053 consensus_queue.cc:1048] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.086711  3905 tablet_bootstrap.cc:492] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:05.087349  3905 ts_tablet_manager.cc:1403] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.001s
I20260709 12:26:05.090075  3905 raft_consensus.cc:359] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.090976  3905 raft_consensus.cc:385] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.091404  3905 raft_consensus.cc:740] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.092553  3906 raft_consensus.cc:359] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.093133  3906 raft_consensus.cc:385] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.092748  3905 consensus_queue.cc:260] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.093446  3906 raft_consensus.cc:740] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.095295  3905 ts_tablet_manager.cc:1434] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:05.096269  3905 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:05.097746  3906 consensus_queue.cc:260] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.103196  4053 consensus_queue.cc:1048] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.104219  3905 tablet_bootstrap.cc:654] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.114720  4011 raft_consensus.cc:493] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.115312  4011 raft_consensus.cc:515] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.118114  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.118953  3784 raft_consensus.cc:2393] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:05.120471  3906 ts_tablet_manager.cc:1434] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.003s
I20260709 12:26:05.120383  4011 leader_election.cc:290] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:05.121753  3906 tablet_bootstrap.cc:492] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:05.122593  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:05.123250  3903 tablet_bootstrap.cc:492] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:05.123802  3903 ts_tablet_manager.cc:1403] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.170s	user 0.005s	sys 0.008s
I20260709 12:26:05.124063  3821 leader_election.cc:304] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:05.125212  4009 raft_consensus.cc:3060] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.132992  4009 raft_consensus.cc:2749] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.138708  3904 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:05.139278  3904 ts_tablet_manager.cc:1403] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.004s
I20260709 12:26:05.142149  3904 raft_consensus.cc:359] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.142814  3904 raft_consensus.cc:385] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.143110  3904 raft_consensus.cc:740] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.143811  3904 consensus_queue.cc:260] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.126677  3903 raft_consensus.cc:359] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.144811  3903 raft_consensus.cc:385] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.149660  3533 catalog_manager.cc:5697] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.145085  3903 raft_consensus.cc:740] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.155563  3905 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:05.156119  3905 ts_tablet_manager.cc:1403] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.016s
I20260709 12:26:05.156235  3903 consensus_queue.cc:260] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.159179  3905 raft_consensus.cc:359] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.159878  3905 raft_consensus.cc:385] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.160167  3905 raft_consensus.cc:740] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.161268  3905 consensus_queue.cc:260] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.161216  3532 catalog_manager.cc:5697] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.164105  3905 ts_tablet_manager.cc:1434] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:05.164535  3903 ts_tablet_manager.cc:1434] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:26:05.170158  3903 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:05.165714  4059 raft_consensus.cc:493] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.171802  4059 raft_consensus.cc:515] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.173918  4059 leader_election.cc:290] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:05.168066  3532 catalog_manager.cc:5697] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.176671  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.177348  3784 raft_consensus.cc:2468] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:05.169209  3906 tablet_bootstrap.cc:654] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.165185  3905 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:05.171324  3904 ts_tablet_manager.cc:1434] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:26:05.185883  3600 leader_election.cc:304] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:05.186722  4060 consensus_queue.cc:1048] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.188143  4060 raft_consensus.cc:2804] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.188513  4060 raft_consensus.cc:493] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.188877  3905 tablet_bootstrap.cc:654] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.189270  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:05.191660  3903 tablet_bootstrap.cc:654] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:05.192121  3600 leader_election.cc:343] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.188871  4060 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.197681  3904 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:05.207681  3903 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:05.208284  3903 ts_tablet_manager.cc:1403] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.002s
I20260709 12:26:05.208379  3904 tablet_bootstrap.cc:654] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:05.208525  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:05.219007  4060 raft_consensus.cc:515] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.221256  3903 raft_consensus.cc:359] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.222256  3903 raft_consensus.cc:385] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.222627  3903 raft_consensus.cc:740] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.223918  3903 consensus_queue.cc:260] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.226635  3903 ts_tablet_manager.cc:1434] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:05.227648  3903 tablet_bootstrap.cc:492] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:05.234758  3903 tablet_bootstrap.cc:654] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.238658  4004 consensus_queue.cc:1048] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:05.245219  4060 leader_election.cc:290] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:05.247818  4053 raft_consensus.cc:493] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.248348  4053 raft_consensus.cc:515] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.250538  4053 leader_election.cc:290] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:05.253394  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:05.256983  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:05.257555  3783 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.257706  3906 tablet_bootstrap.cc:492] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:05.258283  3906 ts_tablet_manager.cc:1403] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.009s
I20260709 12:26:05.261577  3904 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:05.262133  3904 ts_tablet_manager.cc:1403] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 12:26:05.262144  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:05.263214  3854 raft_consensus.cc:2393] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:05.264454  3906 raft_consensus.cc:359] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.265885  3904 raft_consensus.cc:359] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.267371  3904 raft_consensus.cc:385] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.267815  3904 raft_consensus.cc:740] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.267427  3906 raft_consensus.cc:385] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.268426  3906 raft_consensus.cc:740] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.268712  3904 consensus_queue.cc:260] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.269971  3906 consensus_queue.cc:260] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.272330  3904 ts_tablet_manager.cc:1434] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:26:05.274770  3904 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:05.272749  3675 leader_election.cc:304] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:05.276379  3906 ts_tablet_manager.cc:1434] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:05.276510  3903 tablet_bootstrap.cc:492] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:05.277069  3903 ts_tablet_manager.cc:1403] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.002s
I20260709 12:26:05.277479  3906 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:05.277603  3945 raft_consensus.cc:3060] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.289911  3945 raft_consensus.cc:2749] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.281252  3904 tablet_bootstrap.cc:654] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.280365  3903 raft_consensus.cc:359] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.295320  3903 raft_consensus.cc:385] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.295683  3903 raft_consensus.cc:740] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.296463  3903 consensus_queue.cc:260] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.298872  3903 ts_tablet_manager.cc:1434] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:26:05.301306  3903 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:05.301403  3906 tablet_bootstrap.cc:654] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.302249  3904 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:05.302889  3904 ts_tablet_manager.cc:1403] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.002s
I20260709 12:26:05.300102  3905 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:05.303818  3905 ts_tablet_manager.cc:1403] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.139s	user 0.034s	sys 0.020s
I20260709 12:26:05.304358  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
W20260709 12:26:05.306237  3600 leader_election.cc:343] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.306032  3904 raft_consensus.cc:359] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.307060  3904 raft_consensus.cc:385] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.306802  3905 raft_consensus.cc:359] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.307492  3904 raft_consensus.cc:740] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.308471  3904 consensus_queue.cc:260] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.307648  3905 raft_consensus.cc:385] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.311401  3905 raft_consensus.cc:740] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.311995  3904 ts_tablet_manager.cc:1434] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:05.312228  3905 consensus_queue.cc:260] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.313519  3904 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:05.314636  3905 ts_tablet_manager.cc:1434] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:26:05.315781  3905 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:05.314558  3783 raft_consensus.cc:2468] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:05.321028  3904 tablet_bootstrap.cc:654] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.322633  3903 tablet_bootstrap.cc:654] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.322943  4059 raft_consensus.cc:493] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.323518  4059 raft_consensus.cc:515] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.326092  4059 leader_election.cc:290] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:05.327543  3905 tablet_bootstrap.cc:654] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.333499  4009 raft_consensus.cc:493] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.334010  4009 raft_consensus.cc:515] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.336361  3903 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:05.336970  3903 ts_tablet_manager.cc:1403] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260709 12:26:05.337523  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4bf7a09d4943c2a597b74475baa619" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.338200  3707 raft_consensus.cc:2468] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:05.339159  3904 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:05.339356  3823 leader_election.cc:304] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:05.339884  3904 ts_tablet_manager.cc:1403] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.003s
I20260709 12:26:05.340185  3903 raft_consensus.cc:359] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.340698  4011 raft_consensus.cc:2804] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.341019  3903 raft_consensus.cc:385] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.341146  4011 raft_consensus.cc:493] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.341404  3903 raft_consensus.cc:740] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.341652  4011 raft_consensus.cc:3060] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.342203  3903 consensus_queue.cc:260] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.343253  3904 raft_consensus.cc:359] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.343871  4009 leader_election.cc:290] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.344084  3904 raft_consensus.cc:385] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.344969  3904 raft_consensus.cc:740] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.345477  3905 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:05.345999  3905 ts_tablet_manager.cc:1403] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 12:26:05.345809  3904 consensus_queue.cc:260] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.346407  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4bf7a09d4943c2a597b74475baa619" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.347117  3784 raft_consensus.cc:2468] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:05.348492  3904 ts_tablet_manager.cc:1434] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:05.349144  3905 raft_consensus.cc:359] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.349609  3904 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:05.349938  3905 raft_consensus.cc:385] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.350059  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c9a2da48a44e29f55803f43d316b4" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:05.353366  3903 ts_tablet_manager.cc:1434] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:26:05.354286  3600 leader_election.cc:304] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:05.354537  3903 tablet_bootstrap.cc:492] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:05.355399  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c9a2da48a44e29f55803f43d316b4" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.355682  3906 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:05.356272  3906 ts_tablet_manager.cc:1403] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.012s
I20260709 12:26:05.357147  3904 tablet_bootstrap.cc:654] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.350284  3905 raft_consensus.cc:740] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.359786  3905 consensus_queue.cc:260] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.357664  4011 raft_consensus.cc:515] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.362584  3905 ts_tablet_manager.cc:1434] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:26:05.362761  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4bf7a09d4943c2a597b74475baa619" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:05.363451  3708 raft_consensus.cc:3060] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.366957  3903 tablet_bootstrap.cc:654] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.369377  3905 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:05.370038  3904 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:05.370951  3904 ts_tablet_manager.cc:1403] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:26:05.372200  4059 raft_consensus.cc:2804] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.372702  4059 raft_consensus.cc:697] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:05.373590  4059 consensus_queue.cc:237] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.375356  3905 tablet_bootstrap.cc:654] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.390981  4107 raft_consensus.cc:493] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.391763  3905 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:05.391552  4107 raft_consensus.cc:515] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.392246  3905 ts_tablet_manager.cc:1403] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.004s
I20260709 12:26:05.392076  3906 raft_consensus.cc:359] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.392824  3906 raft_consensus.cc:385] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.392355  3904 raft_consensus.cc:359] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.393126  3906 raft_consensus.cc:740] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.393327  3904 raft_consensus.cc:385] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.393599  4107 leader_election.cc:290] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:05.393664  3904 raft_consensus.cc:740] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.393874  3906 consensus_queue.cc:260] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.394645  3904 consensus_queue.cc:260] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.395177  3708 raft_consensus.cc:2468] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:05.395639  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4342bbb0ea4e338952846096527efc" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:05.396521  3823 leader_election.cc:304] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
W20260709 12:26:05.397050  3749 leader_election.cc:343] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.397588  3904 ts_tablet_manager.cc:1434] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:26:05.397684  4011 leader_election.cc:290] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.397365  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4342bbb0ea4e338952846096527efc" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.398550  3904 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:05.398519  3905 raft_consensus.cc:359] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.399214  3905 raft_consensus.cc:385] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.399521  3905 raft_consensus.cc:740] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.400249  3905 consensus_queue.cc:260] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.403509  3905 ts_tablet_manager.cc:1434] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:05.404443  3905 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:05.404663  3906 ts_tablet_manager.cc:1434] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:26:05.412292  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4bf7a09d4943c2a597b74475baa619" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:05.412979  3783 raft_consensus.cc:3060] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.413450  3906 tablet_bootstrap.cc:492] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
W20260709 12:26:05.402215  3749 leader_election.cc:343] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.416090  4011 raft_consensus.cc:2804] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:05.417439  3600 leader_election.cc:343] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.425794  3904 tablet_bootstrap.cc:654] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.424418  4011 raft_consensus.cc:697] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:05.421365  3749 leader_election.cc:304] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:05.428872  4131 raft_consensus.cc:493] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.434535  4052 raft_consensus.cc:2749] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:05.429780  3600 leader_election.cc:343] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.437059  3903 tablet_bootstrap.cc:492] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:05.437740  3903 ts_tablet_manager.cc:1403] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.010s
I20260709 12:26:05.449293  3906 tablet_bootstrap.cc:654] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.436887  4131 raft_consensus.cc:515] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.455286  3854 raft_consensus.cc:3060] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.439711  3600 leader_election.cc:304] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:05.456672  4059 raft_consensus.cc:2749] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.445055  4011 consensus_queue.cc:237] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.466540  3903 raft_consensus.cc:359] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.467160  3903 raft_consensus.cc:385] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.465205  3945 raft_consensus.cc:493] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.467588  3903 raft_consensus.cc:740] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.467526  4060 consensus_queue.cc:1048] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:05.468770  3945 raft_consensus.cc:515] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.463035  3910 raft_consensus.cc:493] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.469975  3910 raft_consensus.cc:515] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.468384  3903 consensus_queue.cc:260] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.470886  3945 leader_election.cc:290] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.475623  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18de4c84f23a4190a5a0ac7d94128717" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:05.476342  3633 raft_consensus.cc:2468] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:05.478199  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18de4c84f23a4190a5a0ac7d94128717" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.478863  3782 raft_consensus.cc:2468] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:05.479498  4060 raft_consensus.cc:493] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.479986  4060 raft_consensus.cc:515] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.480201  3673 leader_election.cc:304] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:05.481600  3945 raft_consensus.cc:2804] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.481972  3945 raft_consensus.cc:493] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.482085  4060 leader_election.cc:290] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:05.482350  3945 raft_consensus.cc:3060] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.484854  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13785e12812d4092839867d05c4bdd56" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.485736  3707 raft_consensus.cc:2393] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:05.487027  3910 leader_election.cc:290] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.462270  4059 consensus_queue.cc:1048] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:26:05.489785  4131 leader_election.cc:290] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.492090  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13785e12812d4092839867d05c4bdd56" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.493603  3823 leader_election.cc:304] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:05.496194  4131 raft_consensus.cc:2749] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.497035  4053 raft_consensus.cc:493] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.497056  4052 consensus_queue.cc:1048] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:05.497710  4053 raft_consensus.cc:515] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.499835  4053 leader_election.cc:290] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:05.500465  3783 raft_consensus.cc:2468] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:05.501408  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c9a2da48a44e29f55803f43d316b4" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:05.501802  3532 catalog_manager.cc:5697] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.490865  3903 ts_tablet_manager.cc:1434] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
W20260709 12:26:05.505306  3675 leader_election.cc:343] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.506278  3903 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:05.512283  3905 tablet_bootstrap.cc:654] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.512382  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c9a2da48a44e29f55803f43d316b4" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:05.513410  3633 raft_consensus.cc:2468] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:05.514849  3673 leader_election.cc:304] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:05.516290  3944 raft_consensus.cc:2804] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.516647  3944 raft_consensus.cc:493] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.516976  3944 raft_consensus.cc:3060] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.518260  3945 raft_consensus.cc:515] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.534251  3904 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:05.534809  3904 ts_tablet_manager.cc:1403] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.009s
I20260709 12:26:05.535442  4052 consensus_queue.cc:1048] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.530629  4053 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.544996  4052 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.545621  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18de4c84f23a4190a5a0ac7d94128717" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:05.530633  4059 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.549844  3906 tablet_bootstrap.cc:492] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:05.551815  3633 raft_consensus.cc:3060] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.551676  4052 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.552374  3906 ts_tablet_manager.cc:1403] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.013s
I20260709 12:26:05.552134  4059 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.553864  4052 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:05.554154  4059 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.550890  3532 catalog_manager.cc:5697] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.554756  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:05.554719  4053 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.555747  3634 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:05.556684  3905 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:05.557163  3747 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:05.560781  3905 ts_tablet_manager.cc:1403] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.157s	user 0.009s	sys 0.006s
I20260709 12:26:05.561259  4107 raft_consensus.cc:2804] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.561721  4107 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.561861  3945 leader_election.cc:290] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.562157  4107 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.562891  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18de4c84f23a4190a5a0ac7d94128717" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:05.563489  3782 raft_consensus.cc:3060] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.564021  3905 raft_consensus.cc:359] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.564453  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:05.564790  3905 raft_consensus.cc:385] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.565243  3905 raft_consensus.cc:740] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.566015  3905 consensus_queue.cc:260] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.567343  3633 raft_consensus.cc:2468] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:05.568202  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.558370  4053 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.559036  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.560184  3903 tablet_bootstrap.cc:654] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.568440  3910 consensus_queue.cc:1048] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.569960  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18de4c84f23a4190a5a0ac7d94128717" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.568516  3905 ts_tablet_manager.cc:1434] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:26:05.551064  3904 raft_consensus.cc:359] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.571581  3904 raft_consensus.cc:385] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.571918  3904 raft_consensus.cc:740] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.571897  3905 tablet_bootstrap.cc:492] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:05.576462  3904 consensus_queue.cc:260] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.570415  3673 leader_election.cc:304] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:05.582300  3904 ts_tablet_manager.cc:1434] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
W20260709 12:26:05.584781  3600 leader_election.cc:343] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.575899  3784 raft_consensus.cc:2468] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:05.588223  4004 raft_consensus.cc:493] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.588891  4004 raft_consensus.cc:515] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.590868  4004 leader_election.cc:290] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:05.588205  3905 tablet_bootstrap.cc:654] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.595935  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:05.597826  3600 leader_election.cc:343] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.597968  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18de4c84f23a4190a5a0ac7d94128717" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.604494  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.606889  3709 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:05.605020  3706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.607620  3706 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:05.600939  4053 raft_consensus.cc:2804] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.608657  4053 raft_consensus.cc:697] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:05.581475  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:05.609583  4053 consensus_queue.cc:237] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.610123  3634 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:05.611305  3780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.612390  3673 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:05.578404  3944 raft_consensus.cc:515] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.633908  3904 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:05.619062  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:05.643432  3906 raft_consensus.cc:359] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.644464  3906 raft_consensus.cc:385] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.644816  3906 raft_consensus.cc:740] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.633030  3945 raft_consensus.cc:2804] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.646729  3906 consensus_queue.cc:260] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.631868  3600 leader_election.cc:304] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:05.651172  3945 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:05.672353  4146 log.cc:927] Time spent T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:26:05.672452  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:36779, user_credentials={real_user=slave}} blocked reactor thread for 58165.4us
I20260709 12:26:05.672757  3944 leader_election.cc:290] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:05.673687  3904 tablet_bootstrap.cc:654] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.674427  3600 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
W20260709 12:26:05.694222  3675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:36779, user_credentials={real_user=slave}} blocked reactor thread for 75520.4us
I20260709 12:26:05.698788  4153 consensus_queue.cc:1048] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:05.708259  3906 ts_tablet_manager.cc:1434] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.155s	user 0.005s	sys 0.004s
I20260709 12:26:05.709435  3906 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:05.668540  3945 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.706403  3910 raft_consensus.cc:2804] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.718290  3903 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:05.720081  3903 ts_tablet_manager.cc:1403] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.214s	user 0.014s	sys 0.008s
I20260709 12:26:05.713205  4131 raft_consensus.cc:493] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.711563  4010 raft_consensus.cc:2804] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.710712  4155 consensus_queue.cc:1048] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:26:05.726480  4107 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.730142  3783 raft_consensus.cc:2393] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:05.728392  4010 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.731642  4010 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.733853  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c9a2da48a44e29f55803f43d316b4" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:05.734860  3906 tablet_bootstrap.cc:654] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:05.740797  3675 leader_election.cc:343] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.706497  4004 consensus_queue.cc:1048] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:26:05.744678  4010 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.719875  3910 raft_consensus.cc:493] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:05.715708  3749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:41805, user_credentials={real_user=slave}} blocked reactor thread for 60905.6us
I20260709 12:26:05.761629  3910 raft_consensus.cc:3060] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.794133  4010 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:05.746248  4131 raft_consensus.cc:515] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.795847  3903 raft_consensus.cc:359] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.796576  3903 raft_consensus.cc:385] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.796837  3903 raft_consensus.cc:740] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.797737  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c9a2da48a44e29f55803f43d316b4" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:05.798569  3633 raft_consensus.cc:3060] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.797474  3903 consensus_queue.cc:260] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.812036  3903 ts_tablet_manager.cc:1434] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.001s
I20260709 12:26:05.812882  3903 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
W20260709 12:26:05.801703  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:41805, user_credentials={real_user=slave}} blocked reactor thread for 74520.7us
I20260709 12:26:05.814152  4154 raft_consensus.cc:493] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.814872  3782 raft_consensus.cc:2468] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:05.831049  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b9d18e76b34cc9968c3e9925c80b96" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:05.831599  4154 raft_consensus.cc:515] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.839452  3904 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:05.839960  3904 ts_tablet_manager.cc:1403] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.206s	user 0.010s	sys 0.011s
I20260709 12:26:05.842559  3905 tablet_bootstrap.cc:492] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:05.843273  3905 ts_tablet_manager.cc:1403] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.272s	user 0.013s	sys 0.008s
I20260709 12:26:05.845921  3631 raft_consensus.cc:2468] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:05.847791  3821 leader_election.cc:304] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:05.848702  4009 raft_consensus.cc:2804] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.849085  4009 raft_consensus.cc:493] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.849444  4009 raft_consensus.cc:3060] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.849575  4107 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:05.842670  3904 raft_consensus.cc:359] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.845944  3905 raft_consensus.cc:359] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.870873  3905 raft_consensus.cc:385] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.871035  3904 raft_consensus.cc:385] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.871366  3904 raft_consensus.cc:740] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.874096  3904 consensus_queue.cc:260] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.860445  3708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:05.871256  3905 raft_consensus.cc:740] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
W20260709 12:26:05.829306  3600 leader_election.cc:343] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.862011  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:05.864840  4131 leader_election.cc:290] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:05.885035  3905 consensus_queue.cc:260] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:05.888150  3904 ts_tablet_manager.cc:1434] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260709 12:26:05.890326  3904 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:05.869611  4009 raft_consensus.cc:515] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:05.892513  3631 raft_consensus.cc:2393] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:05.879092  3633 raft_consensus.cc:2468] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:05.895891  3906 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:05.896814  3906 ts_tablet_manager.cc:1403] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.188s	user 0.026s	sys 0.032s
I20260709 12:26:05.882546  4154 leader_election.cc:290] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:05.879591  3910 raft_consensus.cc:515] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.885358  3600 leader_election.cc:304] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:05.905150  4009 leader_election.cc:290] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:05.908347  3905 ts_tablet_manager.cc:1434] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.002s
I20260709 12:26:05.911252  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c02611ee24affaa7740ab42bc482b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.912835  3905 tablet_bootstrap.cc:492] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:05.913290  3910 leader_election.cc:290] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
W20260709 12:26:05.918113  3749 leader_election.cc:343] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.920718  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c02611ee24affaa7740ab42bc482b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:05.921816  3532 catalog_manager.cc:5697] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.918130  3904 tablet_bootstrap.cc:654] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:05.923743  3749 leader_election.cc:343] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.924240  3749 leader_election.cc:304] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:05.926465  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b9d18e76b34cc9968c3e9925c80b96" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:05.927716  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b9d18e76b34cc9968c3e9925c80b96" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
W20260709 12:26:05.927845  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:36779, user_credentials={real_user=slave}} blocked reactor thread for 100394us
I20260709 12:26:05.928335  3905 tablet_bootstrap.cc:654] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.928395  3633 raft_consensus.cc:3060] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.929593  4164 raft_consensus.cc:2749] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.916551  3906 raft_consensus.cc:359] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.933338  3906 raft_consensus.cc:385] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.933738  3906 raft_consensus.cc:740] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.927073  3705 raft_consensus.cc:3060] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.956950  3906 consensus_queue.cc:260] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.961195  3906 ts_tablet_manager.cc:1434] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.001s
I20260709 12:26:05.962052  3906 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:05.946270  4154 raft_consensus.cc:2749] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.954665  4153 raft_consensus.cc:493] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.964735  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b9d18e76b34cc9968c3e9925c80b96" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:05.979395  3673 leader_election.cc:304] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:05.984504  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:05.985481  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:05.986094  3784 raft_consensus.cc:3060] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.987912  3904 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:05.988454  3904 ts_tablet_manager.cc:1403] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.010s
I20260709 12:26:05.988544  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:05.980939  3945 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:05.992120  3708 raft_consensus.cc:2393] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:05.994953  3904 raft_consensus.cc:359] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:05.995472  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:05.995735  3904 raft_consensus.cc:385] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.996310  3783 raft_consensus.cc:2393] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a423544d890d41e7870787a3a92aaf58 in current term 1: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:05.997294  3904 raft_consensus.cc:740] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.996774  3906 tablet_bootstrap.cc:654] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.999513  3945 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:06.004022  3903 tablet_bootstrap.cc:654] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.007145  3749 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:05.972949  4153 raft_consensus.cc:515] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.009151  4004 raft_consensus.cc:493] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.011854  4004 raft_consensus.cc:515] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.013057  4153 leader_election.cc:290] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:06.013918  4004 leader_election.cc:290] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:06.011086  4155 raft_consensus.cc:2749] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.014569  3633 raft_consensus.cc:2468] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:06.007138  4131 consensus_queue.cc:1048] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:26:05.988016  4158 raft_consensus.cc:2804] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.016070  3821 leader_election.cc:304] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:06.016399  4158 raft_consensus.cc:697] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:06.017024  4131 raft_consensus.cc:2804] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.017527  4131 raft_consensus.cc:697] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:06.017328  4158 consensus_queue.cc:237] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.017787  3904 consensus_queue.cc:260] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.018404  4131 consensus_queue.cc:237] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.019743  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:06.019984  3904 ts_tablet_manager.cc:1434] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:26:06.021315  3904 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:06.021770  3782 raft_consensus.cc:2393] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:06.022727  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:06.032694  3747 leader_election.cc:343] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.019769  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.053689  3705 raft_consensus.cc:2468] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:06.058491  3904 tablet_bootstrap.cc:654] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.061678  3910 raft_consensus.cc:493] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.062227  3910 raft_consensus.cc:515] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.064268  3910 leader_election.cc:290] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:06.061496  4013 consensus_queue.cc:1048] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:06.065464  3600 leader_election.cc:343] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.066231  3600 leader_election.cc:304] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:06.067824  4004 raft_consensus.cc:2749] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:06.068706  4166 log.cc:927] Time spent T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:26:06.082506  3906 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:06.083494  3906 ts_tablet_manager.cc:1403] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.122s	user 0.023s	sys 0.017s
W20260709 12:26:06.043572  3673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:42391, user_credentials={real_user=slave}} blocked reactor thread for 58353.9us
I20260709 12:26:06.091198  3905 tablet_bootstrap.cc:492] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:06.091867  3905 ts_tablet_manager.cc:1403] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.181s	user 0.023s	sys 0.012s
I20260709 12:26:06.092592  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:06.093463  3633 raft_consensus.cc:2393] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:06.102681  3905 raft_consensus.cc:359] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.105041  3905 raft_consensus.cc:385] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.105445  3905 raft_consensus.cc:740] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.106215  3905 consensus_queue.cc:260] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.109382  3854 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.110133  4131 raft_consensus.cc:493] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.110657  4131 raft_consensus.cc:515] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.118876  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4342bbb0ea4e338952846096527efc" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.119621  3782 raft_consensus.cc:2468] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:06.121129  3823 leader_election.cc:304] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:06.122045  4013 raft_consensus.cc:2804] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.122462  4013 raft_consensus.cc:493] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.122838  4013 raft_consensus.cc:3060] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.127286  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547fe2b2ec4f42d4b2386ea1c9a7d2b9" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:06.129375  3784 raft_consensus.cc:2468] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
W20260709 12:26:06.129617  3749 leader_election.cc:343] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.130246  3749 leader_election.cc:304] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:06.132035  4153 raft_consensus.cc:2749] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.132746  4131 leader_election.cc:290] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:06.140439  3905 ts_tablet_manager.cc:1434] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:26:06.142131  3905 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:06.142310  4013 raft_consensus.cc:515] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.149175  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4342bbb0ea4e338952846096527efc" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:06.149856  3781 raft_consensus.cc:3060] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.153031  4159 consensus_queue.cc:1048] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.161278  3906 raft_consensus.cc:359] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.162233  3906 raft_consensus.cc:385] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.166538  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4342bbb0ea4e338952846096527efc" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:06.167331  3707 raft_consensus.cc:3060] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.167619  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4342bbb0ea4e338952846096527efc" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.172055  3904 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:06.172662  3904 ts_tablet_manager.cc:1403] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.005s
I20260709 12:26:06.172816  3781 raft_consensus.cc:2468] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:06.178870  4013 leader_election.cc:290] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:06.179896  4001 raft_consensus.cc:493] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.184499  3600 leader_election.cc:304] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:06.184669  4001 raft_consensus.cc:515] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.187991  4001 leader_election.cc:290] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:06.175820  3904 raft_consensus.cc:359] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.182114  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52472aa8d3c5489dadf9bea4ae265693" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.175755  3823 leader_election.cc:304] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:06.188586  3904 raft_consensus.cc:385] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.188912  3945 consensus_queue.cc:1048] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.189257  4013 raft_consensus.cc:2804] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.189831  4013 raft_consensus.cc:697] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:06.188225  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:06.190714  4013 consensus_queue.cc:237] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.192950  3707 raft_consensus.cc:2468] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:06.192832  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.194051  4159 raft_consensus.cc:2804] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.194633  4159 raft_consensus.cc:697] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:06.195811  4159 consensus_queue.cc:237] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.188964  3904 raft_consensus.cc:740] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.204824  3904 consensus_queue.cc:260] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.207350  3904 ts_tablet_manager.cc:1434] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:26:06.194096  3781 raft_consensus.cc:2468] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:06.240356  3823 leader_election.cc:304] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:06.241644  4013 raft_consensus.cc:2804] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:06.242086  4013 raft_consensus.cc:493] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.242456  4013 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:06.245138  3530 catalog_manager.cc:5697] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.265777  4013 raft_consensus.cc:515] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.291563  4013 leader_election.cc:290] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
W20260709 12:26:06.279114  3673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:42391, user_credentials={real_user=slave}} blocked reactor thread for 99152.9us
I20260709 12:26:06.240522  3904 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:06.292168  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:06.293537  3673 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:06.294143  3906 raft_consensus.cc:740] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.295728  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:06.296396  3781 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:06.295605  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:36779, user_credentials={real_user=slave}} blocked reactor thread for 111201us
I20260709 12:26:06.308307  4004 raft_consensus.cc:493] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.308835  4004 raft_consensus.cc:515] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.310984  4004 leader_election.cc:290] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:06.295083  3906 consensus_queue.cc:260] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.315219  3906 ts_tablet_manager.cc:1434] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.231s	user 0.004s	sys 0.001s
I20260709 12:26:06.330551  3906 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
W20260709 12:26:06.308615  3600 leader_election.cc:343] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.335853  4158 raft_consensus.cc:2749] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.336277  4159 consensus_queue.cc:1048] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.338982  3905 tablet_bootstrap.cc:654] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.342895  3904 tablet_bootstrap.cc:654] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.346907  3600 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:06.347817  4004 raft_consensus.cc:2749] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:26:06.348971  3600 leader_election.cc:343] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.353574  3533 catalog_manager.cc:5697] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.355370  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2f247912a248ed8aee1a67922b1b22" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.356312  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2f247912a248ed8aee1a67922b1b22" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:06.363523  3906 tablet_bootstrap.cc:654] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.365267  3903 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:06.365388  3855 raft_consensus.cc:1240] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Rejecting Update request from peer a423544d890d41e7870787a3a92aaf58 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:06.365818  3903 ts_tablet_manager.cc:1403] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.553s	user 0.010s	sys 0.003s
I20260709 12:26:06.368582  3903 raft_consensus.cc:359] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.369258  3903 raft_consensus.cc:385] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.369542  3903 raft_consensus.cc:740] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.370338  3903 consensus_queue.cc:260] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
W20260709 12:26:06.358956  3673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:42391, user_credentials={real_user=slave}} blocked reactor thread for 65541.5us
W20260709 12:26:06.365279  3600 leader_election.cc:343] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.371588  3781 raft_consensus.cc:2468] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 2.
W20260709 12:26:06.371953  3600 leader_election.cc:343] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.372340  3782 raft_consensus.cc:1240] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Rejecting Update request from peer a423544d890d41e7870787a3a92aaf58 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:06.372413  3600 leader_election.cc:304] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:06.374368  4004 raft_consensus.cc:2749] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.374907  4159 consensus_queue.cc:1059] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.375914  3903 ts_tablet_manager.cc:1434] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:26:06.377031  3903 tablet_bootstrap.cc:492] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:06.380314  4004 consensus_queue.cc:1059] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.375866  4159 raft_consensus.cc:3055] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:06.385048  3532 catalog_manager.cc:5697] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.383589  4159 raft_consensus.cc:740] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:06.388226  4159 consensus_queue.cc:260] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.393381  3903 tablet_bootstrap.cc:654] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.394105  4159 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:06.398919  4158 consensus_queue.cc:1048] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.409179  3823 leader_election.cc:304] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:06.411098  4009 raft_consensus.cc:2804] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:06.412947  4009 raft_consensus.cc:697] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:06.411618  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547fe2b2ec4f42d4b2386ea1c9a7d2b9" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.413928  4009 consensus_queue.cc:237] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.414929  3904 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:06.415539  3904 ts_tablet_manager.cc:1403] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.175s	user 0.021s	sys 0.014s
I20260709 12:26:06.416181  3906 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:06.418372  3904 raft_consensus.cc:359] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.419093  3904 raft_consensus.cc:385] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.419282  3906 ts_tablet_manager.cc:1403] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.089s	user 0.003s	sys 0.016s
I20260709 12:26:06.419404  3904 raft_consensus.cc:740] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
W20260709 12:26:06.418627  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:06.420338  3904 consensus_queue.cc:260] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.422573  3904 ts_tablet_manager.cc:1434] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:06.422322  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52472aa8d3c5489dadf9bea4ae265693" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.422982  3906 raft_consensus.cc:359] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.423560  3904 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:06.423839  3906 raft_consensus.cc:385] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.424235  3906 raft_consensus.cc:740] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.424935  3906 consensus_queue.cc:260] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.427857  3906 ts_tablet_manager.cc:1434] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:26:06.428781  3906 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:06.429118  4011 raft_consensus.cc:493] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.429531  3904 tablet_bootstrap.cc:654] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.429661  4011 raft_consensus.cc:515] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.432247  3903 tablet_bootstrap.cc:492] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:06.432734  3903 ts_tablet_manager.cc:1403] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.003s
I20260709 12:26:06.432680  4011 leader_election.cc:290] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:06.435696  3906 tablet_bootstrap.cc:654] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.435580  3903 raft_consensus.cc:359] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.436303  3903 raft_consensus.cc:385] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.436619  3903 raft_consensus.cc:740] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.437676  3903 consensus_queue.cc:260] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.437973  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c9a2da48a44e29f55803f43d316b4" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:06.438830  3633 raft_consensus.cc:2393] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:06.439733  3903 ts_tablet_manager.cc:1434] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:06.441989  3903 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:06.448217  3903 tablet_bootstrap.cc:654] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.448580  3906 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:06.449139  3906 ts_tablet_manager.cc:1403] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.002s
I20260709 12:26:06.452131  3906 raft_consensus.cc:359] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.452394  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c9a2da48a44e29f55803f43d316b4" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.452913  3906 raft_consensus.cc:385] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.453379  3906 raft_consensus.cc:740] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.454174  3906 consensus_queue.cc:260] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.456555  3906 ts_tablet_manager.cc:1434] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:26:06.457506  3906 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:06.463122  3906 tablet_bootstrap.cc:654] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:06.476002  3600 leader_election.cc:343] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.476552  3600 leader_election.cc:304] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:06.477299  4004 raft_consensus.cc:2749] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.478605  3905 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:06.479401  3905 ts_tablet_manager.cc:1403] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.338s	user 0.017s	sys 0.000s
I20260709 12:26:06.484724  3529 catalog_manager.cc:5697] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:06.489537  3600 leader_election.cc:343] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.490016  3600 leader_election.cc:304] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:06.494984  3905 raft_consensus.cc:359] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.495958  3905 raft_consensus.cc:385] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.496181  3905 raft_consensus.cc:740] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.495473  4004 raft_consensus.cc:2749] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.500814  3905 consensus_queue.cc:260] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.494755  3910 raft_consensus.cc:493] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.490939  3823 leader_election.cc:304] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:06.510174  3905 ts_tablet_manager.cc:1434] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:26:06.511117  3905 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:06.509322  4009 raft_consensus.cc:3060] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.517822  3905 tablet_bootstrap.cc:654] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.518882  4152 raft_consensus.cc:493] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.519416  4152 raft_consensus.cc:515] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.520990  3906 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:06.521521  4152 leader_election.cc:290] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:06.521493  3906 ts_tablet_manager.cc:1403] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.001s
I20260709 12:26:06.507819  3910 raft_consensus.cc:515] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.521449  4158 raft_consensus.cc:493] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.523408  4158 raft_consensus.cc:515] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.524549  3910 leader_election.cc:290] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:06.524802  3906 raft_consensus.cc:359] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.525521  3906 raft_consensus.cc:385] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.525799  3906 raft_consensus.cc:740] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.526451  3906 consensus_queue.cc:260] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.526897  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c02611ee24affaa7740ab42bc482b" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.527645  3781 raft_consensus.cc:2468] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:06.527697  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:06.528388  3854 raft_consensus.cc:2468] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:06.528645  3906 ts_tablet_manager.cc:1434] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:06.529595  3906 tablet_bootstrap.cc:492] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:06.530516  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:06.530865  4011 consensus_queue.cc:1048] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.531145  3630 raft_consensus.cc:2468] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:06.532795  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.530751  3749 leader_election.cc:304] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:06.533511  3781 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:06.534510  4155 raft_consensus.cc:2804] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.534876  4155 raft_consensus.cc:493] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.535210  4155 raft_consensus.cc:3060] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.535430  3906 tablet_bootstrap.cc:654] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.538198  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c02611ee24affaa7740ab42bc482b" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:06.538918  3904 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:06.539479  3904 ts_tablet_manager.cc:1403] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.023s
I20260709 12:26:06.541079  4009 raft_consensus.cc:2749] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.539467  3675 leader_election.cc:304] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:06.542582  4171 raft_consensus.cc:2804] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.542408  3904 raft_consensus.cc:359] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.543027  4171 raft_consensus.cc:493] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.543156  3904 raft_consensus.cc:385] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.543586  4171 raft_consensus.cc:3060] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.543630  3904 raft_consensus.cc:740] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.545435  3904 consensus_queue.cc:260] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.547334  3904 ts_tablet_manager.cc:1434] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:06.548193  3904 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
W20260709 12:26:06.542430  3675 leader_election.cc:343] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.543586  3600 leader_election.cc:304] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:06.550153  4159 raft_consensus.cc:2804] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.550534  4159 raft_consensus.cc:493] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.551476  4159 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:06.532832  4191 log.cc:927] Time spent T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:26:06.554569  4158 leader_election.cc:290] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:06.559082  4155 raft_consensus.cc:515] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.565114  3904 tablet_bootstrap.cc:654] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.565979  4155 leader_election.cc:290] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:06.559792  4159 raft_consensus.cc:515] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.569577  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:06.570253  3855 raft_consensus.cc:3060] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.571376  4159 leader_election.cc:290] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:06.571619  3905 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:06.573004  3906 tablet_bootstrap.cc:492] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:06.575157  3905 ts_tablet_manager.cc:1403] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.009s
I20260709 12:26:06.575289  3906 ts_tablet_manager.cc:1403] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.007s
I20260709 12:26:06.574579  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:06.576413  3634 raft_consensus.cc:3060] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.577853  3906 raft_consensus.cc:359] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.578042  3905 raft_consensus.cc:359] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.578593  3906 raft_consensus.cc:385] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.578744  3905 raft_consensus.cc:385] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.578920  3906 raft_consensus.cc:740] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.579073  3905 raft_consensus.cc:740] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.579720  3905 consensus_queue.cc:260] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.581924  3905 ts_tablet_manager.cc:1434] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:06.579720  3906 consensus_queue.cc:260] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.582870  3905 tablet_bootstrap.cc:492] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:06.583598  3904 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:06.584088  3904 ts_tablet_manager.cc:1403] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:26:06.584583  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:06.585297  3782 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.587198  3904 raft_consensus.cc:359] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.587924  3904 raft_consensus.cc:385] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.587839  4011 consensus_queue.cc:1048] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.588374  3904 raft_consensus.cc:740] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.589103  3905 tablet_bootstrap.cc:654] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.589308  3904 consensus_queue.cc:260] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.592406  3904 ts_tablet_manager.cc:1434] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:06.593688  3904 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:06.611282  4001 consensus_queue.cc:1048] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.613090  4001 raft_consensus.cc:493] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.613658  4001 raft_consensus.cc:515] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.617579  3904 tablet_bootstrap.cc:654] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.618446  4009 raft_consensus.cc:493] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.618988  4009 raft_consensus.cc:515] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.621238  4009 leader_election.cc:290] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:06.619410  3903 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:06.622138  3903 ts_tablet_manager.cc:1403] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.180s	user 0.017s	sys 0.034s
I20260709 12:26:06.625928  3903 raft_consensus.cc:359] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.627614  3903 raft_consensus.cc:385] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.628015  3903 raft_consensus.cc:740] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.628868  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.635951  3703 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:06.631930  3904 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:06.633570  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547fe2b2ec4f42d4b2386ea1c9a7d2b9" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:06.634842  4001 leader_election.cc:290] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:06.636699  3906 ts_tablet_manager.cc:1434] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.002s
I20260709 12:26:06.639519  3904 ts_tablet_manager.cc:1403] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.000s
I20260709 12:26:06.639998  3630 raft_consensus.cc:2468] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:06.641198  3821 leader_election.cc:304] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:06.643306  3855 raft_consensus.cc:2468] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:06.644434  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:06.644438  4001 raft_consensus.cc:2804] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.645082  3707 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.645541  4001 raft_consensus.cc:493] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.646296  4001 raft_consensus.cc:3060] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.645947  3906 tablet_bootstrap.cc:492] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:06.647442  3749 leader_election.cc:304] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:06.648721  4155 raft_consensus.cc:2804] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.649377  4155 raft_consensus.cc:697] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:06.650501  4155 consensus_queue.cc:237] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.656116  3707 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:06.658349  3600 leader_election.cc:304] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:06.660082  3634 raft_consensus.cc:2468] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:06.659737  3910 raft_consensus.cc:2804] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.661113  3910 raft_consensus.cc:697] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:06.666451  3910 consensus_queue.cc:237] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.669732  4159 raft_consensus.cc:493] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.671433  4159 raft_consensus.cc:515] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.673589  3904 raft_consensus.cc:359] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.674378  3904 raft_consensus.cc:385] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.674697  3904 raft_consensus.cc:740] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.674448  4001 raft_consensus.cc:515] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.675989  3904 consensus_queue.cc:260] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.669875  3906 tablet_bootstrap.cc:654] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.636969  3903 consensus_queue.cc:260] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.681993  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7981cc37ba4740aaf2fbba50d6f1cc" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:06.711041  3904 ts_tablet_manager.cc:1434] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.001s
I20260709 12:26:06.712468  3904 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:06.599045  3782 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:06.682964  4159 leader_election.cc:290] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:06.715889  3903 ts_tablet_manager.cc:1434] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 12:26:06.670068  4171 raft_consensus.cc:515] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.718719  3905 tablet_bootstrap.cc:492] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:06.686759  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7981cc37ba4740aaf2fbba50d6f1cc" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.680101  4053 consensus_queue.cc:1048] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:26:06.729240  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547fe2b2ec4f42d4b2386ea1c9a7d2b9" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:06.729861  3630 raft_consensus.cc:3060] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.731065  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c02611ee24affaa7740ab42bc482b" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:06.731909  3781 raft_consensus.cc:3060] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.721837  3903 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:06.737078  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c02611ee24affaa7740ab42bc482b" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.722330  3905 ts_tablet_manager.cc:1403] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.140s	user 0.065s	sys 0.063s
I20260709 12:26:06.683759  4164 consensus_queue.cc:1048] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
W20260709 12:26:06.724946  3600 leader_election.cc:343] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:06.750200  3600 leader_election.cc:343] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.750630  3600 leader_election.cc:304] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:06.751070  4153 raft_consensus.cc:493] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.751345  4004 raft_consensus.cc:2749] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.751613  4153 raft_consensus.cc:515] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.753363  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c02611ee24affaa7740ab42bc482b" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:06.753809  4153 leader_election.cc:290] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:06.753971  3855 raft_consensus.cc:3060] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.725579  4171 leader_election.cc:290] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:06.755517  3533 catalog_manager.cc:5697] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 2 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.757900  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547fe2b2ec4f42d4b2386ea1c9a7d2b9" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:06.758495  3710 raft_consensus.cc:3060] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.758554  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa16bd4043348ff99dd99e5d01ffa01" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:06.760465  3749 leader_election.cc:343] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.725862  4001 leader_election.cc:290] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:06.726094  3906 tablet_bootstrap.cc:492] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:06.761555  3906 ts_tablet_manager.cc:1403] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.007s
I20260709 12:26:06.747303  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547fe2b2ec4f42d4b2386ea1c9a7d2b9" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.767622  3857 raft_consensus.cc:3060] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.770851  3906 raft_consensus.cc:359] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.771574  3906 raft_consensus.cc:385] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.771837  3906 raft_consensus.cc:740] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.774235  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa16bd4043348ff99dd99e5d01ffa01" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.757160  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c02611ee24affaa7740ab42bc482b" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.775152  4171 consensus_queue.cc:1048] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.775627  3703 raft_consensus.cc:2393] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:06.778046  3904 tablet_bootstrap.cc:654] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.778898  3906 consensus_queue.cc:260] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.780614  3906 ts_tablet_manager.cc:1434] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:26:06.780815  3905 raft_consensus.cc:359] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.781518  3906 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:06.781706  3905 raft_consensus.cc:385] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.782059  3905 raft_consensus.cc:740] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.783828  3905 consensus_queue.cc:260] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
W20260709 12:26:06.785296  3749 leader_election.cc:343] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.785792  3749 leader_election.cc:304] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:06.786019  3823 leader_election.cc:304] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:06.786444  3630 raft_consensus.cc:2468] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:06.787328  4152 raft_consensus.cc:2749] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.788408  3821 leader_election.cc:304] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:06.789371  4001 raft_consensus.cc:2804] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.789896  4001 raft_consensus.cc:697] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:06.790836  4001 consensus_queue.cc:237] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:06.790637  3781 raft_consensus.cc:2468] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:06.802363  3910 consensus_queue.cc:1048] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.803303  3529 catalog_manager.cc:5697] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.803941  3710 raft_consensus.cc:2468] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:06.811473  3905 ts_tablet_manager.cc:1434] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:26:06.821588  3906 tablet_bootstrap.cc:654] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.830219  3910 raft_consensus.cc:493] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.830838  3910 raft_consensus.cc:515] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:06.836995  3910 leader_election.cc:290] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:06.841734  3904 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:06.842453  3904 ts_tablet_manager.cc:1403] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.005s
I20260709 12:26:06.846323  3905 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
W20260709 12:26:06.834393  3823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:41805, user_credentials={real_user=slave}} blocked reactor thread for 48479.3us
I20260709 12:26:06.851143  3784 raft_consensus.cc:1275] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:06.853132  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f2315d32f6457b80884480feef6a4b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
W20260709 12:26:06.854580  3600 leader_election.cc:343] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.855754  3532 catalog_manager.cc:5697] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.870473  3675 leader_election.cc:304] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:06.872674  4158 raft_consensus.cc:2804] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.873093  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f2315d32f6457b80884480feef6a4b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:06.873210  4158 raft_consensus.cc:697] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:06.872802  3904 raft_consensus.cc:359] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.874938  3904 raft_consensus.cc:385] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.875910  3904 raft_consensus.cc:740] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
W20260709 12:26:06.875932  3600 leader_election.cc:343] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.877173  3600 leader_election.cc:304] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:06.877182  3904 consensus_queue.cc:260] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.864869  3910 raft_consensus.cc:493] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.882193  3904 ts_tablet_manager.cc:1434] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.002s
I20260709 12:26:06.883088  3904 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:06.885198  3910 raft_consensus.cc:515] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.901599  3910 leader_election.cc:290] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:06.901964  3903 tablet_bootstrap.cc:654] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.880744  4164 raft_consensus.cc:2749] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.902405  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34817477e5034d50bf4b2f435a675a97" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.904666  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34817477e5034d50bf4b2f435a675a97" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:06.905424  3600 leader_election.cc:343] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:06.906421  3600 leader_election.cc:343] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.906821  3600 leader_election.cc:304] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:06.909268  4164 raft_consensus.cc:2749] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.909962  4164 raft_consensus.cc:493] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.910403  4164 raft_consensus.cc:515] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:06.887765  4158 consensus_queue.cc:237] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:06.907773  4210 consensus_queue.cc:1048] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:26:06.915640  3855 raft_consensus.cc:2468] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:06.946766  4164 leader_election.cc:290] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:06.951592  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62f9c73102a4b07a57947eb81059e1e" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:06.952880  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62f9c73102a4b07a57947eb81059e1e" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:06.954851  3600 leader_election.cc:343] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.955179  3906 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:06.955155  3905 tablet_bootstrap.cc:654] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.964633  3906 ts_tablet_manager.cc:1403] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.183s	user 0.019s	sys 0.000s
W20260709 12:26:06.964668  3600 leader_election.cc:343] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.965252  3600 leader_election.cc:304] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:06.967712  3904 tablet_bootstrap.cc:654] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.948523  4009 raft_consensus.cc:2749] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.968801  4159 raft_consensus.cc:2749] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:07.000481  3749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:38747, user_credentials={real_user=slave}} blocked reactor thread for 52673us
W20260709 12:26:06.990701  3823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:41805, user_credentials={real_user=slave}} blocked reactor thread for 72647.9us
I20260709 12:26:07.026298  3630 raft_consensus.cc:1275] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:26:07.026769  3630 pending_rounds.cc:85] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Aborting all ops after (but not including) 0
I20260709 12:26:07.027125  3906 raft_consensus.cc:359] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.028102  3906 raft_consensus.cc:385] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.028469  3906 raft_consensus.cc:740] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.020066  4159 raft_consensus.cc:493] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.031036  3906 consensus_queue.cc:260] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.027021  3630 pending_rounds.cc:107] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:26:07.029440  4011 consensus_queue.cc:1048] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:26:07.039307  4159 raft_consensus.cc:515] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.051275  4159 leader_election.cc:290] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.042657  3906 ts_tablet_manager.cc:1434] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 12:26:07.058547  3904 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:07.059077  3904 ts_tablet_manager.cc:1403] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.176s	user 0.009s	sys 0.009s
I20260709 12:26:07.061031  3906 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:07.049140  3903 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:07.065474  3903 ts_tablet_manager.cc:1403] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.344s	user 0.016s	sys 0.005s
I20260709 12:26:07.068609  4152 consensus_queue.cc:1048] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.036612  3630 raft_consensus.cc:2889] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:07.077049  3903 raft_consensus.cc:359] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.068863  3904 raft_consensus.cc:359] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.079416  4152 raft_consensus.cc:493] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.080217  4152 raft_consensus.cc:515] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.080943  3903 raft_consensus.cc:385] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.081861  3903 raft_consensus.cc:740] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.087990  3903 consensus_queue.cc:260] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.081930  4210 consensus_queue.cc:1048] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:07.084139  3904 raft_consensus.cc:385] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.082949  4152 leader_election.cc:290] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.089766  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52472aa8d3c5489dadf9bea4ae265693" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:07.096071  3630 raft_consensus.cc:2468] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:07.096547  3904 raft_consensus.cc:740] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.097003  4155 raft_consensus.cc:493] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.097594  4155 raft_consensus.cc:515] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.098963  3747 leader_election.cc:304] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
W20260709 12:26:07.092504  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:36779, user_credentials={real_user=slave}} blocked reactor thread for 124524us
I20260709 12:26:07.100251  4228 raft_consensus.cc:2804] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.098623  3904 consensus_queue.cc:260] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.100608  4228 raft_consensus.cc:493] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.103914  4228 raft_consensus.cc:3060] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.106827  3904 ts_tablet_manager.cc:1434] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:26:07.110076  3904 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:07.107278  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2759a53f472748538672660088f60cf4" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:07.121152  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2759a53f472748538672660088f60cf4" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:07.101884  3903 ts_tablet_manager.cc:1434] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 12:26:07.111164  4009 raft_consensus.cc:493] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.122428  4009 raft_consensus.cc:515] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.124536  4009 leader_election.cc:290] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:07.128063  4228 raft_consensus.cc:515] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.128808  3903 tablet_bootstrap.cc:492] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:07.128895  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2f247912a248ed8aee1a67922b1b22" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:07.129621  3857 raft_consensus.cc:2468] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:07.131028  3749 leader_election.cc:304] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:07.131778  4152 raft_consensus.cc:2804] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.132149  4152 raft_consensus.cc:493] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.132486  4152 raft_consensus.cc:3060] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.118145  3906 tablet_bootstrap.cc:654] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.118299  4155 leader_election.cc:290] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:07.119699  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2f247912a248ed8aee1a67922b1b22" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:07.143883  3631 raft_consensus.cc:2468] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:07.144207  3903 tablet_bootstrap.cc:654] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.125828  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa16bd4043348ff99dd99e5d01ffa01" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:07.145004  3707 raft_consensus.cc:2468] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:07.139276  3904 tablet_bootstrap.cc:654] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.113142  3905 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:07.127377  3780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa16bd4043348ff99dd99e5d01ffa01" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:07.145885  3905 ts_tablet_manager.cc:1403] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.301s	user 0.016s	sys 0.004s
I20260709 12:26:07.146129  3780 raft_consensus.cc:2468] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:07.147554  3823 leader_election.cc:304] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
W20260709 12:26:07.145123  3600 leader_election.cc:343] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.149040  4009 raft_consensus.cc:2804] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.148994  4221 consensus_queue.cc:1048] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.149549  4009 raft_consensus.cc:493] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.149931  4009 raft_consensus.cc:3060] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.150918  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52472aa8d3c5489dadf9bea4ae265693" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:07.151531  3631 raft_consensus.cc:3060] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.151849  4228 leader_election.cc:290] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
W20260709 12:26:07.153637  3600 leader_election.cc:343] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.154083  3600 leader_election.cc:304] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:07.154760  4221 raft_consensus.cc:2749] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.156904  3905 raft_consensus.cc:359] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.157922  3905 raft_consensus.cc:385] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.158242  3905 raft_consensus.cc:740] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.158862  3631 raft_consensus.cc:2468] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:07.162108  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52472aa8d3c5489dadf9bea4ae265693" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:07.163298  3747 leader_election.cc:304] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.163611  4152 raft_consensus.cc:515] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.165210  3905 consensus_queue.cc:260] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.165863  4152 leader_election.cc:290] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:07.166198  3705 raft_consensus.cc:2468] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:07.166965  4222 raft_consensus.cc:2804] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.167511  4222 raft_consensus.cc:697] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:07.168390  4222 consensus_queue.cc:237] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.170166  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2f247912a248ed8aee1a67922b1b22" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:07.170750  3857 raft_consensus.cc:3060] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.172330  3905 ts_tablet_manager.cc:1434] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:26:07.174355  3532 catalog_manager.cc:5697] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.173456  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2f247912a248ed8aee1a67922b1b22" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:07.175809  3631 raft_consensus.cc:3060] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.178686  3905 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:07.185555  4228 consensus_queue.cc:1048] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.188037  3857 raft_consensus.cc:2468] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:07.189273  3749 leader_election.cc:304] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:07.184288  4009 raft_consensus.cc:515] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.195662  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa16bd4043348ff99dd99e5d01ffa01" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:07.196316  3705 raft_consensus.cc:3060] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.198676  4228 raft_consensus.cc:2804] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.199211  3530 catalog_manager.cc:5697] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.211309  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52472aa8d3c5489dadf9bea4ae265693" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:07.212088  3710 raft_consensus.cc:3060] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.204254  4228 raft_consensus.cc:697] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:07.217374  4228 consensus_queue.cc:237] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.227514  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa16bd4043348ff99dd99e5d01ffa01" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:07.228197  3782 raft_consensus.cc:3060] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.236209  3782 raft_consensus.cc:2468] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:07.236737  3910 raft_consensus.cc:493] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.237298  3910 raft_consensus.cc:515] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.237905  4221 consensus_queue.cc:1048] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.239266  3910 leader_election.cc:290] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.239390  3823 leader_election.cc:304] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:07.242305  4011 raft_consensus.cc:2804] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.242623  3906 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:07.243250  3906 ts_tablet_manager.cc:1403] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.000s
I20260709 12:26:07.242945  4011 raft_consensus.cc:697] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:07.269649  4011 consensus_queue.cc:237] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.243995  4009 leader_election.cc:290] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:07.246868  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d58d259e3e44cdda99987f566b1716e" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:07.246919  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d58d259e3e44cdda99987f566b1716e" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:07.250927  3631 raft_consensus.cc:2468] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:07.225807  3705 raft_consensus.cc:2468] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:07.259479  3903 tablet_bootstrap.cc:492] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:07.261299  3905 tablet_bootstrap.cc:654] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.265219  3904 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:07.275697  3904 ts_tablet_manager.cc:1403] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.000s
I20260709 12:26:07.277859  3903 ts_tablet_manager.cc:1403] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.000s
I20260709 12:26:07.279002  3904 raft_consensus.cc:359] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.279995  3904 raft_consensus.cc:385] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.280328  3904 raft_consensus.cc:740] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.266363  3533 catalog_manager.cc:5697] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:07.274372  3600 leader_election.cc:343] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:07.281453  3600 leader_election.cc:343] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.281884  3600 leader_election.cc:304] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:07.281697  3903 raft_consensus.cc:359] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.282712  3903 raft_consensus.cc:385] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.283077  3903 raft_consensus.cc:740] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.283181  4221 raft_consensus.cc:2749] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.284384  3904 consensus_queue.cc:260] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.286778  3904 ts_tablet_manager.cc:1434] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:26:07.286707  3903 consensus_queue.cc:260] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.287927  3904 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:07.291160  3903 ts_tablet_manager.cc:1434] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:26:07.292138  3903 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:07.297173  3904 tablet_bootstrap.cc:654] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.297686  3905 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:07.298301  3905 ts_tablet_manager.cc:1403] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.120s	user 0.008s	sys 0.003s
I20260709 12:26:07.300285  3903 tablet_bootstrap.cc:654] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.301553  3905 raft_consensus.cc:359] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.301486  3530 catalog_manager.cc:5697] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.302415  3905 raft_consensus.cc:385] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.302875  3905 raft_consensus.cc:740] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.303582  3905 consensus_queue.cc:260] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.306578  3905 ts_tablet_manager.cc:1434] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:26:07.308494  3905 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:07.280097  3710 raft_consensus.cc:2468] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:07.313133  3533 catalog_manager.cc:5697] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.316591  3905 tablet_bootstrap.cc:654] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.326987  4210 consensus_queue.cc:1048] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.332921  3906 raft_consensus.cc:359] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.333806  3906 raft_consensus.cc:385] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.334249  3906 raft_consensus.cc:740] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.344767  3906 consensus_queue.cc:260] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.348554  3906 ts_tablet_manager.cc:1434] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:26:07.355993  3906 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:07.354513  4215 consensus_queue.cc:1048] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:07.357986  3905 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:07.358503  3905 ts_tablet_manager.cc:1403] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.005s
I20260709 12:26:07.376833  3906 tablet_bootstrap.cc:654] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.378798  3903 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:07.379398  3903 ts_tablet_manager.cc:1403] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.011s
I20260709 12:26:07.382033  3904 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:07.381848  3905 raft_consensus.cc:359] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.382704  3905 raft_consensus.cc:385] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.383150  3905 raft_consensus.cc:740] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.383939  3905 consensus_queue.cc:260] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.382732  3904 ts_tablet_manager.cc:1403] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.007s
I20260709 12:26:07.387064  3904 raft_consensus.cc:359] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.388168  3904 raft_consensus.cc:385] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.388510  3904 raft_consensus.cc:740] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.389575  3904 consensus_queue.cc:260] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.395205  4171 consensus_queue.cc:1048] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.399904  3905 ts_tablet_manager.cc:1434] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 12:26:07.400962  3905 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:07.401779  3904 ts_tablet_manager.cc:1434] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:26:07.403095  3904 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:07.412371  3903 raft_consensus.cc:359] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.413003  3905 tablet_bootstrap.cc:654] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.416742  3903 raft_consensus.cc:385] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.417385  3903 raft_consensus.cc:740] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.419319  3903 consensus_queue.cc:260] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.460630  4152 raft_consensus.cc:493] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.461340  4152 raft_consensus.cc:515] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.464083  4152 leader_election.cc:290] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:07.470449  3903 ts_tablet_manager.cc:1434] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 12:26:07.471549  3903 tablet_bootstrap.cc:492] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:07.478992  3903 tablet_bootstrap.cc:654] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.470535  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6c38732d3b4d4a92be8805b1e20070" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:07.488574  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6c38732d3b4d4a92be8805b1e20070" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
W20260709 12:26:07.491528  3749 leader_election.cc:343] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:07.492355  3749 leader_election.cc:343] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.492775  3749 leader_election.cc:304] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:07.493592  4222 raft_consensus.cc:2749] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.498709  3904 tablet_bootstrap.cc:654] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.508311  4218 consensus_queue.cc:1048] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.510228  3903 tablet_bootstrap.cc:492] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:07.510757  3903 ts_tablet_manager.cc:1403] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.002s
I20260709 12:26:07.512001  3904 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:07.512706  3904 ts_tablet_manager.cc:1403] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.004s
I20260709 12:26:07.513659  3903 raft_consensus.cc:359] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.514381  3903 raft_consensus.cc:385] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.514770  3903 raft_consensus.cc:740] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.515478  3903 consensus_queue.cc:260] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.515666  3904 raft_consensus.cc:359] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.516376  3904 raft_consensus.cc:385] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.516705  3904 raft_consensus.cc:740] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.517521  3903 ts_tablet_manager.cc:1434] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:26:07.518488  3903 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:07.515055  3906 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:07.518030  3904 consensus_queue.cc:260] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.520372  3906 ts_tablet_manager.cc:1403] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.165s	user 0.045s	sys 0.034s
I20260709 12:26:07.521303  3904 ts_tablet_manager.cc:1434] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:07.522419  3904 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:07.522926  3906 raft_consensus.cc:359] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.523622  3906 raft_consensus.cc:385] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.523885  3906 raft_consensus.cc:740] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.524545  3906 consensus_queue.cc:260] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.535725  3906 ts_tablet_manager.cc:1434] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:07.536593  3906 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:07.536657  3905 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:07.537135  3905 ts_tablet_manager.cc:1403] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.013s
I20260709 12:26:07.541443  3904 tablet_bootstrap.cc:654] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.547307  3903 tablet_bootstrap.cc:654] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.553567  3906 tablet_bootstrap.cc:654] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.560468  3904 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:07.561022  3904 ts_tablet_manager.cc:1403] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.008s
I20260709 12:26:07.564038  3905 raft_consensus.cc:359] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.565685  3905 raft_consensus.cc:385] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.565973  3905 raft_consensus.cc:740] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.566640  3905 consensus_queue.cc:260] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.568039  3904 raft_consensus.cc:359] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.569164  3905 ts_tablet_manager.cc:1434] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.004s
I20260709 12:26:07.569454  3904 raft_consensus.cc:385] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.569824  3904 raft_consensus.cc:740] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.570603  3905 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
W20260709 12:26:07.576395  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:07.577567  3904 consensus_queue.cc:260] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.578289  3903 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:07.578770  3903 ts_tablet_manager.cc:1403] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.008s
I20260709 12:26:07.580492  3905 tablet_bootstrap.cc:654] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.580380  4222 consensus_queue.cc:1048] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.581653  3903 raft_consensus.cc:359] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.582360  3903 raft_consensus.cc:385] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.582617  3903 raft_consensus.cc:740] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.583397  3903 consensus_queue.cc:260] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.586223  3903 ts_tablet_manager.cc:1434] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:07.588879  3906 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:07.588958  3910 raft_consensus.cc:493] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.589548  3910 raft_consensus.cc:515] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.590245  3903 tablet_bootstrap.cc:492] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:07.589553  3906 ts_tablet_manager.cc:1403] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.005s
I20260709 12:26:07.594530  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:07.596513  3910 leader_election.cc:290] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:07.597645  3906 raft_consensus.cc:359] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.598385  3906 raft_consensus.cc:385] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.598739  3906 raft_consensus.cc:740] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.598034  3903 tablet_bootstrap.cc:654] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.599640  3906 consensus_queue.cc:260] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.603464  3906 ts_tablet_manager.cc:1434] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:26:07.605417  3906 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
W20260709 12:26:07.605480  3600 leader_election.cc:343] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.607115  4222 consensus_queue.cc:1048] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.609308  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:07.610996  3910 raft_consensus.cc:493] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.611670  3910 raft_consensus.cc:515] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.613642  3910 leader_election.cc:290] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.580420  3904 ts_tablet_manager.cc:1434] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:26:07.616900  3904 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
W20260709 12:26:07.611069  3600 leader_election.cc:343] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.617697  3600 leader_election.cc:304] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:07.619587  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f9aead41d420995c59bc0f03e4cc6" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:07.620954  3910 raft_consensus.cc:2749] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.626030  3906 tablet_bootstrap.cc:654] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.637079  3905 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:07.637610  3905 ts_tablet_manager.cc:1403] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.067s	user 0.032s	sys 0.024s
I20260709 12:26:07.637794  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f9aead41d420995c59bc0f03e4cc6" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:07.639631  3600 leader_election.cc:343] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:07.640270  3600 leader_election.cc:343] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.640637  3600 leader_election.cc:304] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:07.633677  3904 tablet_bootstrap.cc:654] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.640897  3905 raft_consensus.cc:359] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.641638  3905 raft_consensus.cc:385] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.641952  3905 raft_consensus.cc:740] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.642781  3905 consensus_queue.cc:260] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.644869  3905 ts_tablet_manager.cc:1434] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:07.645179  3903 tablet_bootstrap.cc:492] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:07.645663  3903 ts_tablet_manager.cc:1403] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.003s
I20260709 12:26:07.645756  3905 tablet_bootstrap.cc:492] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:07.647408  3910 raft_consensus.cc:2749] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.648193  3903 raft_consensus.cc:359] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.648933  3903 raft_consensus.cc:385] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.649236  3903 raft_consensus.cc:740] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.649914  3903 consensus_queue.cc:260] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.652029  3903 ts_tablet_manager.cc:1434] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:07.652128  3905 tablet_bootstrap.cc:654] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.667886  3903 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:07.683846  3903 tablet_bootstrap.cc:654] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.685590  3906 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:07.686141  3906 ts_tablet_manager.cc:1403] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.002s
I20260709 12:26:07.691219  4228 consensus_queue.cc:1048] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.694831  3906 raft_consensus.cc:359] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.695632  3906 raft_consensus.cc:385] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.695912  3906 raft_consensus.cc:740] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.696518  4013 raft_consensus.cc:493] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.697069  4013 raft_consensus.cc:515] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.698336  3905 tablet_bootstrap.cc:492] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:07.698822  3905 ts_tablet_manager.cc:1403] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.012s
I20260709 12:26:07.699138  4013 leader_election.cc:290] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.700737  3906 consensus_queue.cc:260] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.702463  3906 ts_tablet_manager.cc:1434] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:07.703768  3906 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:07.704237  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d58d259e3e44cdda99987f566b1716e" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:07.705090  3631 raft_consensus.cc:2468] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:07.708103  3821 leader_election.cc:304] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.709915  4210 raft_consensus.cc:2804] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.710412  4210 raft_consensus.cc:493] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.710836  4210 raft_consensus.cc:3060] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.715889  3906 tablet_bootstrap.cc:654] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.716012  3905 raft_consensus.cc:359] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.717080  3905 raft_consensus.cc:385] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.717437  3905 raft_consensus.cc:740] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.718312  3905 consensus_queue.cc:260] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.719981  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d58d259e3e44cdda99987f566b1716e" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:07.720753  3710 raft_consensus.cc:2468] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:07.722007  4215 raft_consensus.cc:493] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.722532  4215 raft_consensus.cc:515] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.724984  4215 leader_election.cc:290] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:07.726938  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34817477e5034d50bf4b2f435a675a97" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:07.727706  3634 raft_consensus.cc:2468] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:07.731129  3821 leader_election.cc:304] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.736536  4013 raft_consensus.cc:2804] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.730379  3904 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:07.732863  3905 ts_tablet_manager.cc:1434] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:26:07.745707  4009 consensus_queue.cc:1048] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.747010  4013 raft_consensus.cc:493] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.747891  4013 raft_consensus.cc:3060] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.733599  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34817477e5034d50bf4b2f435a675a97" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:07.748827  3782 raft_consensus.cc:2468] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:07.753753  3905 tablet_bootstrap.cc:492] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:07.758682  4011 consensus_queue.cc:1048] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.767378  4171 raft_consensus.cc:493] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.768167  4171 raft_consensus.cc:515] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.772861  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7981cc37ba4740aaf2fbba50d6f1cc" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:07.773566  3634 raft_consensus.cc:2468] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:07.774097  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7981cc37ba4740aaf2fbba50d6f1cc" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:07.774868  3673 leader_election.cc:304] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.774992  3857 raft_consensus.cc:2468] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:07.776235  4218 raft_consensus.cc:2804] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.776711  4218 raft_consensus.cc:493] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.777122  4218 raft_consensus.cc:3060] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.790802  3910 raft_consensus.cc:493] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.791491  3910 raft_consensus.cc:515] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.793313  3910 leader_election.cc:290] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:07.803736  4158 raft_consensus.cc:493] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.804504  4158 raft_consensus.cc:515] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.808233  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:07.809077  3634 raft_consensus.cc:2468] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:07.810724  3673 leader_election.cc:304] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.811884  4223 raft_consensus.cc:2804] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.812363  4223 raft_consensus.cc:493] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.812839  4223 raft_consensus.cc:3060] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.817359  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:07.818361  3781 raft_consensus.cc:2468] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:07.820956  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:07.831835  4158 leader_election.cc:290] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:07.835860  4215 raft_consensus.cc:493] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.836422  4215 raft_consensus.cc:515] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.838850  4215 leader_election.cc:290] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.840878  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2759a53f472748538672660088f60cf4" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:07.841732  3634 raft_consensus.cc:2468] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:07.842870  3821 leader_election.cc:304] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.843679  4011 raft_consensus.cc:2804] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.845441  4210 raft_consensus.cc:515] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.844051  4011 raft_consensus.cc:493] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.846361  4011 raft_consensus.cc:3060] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.847584  4210 leader_election.cc:290] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.848825  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d58d259e3e44cdda99987f566b1716e" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:07.849474  3634 raft_consensus.cc:3060] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.853978  4153 consensus_queue.cc:1048] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.853750  4013 raft_consensus.cc:515] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.856544  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2759a53f472748538672660088f60cf4" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:07.858413  3709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d58d259e3e44cdda99987f566b1716e" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:07.859098  3709 raft_consensus.cc:3060] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:07.863013  3823 leader_election.cc:343] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.858486  4011 raft_consensus.cc:515] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.870802  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2759a53f472748538672660088f60cf4" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:07.871798  3631 raft_consensus.cc:3060] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.870946  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:07.874979  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34817477e5034d50bf4b2f435a675a97" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:07.875613  3630 raft_consensus.cc:3060] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.877914  3905 tablet_bootstrap.cc:654] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.747219  3904 ts_tablet_manager.cc:1403] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.001s
I20260709 12:26:07.879973  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34817477e5034d50bf4b2f435a675a97" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:07.880614  3782 raft_consensus.cc:3060] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.882215  3904 raft_consensus.cc:359] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.882926  3904 raft_consensus.cc:385] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.884743  4158 raft_consensus.cc:493] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.885249  4158 raft_consensus.cc:515] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.887658  3600 leader_election.cc:304] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.888337  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f2315d32f6457b80884480feef6a4b" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:07.889019  3910 raft_consensus.cc:2804] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.889046  3633 raft_consensus.cc:2468] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:07.889577  3910 raft_consensus.cc:493] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.890048  3910 raft_consensus.cc:3060] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.890175  4171 leader_election.cc:290] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:07.890518  3673 leader_election.cc:304] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.888252  4158 leader_election.cc:290] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:07.892107  3945 raft_consensus.cc:2804] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.892496  3945 raft_consensus.cc:493] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.892876  3945 raft_consensus.cc:3060] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.895813  3634 raft_consensus.cc:2468] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:07.898167  3910 raft_consensus.cc:515] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
W20260709 12:26:07.900835  3600 leader_election.cc:343] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.904703  3709 raft_consensus.cc:2468] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:07.883190  3904 raft_consensus.cc:740] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.905795  4218 raft_consensus.cc:515] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.909130  3821 leader_election.cc:304] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.909526  4223 raft_consensus.cc:515] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.910841  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7981cc37ba4740aaf2fbba50d6f1cc" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:07.911727  3633 raft_consensus.cc:3060] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.912175  4223 leader_election.cc:290] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:07.913219  4011 leader_election.cc:290] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.913843  4011 raft_consensus.cc:2804] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.914319  4011 raft_consensus.cc:697] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:07.908923  3904 consensus_queue.cc:260] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.858400  4013 leader_election.cc:290] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:07.916651  3632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:07.917305  3632 raft_consensus.cc:3060] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.917657  3904 ts_tablet_manager.cc:1434] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:26:07.921470  3631 raft_consensus.cc:2468] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:07.922149  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2759a53f472748538672660088f60cf4" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:07.923635  3821 leader_election.cc:304] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.924038  4218 leader_election.cc:290] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:07.924499  4270 raft_consensus.cc:2804] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.925661  4270 raft_consensus.cc:697] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:07.929695  3633 raft_consensus.cc:2468] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:07.930874  3673 leader_election.cc:304] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.931752  3904 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:07.932735  4155 raft_consensus.cc:493] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.932925  4158 raft_consensus.cc:2804] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.933491  4158 raft_consensus.cc:697] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
W20260709 12:26:07.933624  3823 leader_election.cc:343] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.934360  4158 consensus_queue.cc:237] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.933252  4155 raft_consensus.cc:515] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.935389  3632 raft_consensus.cc:2468] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:07.936697  3673 leader_election.cc:304] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:07.937110  4155 leader_election.cc:290] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:07.916684  3945 raft_consensus.cc:515] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.939155  3903 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:07.950625  3910 leader_election.cc:290] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:07.915165  4011 consensus_queue.cc:237] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.949191  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:07.950829  3903 ts_tablet_manager.cc:1403] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.283s	user 0.047s	sys 0.115s
I20260709 12:26:07.951380  3906 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:07.957307  3906 ts_tablet_manager.cc:1403] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.254s	user 0.027s	sys 0.051s
I20260709 12:26:07.926745  4270 consensus_queue.cc:237] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.963840  3945 leader_election.cc:290] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:07.960924  4218 raft_consensus.cc:493] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:07.961906  3675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:36779, user_credentials={real_user=slave}} blocked reactor thread for 72609.5us
W20260709 12:26:07.970395  3749 leader_election.cc:343] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:07.973413  3675 leader_election.cc:343] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.976760  4218 raft_consensus.cc:515] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.978787  4221 raft_consensus.cc:493] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.980051  4221 raft_consensus.cc:515] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:07.980993  3905 tablet_bootstrap.cc:492] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:07.981572  3905 ts_tablet_manager.cc:1403] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.228s	user 0.019s	sys 0.003s
I20260709 12:26:07.982026  4221 leader_election.cc:290] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:07.980922  4218 leader_election.cc:290] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:07.982847  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f2315d32f6457b80884480feef6a4b" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:07.983546  3780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:07.985224  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f2315d32f6457b80884480feef6a4b" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:07.986450  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7981cc37ba4740aaf2fbba50d6f1cc" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:07.987077  3855 raft_consensus.cc:3060] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.991528  3904 tablet_bootstrap.cc:654] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.970618  4223 raft_consensus.cc:2804] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.993824  3903 raft_consensus.cc:359] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.995625  3903 raft_consensus.cc:385] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.995923  3903 raft_consensus.cc:740] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.989854  3906 raft_consensus.cc:359] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:07.996896  3906 raft_consensus.cc:385] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.996706  3903 consensus_queue.cc:260] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:07.997174  3906 raft_consensus.cc:740] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.997808  3906 consensus_queue.cc:260] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
W20260709 12:26:08.001305  3675 leader_election.cc:343] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.002718  3905 raft_consensus.cc:359] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:07.967840  3630 raft_consensus.cc:2468] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:08.013424  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:08.014186  3905 raft_consensus.cc:385] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.001372  3906 ts_tablet_manager.cc:1434] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:26:07.969127  3782 raft_consensus.cc:2468] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:08.024304  3906 tablet_bootstrap.cc:492] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:08.023104  3905 raft_consensus.cc:740] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.026813  3905 consensus_queue.cc:260] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.026860  3533 catalog_manager.cc:5697] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.003060  3780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.013785  4221 raft_consensus.cc:493] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.028800  3533 catalog_manager.cc:5697] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.014137  4223 raft_consensus.cc:697] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:08.023063  3903 ts_tablet_manager.cc:1434] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
W20260709 12:26:08.024947  3675 leader_election.cc:343] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.033510  3780 raft_consensus.cc:2468] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:08.014597  3855 raft_consensus.cc:2468] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:08.034279  3821 leader_election.cc:304] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:08.034354  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f2315d32f6457b80884480feef6a4b" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
W20260709 12:26:08.040016  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:38747, user_credentials={real_user=slave}} blocked reactor thread for 84460.3us
W20260709 12:26:08.040198  3675 leader_election.cc:343] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.041285  3905 ts_tablet_manager.cc:1434] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.008s
I20260709 12:26:08.050294  3905 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:08.041536  3903 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:08.038631  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:08.061000  3675 leader_election.cc:343] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.056602  3630 raft_consensus.cc:3060] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.069156  4215 raft_consensus.cc:493] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.069754  4215 raft_consensus.cc:515] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.067529  3710 raft_consensus.cc:2468] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:08.071866  4215 leader_election.cc:290] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:08.073824  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff8ced4a7c47afba587ccdac4e1487" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:08.073899  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:08.074837  3855 raft_consensus.cc:3060] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.076519  3749 leader_election.cc:304] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:08.077736  3675 leader_election.cc:304] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
W20260709 12:26:08.075210  3600 leader_election.cc:343] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.040282  4221 raft_consensus.cc:515] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.081463  3532 catalog_manager.cc:5697] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.065739  4013 raft_consensus.cc:2804] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.084378  4158 raft_consensus.cc:2804] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.080848  4153 raft_consensus.cc:2804] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.085793  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.086934  4158 raft_consensus.cc:493] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.088418  4158 raft_consensus.cc:3060] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.076092  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:08.104743  3903 tablet_bootstrap.cc:654] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.087119  4153 raft_consensus.cc:493] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.110347  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:08.111193  3634 raft_consensus.cc:2393] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate a423544d890d41e7870787a3a92aaf58 in this term.
I20260709 12:26:08.103029  4013 raft_consensus.cc:697] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:08.112531  4013 consensus_queue.cc:237] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.109141  4153 raft_consensus.cc:3060] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.104020  3784 raft_consensus.cc:2468] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:08.115681  3823 leader_election.cc:304] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
W20260709 12:26:08.122364  4277 log.cc:927] Time spent T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:26:08.087340  4223 consensus_queue.cc:237] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.124528  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff8ced4a7c47afba587ccdac4e1487" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:08.129752  3906 tablet_bootstrap.cc:654] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.133620  3904 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:08.134130  3904 ts_tablet_manager.cc:1403] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.203s	user 0.010s	sys 0.019s
I20260709 12:26:08.121372  4272 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.142043  4155 raft_consensus.cc:493] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.142558  4155 raft_consensus.cc:515] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.143726  4221 leader_election.cc:290] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.141456  4158 raft_consensus.cc:515] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.144657  4155 leader_election.cc:290] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:08.147171  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f651c75d6a434e50a9e9e0e36543be65" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.145097  3904 raft_consensus.cc:359] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.148275  3904 raft_consensus.cc:385] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.148557  3904 raft_consensus.cc:740] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.149207  3904 consensus_queue.cc:260] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
W20260709 12:26:08.150297  3600 leader_election.cc:343] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.151414  3904 ts_tablet_manager.cc:1434] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:26:08.151299  4272 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.147218  3855 raft_consensus.cc:2468] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:08.156222  4210 raft_consensus.cc:2764] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:08.157512  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:08.158917  4153 raft_consensus.cc:515] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.161375  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f651c75d6a434e50a9e9e0e36543be65" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:08.154013  3904 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:08.159080  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:08.162671  3783 raft_consensus.cc:2393] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
W20260709 12:26:08.163682  3600 leader_election.cc:343] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.151504  4158 leader_election.cc:290] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:08.160845  3905 tablet_bootstrap.cc:654] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.160065  4272 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.167001  3600 leader_election.cc:304] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
W20260709 12:26:08.167531  3749 leader_election.cc:343] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.175361  3600 leader_election.cc:304] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:08.160526  3630 raft_consensus.cc:2468] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:08.181303  4004 raft_consensus.cc:2749] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.189042  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.189816  3783 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:08.184365  4279 raft_consensus.cc:2804] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.191368  4279 raft_consensus.cc:697] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:08.192381  3675 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:08.192301  4279 consensus_queue.cc:237] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.190613  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:08.193651  3630 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:08.194599  4153 leader_election.cc:290] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
W20260709 12:26:08.196599  3600 leader_election.cc:343] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.198177  3600 leader_election.cc:304] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:08.180294  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:08.199970  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:08.200726  3710 raft_consensus.cc:2393] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:08.201344  4158 raft_consensus.cc:2804] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:08.201779  4158 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.202126  4158 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:08.202775  3673 leader_election.cc:304] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:08.203624  4272 raft_consensus.cc:2804] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.204114  4272 raft_consensus.cc:697] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:08.204954  4272 consensus_queue.cc:237] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
W20260709 12:26:08.208954  3749 leader_election.cc:343] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.210822  3904 tablet_bootstrap.cc:654] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.212311  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:08.209486  3749 leader_election.cc:304] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:08.215212  4158 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.219944  4153 raft_consensus.cc:2749] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.221798  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:08.222388  3783 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:08.223011  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:08.235105  3910 raft_consensus.cc:2749] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:08.241361  3749 leader_election.cc:343] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.241840  3749 leader_election.cc:304] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a
W20260709 12:26:08.252522  3675 leader_election.cc:343] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.253237  3675 leader_election.cc:304] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:08.232434  3783 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:08.234576  4158 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.245208  4155 raft_consensus.cc:2749] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.259308  4158 raft_consensus.cc:2749] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.270990  3675 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:08.292209  4223 raft_consensus.cc:2804] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:08.316359  4223 raft_consensus.cc:697] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:08.317454  4223 consensus_queue.cc:237] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.338812  4153 raft_consensus.cc:493] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.339624  4153 raft_consensus.cc:515] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.342613  4153 leader_election.cc:290] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:08.345112  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:08.346284  3634 raft_consensus.cc:2393] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:08.347910  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:08.352671  3749 leader_election.cc:304] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:08.354281  4153 raft_consensus.cc:3060] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:08.356994  4287 log.cc:927] Time spent T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:26:08.368973  3530 catalog_manager.cc:5697] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.371907  4158 raft_consensus.cc:493] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.372629  4158 raft_consensus.cc:515] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.374686  4158 leader_election.cc:290] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:08.380766  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6c38732d3b4d4a92be8805b1e20070" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.393523  3782 raft_consensus.cc:2468] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
W20260709 12:26:08.386389  4290 log.cc:927] Time spent T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Append to log took a long time: real 0.066s	user 0.003s	sys 0.002s
I20260709 12:26:08.386861  3905 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:08.394704  3905 ts_tablet_manager.cc:1403] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.345s	user 0.017s	sys 0.020s
W20260709 12:26:08.387938  3953 log.cc:927] Time spent T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23: Append to log took a long time: real 0.084s	user 0.013s	sys 0.005s
I20260709 12:26:08.388943  3904 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: No bootstrap required, opened a new log
I20260709 12:26:08.395788  3904 ts_tablet_manager.cc:1403] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.242s	user 0.019s	sys 0.020s
I20260709 12:26:08.391758  3906 tablet_bootstrap.cc:492] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:08.396713  3906 ts_tablet_manager.cc:1403] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.373s	user 0.030s	sys 0.030s
I20260709 12:26:08.400429  3905 raft_consensus.cc:359] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.401160  3905 raft_consensus.cc:385] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.401422  3905 raft_consensus.cc:740] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.405267  3904 raft_consensus.cc:359] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.405958  3904 raft_consensus.cc:385] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.406224  3904 raft_consensus.cc:740] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.408553  4279 raft_consensus.cc:493] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.409049  4279 raft_consensus.cc:515] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.410419  3533 catalog_manager.cc:5697] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.412322  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e083cdabbfa42638fed2591051bc9d6" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:08.414004  3600 leader_election.cc:343] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.415482  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6c38732d3b4d4a92be8805b1e20070" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:08.421667  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e083cdabbfa42638fed2591051bc9d6" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
W20260709 12:26:08.423285  3600 leader_election.cc:343] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.423702  3600 leader_election.cc:304] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:08.424619  4289 raft_consensus.cc:2749] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.425429  4279 leader_election.cc:290] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.406876  3904 consensus_queue.cc:260] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.409327  3906 raft_consensus.cc:359] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.426942  3906 raft_consensus.cc:385] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.430233  3906 raft_consensus.cc:740] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.430953  3906 consensus_queue.cc:260] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.431903  3854 raft_consensus.cc:2468] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:08.433140  3906 ts_tablet_manager.cc:1434] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.003s
I20260709 12:26:08.434064  3906 tablet_bootstrap.cc:492] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:08.428031  3904 ts_tablet_manager.cc:1434] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:26:08.428894  3675 leader_election.cc:304] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:08.403095  3905 consensus_queue.cc:260] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.429814  3903 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:08.441231  3903 ts_tablet_manager.cc:1403] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.400s	user 0.021s	sys 0.023s
I20260709 12:26:08.444242  3903 raft_consensus.cc:359] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.444908  3903 raft_consensus.cc:385] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.445180  3903 raft_consensus.cc:740] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.445815  3903 consensus_queue.cc:260] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.448338  4272 raft_consensus.cc:2804] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.447865  3533 catalog_manager.cc:5697] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.448762  4272 raft_consensus.cc:493] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.449223  4272 raft_consensus.cc:3060] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.452953  4153 raft_consensus.cc:2749] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.460108  3905 ts_tablet_manager.cc:1434] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.002s
I20260709 12:26:08.461086  3905 tablet_bootstrap.cc:492] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:08.452642  3533 catalog_manager.cc:5697] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.453709  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:08.467578  3630 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:08.476017  3533 catalog_manager.cc:5697] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 2, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 2 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.484959  4296 consensus_queue.cc:1048] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:08.457369  4272 raft_consensus.cc:515] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.495880  3903 ts_tablet_manager.cc:1434] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:26:08.502764  3630 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:08.505779  4272 leader_election.cc:290] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:08.510111  3903 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:08.512787  3905 tablet_bootstrap.cc:654] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.516312  3906 tablet_bootstrap.cc:654] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.516849  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6c38732d3b4d4a92be8805b1e20070" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:08.520547  3782 raft_consensus.cc:3060] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.518288  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6c38732d3b4d4a92be8805b1e20070" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:08.521468  3854 raft_consensus.cc:3060] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.524290  4296 consensus_queue.cc:1048] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.528268  3903 tablet_bootstrap.cc:654] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.537395  4158 consensus_queue.cc:1048] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:08.538151  3854 raft_consensus.cc:2468] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:08.542475  3782 raft_consensus.cc:2468] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:08.548779  3675 leader_election.cc:304] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:08.549821  4158 raft_consensus.cc:2804] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.550350  4158 raft_consensus.cc:697] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:08.558879  4223 consensus_queue.cc:1048] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:08.561411  3906 tablet_bootstrap.cc:492] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:08.562124  3906 ts_tablet_manager.cc:1403] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.002s
I20260709 12:26:08.562474  4158 consensus_queue.cc:237] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.565867  3906 raft_consensus.cc:359] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.566807  3906 raft_consensus.cc:385] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.581517  4272 consensus_queue.cc:1048] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.597091  3905 tablet_bootstrap.cc:492] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:08.598749  3905 ts_tablet_manager.cc:1403] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.003s
I20260709 12:26:08.601600  3905 raft_consensus.cc:359] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.601922  4294 consensus_queue.cc:1048] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:08.602327  3905 raft_consensus.cc:385] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.602610  3905 raft_consensus.cc:740] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
W20260709 12:26:08.610512  3823 consensus_peers.cc:597] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.567155  3906 raft_consensus.cc:740] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.620110  3906 consensus_queue.cc:260] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.603237  3905 consensus_queue.cc:260] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.617930  3903 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:08.621819  3903 ts_tablet_manager.cc:1403] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.112s	user 0.032s	sys 0.046s
I20260709 12:26:08.622781  3906 ts_tablet_manager.cc:1434] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 12:26:08.623734  3906 tablet_bootstrap.cc:492] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:08.624541  3903 raft_consensus.cc:359] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.625243  3903 raft_consensus.cc:385] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.625510  3903 raft_consensus.cc:740] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.626284  3903 consensus_queue.cc:260] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.627882  4210 raft_consensus.cc:493] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.628470  4210 raft_consensus.cc:515] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.633312  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:08.634224  3705 raft_consensus.cc:2393] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:08.634806  3905 ts_tablet_manager.cc:1434] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 12:26:08.635758  3905 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:08.637943  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.638700  3782 raft_consensus.cc:2393] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 1: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:08.640020  3903 ts_tablet_manager.cc:1434] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:26:08.630636  4210 leader_election.cc:290] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.640700  3823 leader_election.cc:304] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:08.641858  4210 raft_consensus.cc:3060] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.642299  3906 tablet_bootstrap.cc:654] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.650348  3782 raft_consensus.cc:3060] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.656190  4210 raft_consensus.cc:2749] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.640995  3903 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:08.662614  3903 tablet_bootstrap.cc:654] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.664280  4296 consensus_queue.cc:1048] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:08.665741  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:08.671931  3906 tablet_bootstrap.cc:492] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:08.672458  3906 ts_tablet_manager.cc:1403] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.012s
I20260709 12:26:08.673033  3905 tablet_bootstrap.cc:654] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.675617  3906 raft_consensus.cc:359] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.676649  3906 raft_consensus.cc:385] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.676344  4289 consensus_queue.cc:1048] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:08.677038  3906 raft_consensus.cc:740] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.678156  3906 consensus_queue.cc:260] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.681057  3906 ts_tablet_manager.cc:1434] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:26:08.682014  3906 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:08.687718  3903 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:08.689795  3903 ts_tablet_manager.cc:1403] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
I20260709 12:26:08.693761  3906 tablet_bootstrap.cc:654] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.694059  3905 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:08.694552  3905 ts_tablet_manager.cc:1403] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 12:26:08.692677  3903 raft_consensus.cc:359] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.697723  3905 raft_consensus.cc:359] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:08.698458  3903 raft_consensus.cc:385] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.698684  3905 raft_consensus.cc:385] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.698854  3903 raft_consensus.cc:740] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.700831  3903 consensus_queue.cc:260] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.705415  4158 raft_consensus.cc:493] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.706058  4158 raft_consensus.cc:515] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.707690  3903 ts_tablet_manager.cc:1434] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:08.708887  4158 leader_election.cc:290] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.710573  3903 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:08.722568  3905 raft_consensus.cc:740] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.737831  3903 tablet_bootstrap.cc:654] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.739543  3906 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:08.740108  3906 ts_tablet_manager.cc:1403] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.058s	user 0.033s	sys 0.019s
I20260709 12:26:08.743803  3906 raft_consensus.cc:359] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.744789  3906 raft_consensus.cc:385] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.745133  3906 raft_consensus.cc:740] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.746009  3906 consensus_queue.cc:260] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.737221  3905 consensus_queue.cc:260] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:08.748394  3903 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:08.748827  3905 ts_tablet_manager.cc:1434] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:26:08.748904  3903 ts_tablet_manager.cc:1403] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.004s
I20260709 12:26:08.750046  3905 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:08.754267  4296 raft_consensus.cc:493] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.754906  4296 raft_consensus.cc:515] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.757205  4296 leader_election.cc:290] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.757628  3905 tablet_bootstrap.cc:654] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.759799  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:08.760524  3705 raft_consensus.cc:2468] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:08.761014  3903 raft_consensus.cc:359] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.761713  3903 raft_consensus.cc:385] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.761855  3823 leader_election.cc:304] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:08.762097  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.762950  3782 raft_consensus.cc:2468] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:08.763892  4296 raft_consensus.cc:2804] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.764348  4296 raft_consensus.cc:493] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.761989  3903 raft_consensus.cc:740] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.764678  4296 raft_consensus.cc:3060] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.766312  3903 consensus_queue.cc:260] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.774982  4289 consensus_queue.cc:1048] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:08.781338  3903 ts_tablet_manager.cc:1434] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 12:26:08.782400  3903 tablet_bootstrap.cc:492] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:08.791302  3906 ts_tablet_manager.cc:1434] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:26:08.791509  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f651c75d6a434e50a9e9e0e36543be65" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.792469  3784 raft_consensus.cc:2468] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:08.792781  4298 raft_consensus.cc:493] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.793263  4298 raft_consensus.cc:515] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.795414  4298 leader_election.cc:290] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:08.803288  3903 tablet_bootstrap.cc:654] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.807180  4296 raft_consensus.cc:515] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.808626  3906 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:08.816898  4298 raft_consensus.cc:493] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.817472  4298 raft_consensus.cc:515] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.821803  4298 leader_election.cc:290] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:08.822558  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62f9c73102a4b07a57947eb81059e1e" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:08.823485  3906 tablet_bootstrap.cc:654] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.823583  3857 raft_consensus.cc:2468] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:08.824105  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62f9c73102a4b07a57947eb81059e1e" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:08.824744  3631 raft_consensus.cc:2468] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:08.825423  3749 leader_election.cc:304] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:08.826713  4298 raft_consensus.cc:2804] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.828836  4298 raft_consensus.cc:493] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.829276  4298 raft_consensus.cc:3060] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.829594  3905 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:08.830238  3905 ts_tablet_manager.cc:1403] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.010s
I20260709 12:26:08.831455  3906 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:08.831919  3906 ts_tablet_manager.cc:1403] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 12:26:08.834074  3906 raft_consensus.cc:359] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.834929  3906 raft_consensus.cc:385] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.835188  3906 raft_consensus.cc:740] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.836020  3906 consensus_queue.cc:260] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.838405  4298 raft_consensus.cc:515] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.840078  3906 ts_tablet_manager.cc:1434] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:08.841715  3906 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:08.843555  3905 raft_consensus.cc:359] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:08.846153  3905 raft_consensus.cc:385] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.847118  3905 raft_consensus.cc:740] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.848325  3906 tablet_bootstrap.cc:654] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.848701  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62f9c73102a4b07a57947eb81059e1e" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:08.849444  3857 raft_consensus.cc:3060] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.844429  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f2315d32f6457b80884480feef6a4b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:08.851877  3905 consensus_queue.cc:260] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:08.853579  3630 raft_consensus.cc:2393] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 1: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:08.858072  3532 catalog_manager.cc:5697] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.858870  3905 ts_tablet_manager.cc:1434] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:26:08.860464  3905 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:08.864027  3906 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:08.864490  3906 ts_tablet_manager.cc:1403] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 12:26:08.867466  3906 raft_consensus.cc:359] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:08.868026  4221 raft_consensus.cc:493] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.868232  3906 raft_consensus.cc:385] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.868295  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f651c75d6a434e50a9e9e0e36543be65" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:08.868642  3906 raft_consensus.cc:740] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.868595  4221 raft_consensus.cc:515] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.869071  3631 raft_consensus.cc:2468] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:08.869550  3906 consensus_queue.cc:260] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:08.861848  4298 leader_election.cc:290] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:08.863615  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62f9c73102a4b07a57947eb81059e1e" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:08.870765  3630 raft_consensus.cc:3060] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.872869  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:08.873507  3854 raft_consensus.cc:2468] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 0.
I20260709 12:26:08.874130  3906 ts_tablet_manager.cc:1434] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:08.875134  3906 tablet_bootstrap.cc:492] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:08.870874  4221 leader_election.cc:290] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:08.874989  3600 leader_election.cc:304] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:08.876212  4221 raft_consensus.cc:2804] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.876583  4221 raft_consensus.cc:493] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.876931  4221 raft_consensus.cc:3060] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.879921  4215 consensus_queue.cc:1048] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.882438  3906 tablet_bootstrap.cc:654] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.886698  4275 consensus_queue.cc:1048] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.888959  4221 raft_consensus.cc:515] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.890188  3633 raft_consensus.cc:1275] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:08.891820  3780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:08.889241  3673 leader_election.cc:304] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:08.893306  4223 raft_consensus.cc:2804] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.893796  4223 raft_consensus.cc:493] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.894214  4223 raft_consensus.cc:3060] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.895041  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:08.900166  3857 raft_consensus.cc:2468] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:08.901419  3749 leader_election.cc:304] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:08.902129  4298 raft_consensus.cc:2804] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.905651  4298 raft_consensus.cc:697] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:08.906720  4298 consensus_queue.cc:237] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:08.910089  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:08.910756  4296 leader_election.cc:290] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.910938  3705 raft_consensus.cc:3060] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:08.893301  3600 leader_election.cc:343] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:08.914911  3600 leader_election.cc:343] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.915457  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:08.916086  3854 raft_consensus.cc:3060] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.921140  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:08.921859  3781 raft_consensus.cc:3060] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.928588  3630 raft_consensus.cc:2468] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:08.930126  3854 raft_consensus.cc:2468] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 1.
I20260709 12:26:08.930331  3905 tablet_bootstrap.cc:654] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.925171  4223 raft_consensus.cc:515] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.943375  4223 leader_election.cc:290] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:08.913275  4221 leader_election.cc:290] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:08.951833  3781 raft_consensus.cc:2468] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:08.954011  3823 leader_election.cc:304] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:08.955111  4297 raft_consensus.cc:493] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.955766  4297 raft_consensus.cc:515] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:08.956569  3705 raft_consensus.cc:2468] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:08.957207  4294 raft_consensus.cc:2804] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.957741  4294 raft_consensus.cc:697] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:08.958624  4294 consensus_queue.cc:237] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:08.967970  3905 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
W20260709 12:26:08.968160  3675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:38747, user_credentials={real_user=slave}} blocked reactor thread for 134576us
I20260709 12:26:08.968520  3905 ts_tablet_manager.cc:1403] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.108s	user 0.005s	sys 0.007s
I20260709 12:26:08.971179  3905 raft_consensus.cc:359] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.972396  3905 raft_consensus.cc:385] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.972673  3905 raft_consensus.cc:740] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.958448  4297 leader_election.cc:290] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:08.973345  3905 consensus_queue.cc:260] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:08.974144  3781 raft_consensus.cc:1275] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:08.974798  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f9aead41d420995c59bc0f03e4cc6" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:08.975522  3710 raft_consensus.cc:2468] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:08.976704  3823 leader_election.cc:304] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:08.977259  3905 ts_tablet_manager.cc:1434] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:08.977492  4296 raft_consensus.cc:2804] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.977974  4296 raft_consensus.cc:493] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.978267  3905 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:08.978332  4296 raft_consensus.cc:3060] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.963508  3530 catalog_manager.cc:5697] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.993331  3905 tablet_bootstrap.cc:654] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.994524  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f651c75d6a434e50a9e9e0e36543be65" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:08.995222  3783 raft_consensus.cc:3060] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.014389  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f2315d32f6457b80884480feef6a4b" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:09.016703  4296 raft_consensus.cc:515] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:09.020962  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f9aead41d420995c59bc0f03e4cc6" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:09.021739  3634 raft_consensus.cc:2468] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:09.024201  3905 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:09.027143  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f9aead41d420995c59bc0f03e4cc6" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:09.027906  3707 raft_consensus.cc:3060] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.026049  4296 leader_election.cc:290] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:09.044483  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f9aead41d420995c59bc0f03e4cc6" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:09.045198  3634 raft_consensus.cc:3060] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.055217  4218 consensus_queue.cc:1048] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.058032  3783 raft_consensus.cc:2468] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:09.061370  3782 raft_consensus.cc:3060] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.067239  3903 tablet_bootstrap.cc:492] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:09.067845  3903 ts_tablet_manager.cc:1403] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.286s	user 0.015s	sys 0.029s
I20260709 12:26:09.069633  4223 consensus_queue.cc:1048] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.071162  4223 consensus_queue.cc:1048] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.072642  3906 tablet_bootstrap.cc:492] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:09.073165  3906 ts_tablet_manager.cc:1403] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.198s	user 0.081s	sys 0.081s
I20260709 12:26:09.082108  3707 raft_consensus.cc:2468] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:09.083556  3823 leader_election.cc:304] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:09.084400  4215 raft_consensus.cc:2804] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.084962  4215 raft_consensus.cc:697] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:09.085788  4215 consensus_queue.cc:237] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
W20260709 12:26:09.100453  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:41805, user_credentials={real_user=slave}} blocked reactor thread for 173044us
I20260709 12:26:09.027387  3905 ts_tablet_manager.cc:1403] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 12:26:09.079118  3906 raft_consensus.cc:359] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.163667  4223 consensus_queue.cc:1048] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.169168  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f651c75d6a434e50a9e9e0e36543be65" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:09.169848  3630 raft_consensus.cc:3060] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.168115  3906 raft_consensus.cc:385] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.171092  3906 raft_consensus.cc:740] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.171840  3906 consensus_queue.cc:260] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
W20260709 12:26:09.164387  3675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:36779, user_credentials={real_user=slave}} blocked reactor thread for 68695.8us
I20260709 12:26:09.183880  3675 leader_election.cc:304] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:09.185110  4275 raft_consensus.cc:2804] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.185602  4275 raft_consensus.cc:697] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:09.186594  3903 raft_consensus.cc:359] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.187280  3903 raft_consensus.cc:385] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.187546  3903 raft_consensus.cc:740] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.186483  4275 consensus_queue.cc:237] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:09.188829  3749 leader_election.cc:304] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:09.190779  4153 raft_consensus.cc:2749] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.191794  3600 leader_election.cc:304] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:09.197899  3705 raft_consensus.cc:3060] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.198413  4334 raft_consensus.cc:2804] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.199167  4334 raft_consensus.cc:697] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:09.200376  3530 catalog_manager.cc:5697] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.201967  4334 consensus_queue.cc:237] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:09.203542  4222 raft_consensus.cc:493] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.204056  4222 raft_consensus.cc:515] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:09.205466  3634 raft_consensus.cc:2468] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:09.206079  4222 leader_election.cc:290] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:09.188208  3903 consensus_queue.cc:260] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.211148  3906 ts_tablet_manager.cc:1434] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.135s	user 0.009s	sys 0.002s
I20260709 12:26:09.214695  3906 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Bootstrap starting.
I20260709 12:26:09.218451  3632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e083cdabbfa42638fed2591051bc9d6" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:09.219380  3632 raft_consensus.cc:2468] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:09.226528  3903 ts_tablet_manager.cc:1434] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.158s	user 0.007s	sys 0.005s
I20260709 12:26:09.238281  3906 tablet_bootstrap.cc:654] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.275883  3903 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902: Bootstrap starting.
I20260709 12:26:09.266496  4218 consensus_queue.cc:1048] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.276183  3630 raft_consensus.cc:2468] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
W20260709 12:26:09.263442  3600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:41805, user_credentials={real_user=slave}} blocked reactor thread for 43919.1us
W20260709 12:26:09.301514  3749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:38747, user_credentials={real_user=slave}} blocked reactor thread for 110387us
I20260709 12:26:09.302937  3532 catalog_manager.cc:5697] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.315675  3903 tablet_bootstrap.cc:654] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.316474  3710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e083cdabbfa42638fed2591051bc9d6" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:09.317202  3710 raft_consensus.cc:2468] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 0.
I20260709 12:26:09.321133  4218 consensus_queue.cc:1048] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.380353  4210 raft_consensus.cc:493] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.383536  4210 raft_consensus.cc:515] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.386763  4210 leader_election.cc:290] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:09.388383  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07cd2a3e0cb4de9a4e366ccadc47722" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
W20260709 12:26:09.390328  3823 leader_election.cc:343] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.397275  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07cd2a3e0cb4de9a4e366ccadc47722" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:09.397977  3781 raft_consensus.cc:2468] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 0.
I20260709 12:26:09.399160  3823 leader_election.cc:304] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f
I20260709 12:26:09.398976  3533 catalog_manager.cc:5697] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.400223  4210 raft_consensus.cc:2804] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.400689  4210 raft_consensus.cc:493] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.401021  4210 raft_consensus.cc:3060] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.410225  4210 raft_consensus.cc:515] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.416540  4210 leader_election.cc:290] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:09.422719  3781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07cd2a3e0cb4de9a4e366ccadc47722" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:09.423424  3781 raft_consensus.cc:3060] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.423867  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07cd2a3e0cb4de9a4e366ccadc47722" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:09.424337  4294 consensus_queue.cc:1048] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:09.425264  3823 leader_election.cc:343] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.433800  4294 consensus_queue.cc:1048] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.263514  3747 leader_election.cc:304] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:09.250386  3905 raft_consensus.cc:359] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:09.440546  3905 raft_consensus.cc:385] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.440886  3905 raft_consensus.cc:740] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.441591  3905 consensus_queue.cc:260] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:09.443717  3905 ts_tablet_manager.cc:1434] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.278s	user 0.006s	sys 0.000s
I20260709 12:26:09.444661  3905 tablet_bootstrap.cc:492] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f: Bootstrap starting.
I20260709 12:26:09.454082  3905 tablet_bootstrap.cc:654] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:09.458128  3749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.194:41805, user_credentials={real_user=slave}} blocked reactor thread for 126395us
I20260709 12:26:09.477659  4222 raft_consensus.cc:2804] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.478164  4222 raft_consensus.cc:493] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.478739  4222 raft_consensus.cc:3060] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.480515  3903 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902: No bootstrap required, opened a new log
I20260709 12:26:09.481096  3903 ts_tablet_manager.cc:1403] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902: Time spent bootstrapping tablet: real 0.205s	user 0.036s	sys 0.061s
I20260709 12:26:09.483850  3903 raft_consensus.cc:359] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:09.484476  3903 raft_consensus.cc:385] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.484534  3781 raft_consensus.cc:2468] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
W20260709 12:26:09.486016  3747 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.193:42391, user_credentials={real_user=slave}} blocked reactor thread for 222563us
I20260709 12:26:09.488883  3823 leader_election.cc:304] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f
I20260709 12:26:09.489821  3906 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a: No bootstrap required, opened a new log
I20260709 12:26:09.490290  3906 ts_tablet_manager.cc:1403] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent bootstrapping tablet: real 0.276s	user 0.014s	sys 0.009s
I20260709 12:26:09.484762  3903 raft_consensus.cc:740] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.494560  4294 raft_consensus.cc:2804] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.494894  3903 consensus_queue.cc:260] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:09.496074  4294 raft_consensus.cc:697] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:09.497499  3903 ts_tablet_manager.cc:1434] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:26:09.527488  4353 consensus_queue.cc:1048] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.497066  4294 consensus_queue.cc:237] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.535970  3906 raft_consensus.cc:359] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:09.538537  3906 raft_consensus.cc:385] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.539215  3906 raft_consensus.cc:740] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.539928  3906 consensus_queue.cc:260] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:09.563493  3906 ts_tablet_manager.cc:1434] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 12:26:09.576982  4153 consensus_queue.cc:1048] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.593516  4222 raft_consensus.cc:515] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:09.605883  4210 consensus_queue.cc:1048] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.609400  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e083cdabbfa42638fed2591051bc9d6" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:09.610275  3705 raft_consensus.cc:3060] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.617578  4222 leader_election.cc:290] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
W20260709 12:26:09.632520  3747 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.193:42391, user_credentials={real_user=slave}} blocked reactor thread for 56385.2us
I20260709 12:26:09.633188  3529 catalog_manager.cc:5697] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 1 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.644194  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e083cdabbfa42638fed2591051bc9d6" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:09.644883  3630 raft_consensus.cc:3060] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.650596  3905 tablet_bootstrap.cc:492] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f: No bootstrap required, opened a new log
I20260709 12:26:09.651141  3905 ts_tablet_manager.cc:1403] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.002s
I20260709 12:26:09.654090  3630 raft_consensus.cc:2468] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:09.656111  3905 raft_consensus.cc:359] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.656843  3905 raft_consensus.cc:385] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.657104  3905 raft_consensus.cc:740] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.658497  3747 leader_election.cc:304] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:09.659472  4210 consensus_queue.cc:1048] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.659778  4298 raft_consensus.cc:2804] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.660521  4298 raft_consensus.cc:697] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:09.662961  4334 consensus_queue.cc:1048] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.668087  3905 consensus_queue.cc:260] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.661692  4298 consensus_queue.cc:237] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:09.690932  3705 raft_consensus.cc:2468] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:09.689882  4275 consensus_queue.cc:1048] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.678753  3530 catalog_manager.cc:5697] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.710188  3905 ts_tablet_manager.cc:1434] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 12:26:09.711145  3781 raft_consensus.cc:3060] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:09.754590  3581 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:09.756153  4356 raft_consensus.cc:493] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.756701  4356 raft_consensus.cc:515] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:09.763044  4356 leader_election.cc:290] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:09.766070  3633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:09.771344  4279 consensus_queue.cc:1048] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.775593  4329 raft_consensus.cc:493] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.776155  4329 raft_consensus.cc:515] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:09.778326  4329 leader_election.cc:290] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:09.779460  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff8ced4a7c47afba587ccdac4e1487" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:09.780122  3634 raft_consensus.cc:2468] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:09.776263  4275 consensus_queue.cc:1048] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.781221  3673 leader_election.cc:304] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:09.782173  4275 raft_consensus.cc:2804] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.782537  4275 raft_consensus.cc:493] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.782873  4275 raft_consensus.cc:3060] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.813553  4218 raft_consensus.cc:493] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.814313  4218 raft_consensus.cc:515] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.815348  4275 raft_consensus.cc:515] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:09.816440  4218 leader_election.cc:290] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:09.818457  3634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff8ced4a7c47afba587ccdac4e1487" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:09.819121  3634 raft_consensus.cc:3060] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.823787  4275 leader_election.cc:290] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:09.828855  3634 raft_consensus.cc:2468] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:09.830161  3673 leader_election.cc:304] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:09.831084  4275 raft_consensus.cc:2804] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.832137  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:09.831665  4275 raft_consensus.cc:697] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:09.834122  4275 consensus_queue.cc:237] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:09.835376  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff8ced4a7c47afba587ccdac4e1487" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:09.836011  3854 raft_consensus.cc:2468] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 0.
I20260709 12:26:09.838186  3749 leader_election.cc:304] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:09.840131  4356 raft_consensus.cc:2749] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:09.862327  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07cd2a3e0cb4de9a4e366ccadc47722" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:09.863572  3784 raft_consensus.cc:2393] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 1: Already voted for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in this term.
I20260709 12:26:09.870232  4360 raft_consensus.cc:493] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.870790  4360 raft_consensus.cc:515] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.873167  4360 leader_election.cc:290] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:09.895135  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:09.895828  3854 raft_consensus.cc:2468] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:09.896966  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07cd2a3e0cb4de9a4e366ccadc47722" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:09.901382  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:09.901736  3749 leader_election.cc:304] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:09.902029  3707 raft_consensus.cc:2468] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:09.902706  4222 raft_consensus.cc:2804] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:09.903091  4222 raft_consensus.cc:493] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.903443  4222 raft_consensus.cc:3060] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.908692  3675 leader_election.cc:304] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:09.917647  4222 raft_consensus.cc:515] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.920935  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff8ced4a7c47afba587ccdac4e1487" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:09.924659  3854 raft_consensus.cc:3060] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.925380  4218 raft_consensus.cc:3060] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.935292  4218 raft_consensus.cc:2749] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.968235  3533 catalog_manager.cc:5697] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 1 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.973022  4222 leader_election.cc:290] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:09.978044  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:09.978761  3857 raft_consensus.cc:3060] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.978206  3854 raft_consensus.cc:2468] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:09.987605  3857 raft_consensus.cc:2468] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:09.988660  3749 leader_election.cc:304] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:09.989416  4222 raft_consensus.cc:2804] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:09.989923  4222 raft_consensus.cc:697] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:09.990764  4222 consensus_queue.cc:237] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:09.997699  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff54594fa04818823d814a68d333dd" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:09.998345  3705 raft_consensus.cc:3060] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.006989  3529 catalog_manager.cc:5697] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.009141  4297 consensus_queue.cc:1048] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.014842  4297 consensus_queue.cc:1048] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.018607  3705 raft_consensus.cc:2468] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:10.085875  3530 catalog_manager.cc:5697] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 0 to 2, leader changed from <none> to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 2 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.192755  4222 consensus_queue.cc:1048] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.203290  4222 consensus_queue.cc:1048] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:10.308645  4326 consensus_queue.cc:1048] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.320308  4218 consensus_queue.cc:1048] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.473071  3858 raft_consensus.cc:1275] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:10.474210  4222 consensus_queue.cc:1048] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.482890  3705 raft_consensus.cc:1275] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:10.484200  4298 consensus_queue.cc:1048] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.032469 30223 tablet_server.cc:179] TabletServer@127.29.131.193:0 shutting down...
W20260709 12:26:11.058799  3821 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:26:11.069671  3821 consensus_peers.cc:597] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.080197  3821 consensus_peers.cc:597] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.087843  3747 consensus_peers.cc:597] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.093024 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:11.095459 30223 tablet_replica.cc:333] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.098229 30223 raft_consensus.cc:2243] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.099289 30223 raft_consensus.cc:2272] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.101379  3821 consensus_peers.cc:597] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.103365 30223 tablet_replica.cc:333] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.104174 30223 raft_consensus.cc:2243] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.104723 30223 raft_consensus.cc:2272] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.106940 30223 tablet_replica.cc:333] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.107565 30223 raft_consensus.cc:2243] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.108024 30223 raft_consensus.cc:2272] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.110486 30223 tablet_replica.cc:333] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.111079 30223 raft_consensus.cc:2243] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.112140 30223 raft_consensus.cc:2272] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.114655 30223 tablet_replica.cc:333] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.115696 30223 raft_consensus.cc:2243] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.116801 30223 raft_consensus.cc:2272] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.120277 30223 tablet_replica.cc:333] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.121235 30223 raft_consensus.cc:2243] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.121943 30223 raft_consensus.cc:2272] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.124490 30223 tablet_replica.cc:333] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.125160 30223 raft_consensus.cc:2243] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.125643 30223 raft_consensus.cc:2272] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.128147 30223 tablet_replica.cc:333] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.128768 30223 raft_consensus.cc:2243] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.129289 30223 raft_consensus.cc:2272] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.132323 30223 tablet_replica.cc:333] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.133266 30223 raft_consensus.cc:2243] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.133945 30223 raft_consensus.cc:2272] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.137082 30223 tablet_replica.cc:333] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.137902 30223 raft_consensus.cc:2243] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.138516 30223 raft_consensus.cc:2272] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.141191  3673 consensus_peers.cc:597] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.141938 30223 tablet_replica.cc:333] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.143059 30223 raft_consensus.cc:2243] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.143781 30223 raft_consensus.cc:2272] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.145385  3821 consensus_peers.cc:597] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.147656 30223 tablet_replica.cc:333] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.148837 30223 raft_consensus.cc:2243] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.149757 30223 raft_consensus.cc:2272] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.153144 30223 tablet_replica.cc:333] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.153970 30223 raft_consensus.cc:2243] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.154461 30223 raft_consensus.cc:2272] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.156617 30223 tablet_replica.cc:333] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.157183 30223 raft_consensus.cc:2243] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.157603 30223 raft_consensus.cc:2272] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.159684 30223 tablet_replica.cc:333] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.160216 30223 raft_consensus.cc:2243] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.160753 30223 raft_consensus.cc:2272] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.162864 30223 tablet_replica.cc:333] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.163488 30223 raft_consensus.cc:2243] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.163973 30223 raft_consensus.cc:2272] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.166121 30223 tablet_replica.cc:333] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.166706 30223 raft_consensus.cc:2243] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.167289 30223 raft_consensus.cc:2272] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.170912 30223 tablet_replica.cc:333] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.171958 30223 raft_consensus.cc:2243] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.172657 30223 raft_consensus.cc:2272] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.174321  3673 consensus_peers.cc:597] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.176079 30223 tablet_replica.cc:333] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.176786 30223 raft_consensus.cc:2243] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.177297 30223 raft_consensus.cc:2272] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.180218 30223 tablet_replica.cc:333] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.180825 30223 raft_consensus.cc:2243] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.181846 30223 raft_consensus.cc:2272] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.184263 30223 tablet_replica.cc:333] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.184845 30223 raft_consensus.cc:2243] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.185364 30223 raft_consensus.cc:2272] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.188463 30223 tablet_replica.cc:333] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.189365 30223 raft_consensus.cc:2243] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.190744 30223 raft_consensus.cc:2272] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.193684 30223 tablet_replica.cc:333] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.194383 30223 raft_consensus.cc:2243] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.194912 30223 raft_consensus.cc:2272] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.195789  3673 consensus_peers.cc:597] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.197738 30223 tablet_replica.cc:333] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.198731 30223 raft_consensus.cc:2243] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.199587 30223 raft_consensus.cc:2272] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.201135  3821 consensus_peers.cc:597] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.202862 30223 tablet_replica.cc:333] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.203850 30223 raft_consensus.cc:2243] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:11.203977  3747 consensus_peers.cc:597] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.204751 30223 raft_consensus.cc:2272] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.206655  3673 consensus_peers.cc:597] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.208127 30223 tablet_replica.cc:333] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.208829 30223 raft_consensus.cc:2243] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.209892 30223 raft_consensus.cc:2272] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.212587 30223 tablet_replica.cc:333] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.213266 30223 raft_consensus.cc:2243] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.213850 30223 raft_consensus.cc:2272] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.216897 30223 tablet_replica.cc:333] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.217582 30223 raft_consensus.cc:2243] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.218148 30223 raft_consensus.cc:2272] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.218582  3821 consensus_peers.cc:597] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.219682  3747 consensus_peers.cc:597] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.221544 30223 tablet_replica.cc:333] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.222298 30223 raft_consensus.cc:2243] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.222858 30223 raft_consensus.cc:2272] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.223968  3821 consensus_peers.cc:597] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.225440 30223 tablet_replica.cc:333] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.226084 30223 raft_consensus.cc:2243] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.227026 30223 raft_consensus.cc:2272] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.229750 30223 tablet_replica.cc:333] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.230270 30223 raft_consensus.cc:2243] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.231019 30223 raft_consensus.cc:2272] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.233067 30223 tablet_replica.cc:333] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.233654 30223 raft_consensus.cc:2243] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.234086 30223 raft_consensus.cc:2272] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.236089 30223 tablet_replica.cc:333] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.236586 30223 raft_consensus.cc:2243] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.237039 30223 raft_consensus.cc:2272] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.239032 30223 tablet_replica.cc:333] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.239562 30223 raft_consensus.cc:2243] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.240029 30223 raft_consensus.cc:2272] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.242884 30223 tablet_replica.cc:333] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.243719 30223 raft_consensus.cc:2243] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.244429 30223 raft_consensus.cc:2272] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.247524 30223 tablet_replica.cc:333] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.248162 30223 raft_consensus.cc:2243] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.248586 30223 raft_consensus.cc:2272] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.250765 30223 tablet_replica.cc:333] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.251483 30223 raft_consensus.cc:2243] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.252507 30223 raft_consensus.cc:2272] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.255062 30223 tablet_replica.cc:333] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.255635 30223 raft_consensus.cc:2243] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.256075 30223 raft_consensus.cc:2272] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.258163 30223 tablet_replica.cc:333] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.258945 30223 raft_consensus.cc:2243] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.259579 30223 raft_consensus.cc:2272] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.261660 30223 tablet_replica.cc:333] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.262197 30223 raft_consensus.cc:2243] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.262980 30223 raft_consensus.cc:2272] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.264873 30223 tablet_replica.cc:333] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.265412 30223 raft_consensus.cc:2243] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.265843 30223 raft_consensus.cc:2272] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.267926 30223 tablet_replica.cc:333] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.268553 30223 raft_consensus.cc:2243] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.269178 30223 raft_consensus.cc:2272] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.271557 30223 tablet_replica.cc:333] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.272235 30223 raft_consensus.cc:2243] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.272859 30223 raft_consensus.cc:2272] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.275521 30223 tablet_replica.cc:333] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.276070 30223 raft_consensus.cc:2243] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:11.276952 30223 raft_consensus.cc:2272] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.279376 30223 tablet_replica.cc:333] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: stopping tablet replica
I20260709 12:26:11.279910 30223 raft_consensus.cc:2243] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.280386 30223 raft_consensus.cc:2272] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:11.295420  3673 consensus_peers.cc:597] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.299302  3673 consensus_peers.cc:597] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.301133  3747 consensus_peers.cc:597] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.307080  3673 consensus_peers.cc:597] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.312853  3747 consensus_peers.cc:597] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.314914  3673 consensus_peers.cc:597] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.327999  3821 consensus_peers.cc:597] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.332645  3821 consensus_peers.cc:597] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.343645  3747 consensus_peers.cc:597] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.349867  3673 consensus_peers.cc:597] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.365744  3747 consensus_peers.cc:597] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.380523 30223 tablet_server.cc:196] TabletServer@127.29.131.193:0 shutdown complete.
W20260709 12:26:11.391781  3673 consensus_peers.cc:597] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.396344  3821 consensus_peers.cc:597] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.436295  3673 consensus_peers.cc:597] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.469044  3747 consensus_peers.cc:597] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.477886  3673 consensus_peers.cc:597] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.484972  3747 consensus_peers.cc:597] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.490141  3747 consensus_peers.cc:597] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.497285 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:11.506011  4391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:11.509879  4392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:11.524070  3821 consensus_peers.cc:597] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.527873 30223 server_base.cc:1061] running on GCE node
W20260709 12:26:11.529681  4395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:11.534467 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:11.534786 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:11.535010 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599971534992 us; error 0 us; skew 500 ppm
I20260709 12:26:11.535809 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:11.539692 30223 webserver.cc:533] Webserver started at http://127.29.131.193:41357/ using document root <none> and password file <none>
I20260709 12:26:11.540434 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:11.540721 30223 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:26:11.545902 30223 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:26:11.556242  4399 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:11.557111 30223 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:26:11.557461 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "a423544d890d41e7870787a3a92aaf58"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-n640"
I20260709 12:26:11.558000 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:11.568897 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:11.570154 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:11.571587 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:11.576119  4406 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:26:11.588862  3747 consensus_peers.cc:597] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:11.646230  3821 consensus_peers.cc:597] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.825439 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:26:11.825836 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.251s	user 0.009s	sys 0.000s
I20260709 12:26:11.826190 30223 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:26:11.832526  4406 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:11.855870  4406 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:11.856943  4406 tablet_bootstrap.cc:492] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:11.857668  4406 ts_tablet_manager.cc:1403] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:26:11.860597  4406 raft_consensus.cc:359] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:11.861529  4406 raft_consensus.cc:740] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.862242  4406 consensus_queue.cc:260] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:11.865118  4406 ts_tablet_manager.cc:1434] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:11.866150  4406 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:11.880692  4406 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:11.881552  4406 tablet_bootstrap.cc:492] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:11.882167  4406 ts_tablet_manager.cc:1403] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:26:11.884684  4406 raft_consensus.cc:359] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:11.885313  4406 raft_consensus.cc:740] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.886001  4406 consensus_queue.cc:260] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:11.887797  4406 ts_tablet_manager.cc:1434] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:26:11.888520  4406 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:11.926775  4406 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:11.927711  4406 tablet_bootstrap.cc:492] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:11.928300  4406 ts_tablet_manager.cc:1403] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.024s
I20260709 12:26:11.930578  4406 raft_consensus.cc:359] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:11.931208  4406 raft_consensus.cc:740] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.936611  4406 consensus_queue.cc:260] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:11.938467  4406 ts_tablet_manager.cc:1434] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.004s
I20260709 12:26:11.939275  4406 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.110737  4406 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.111713  4406 tablet_bootstrap.cc:492] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.119799  4406 ts_tablet_manager.cc:1403] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.181s	user 0.063s	sys 0.081s
I20260709 12:26:12.122674  4406 raft_consensus.cc:359] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.123378  4406 raft_consensus.cc:740] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.124065  4406 consensus_queue.cc:260] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.125974  4406 ts_tablet_manager.cc:1434] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:12.127010  4406 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.150496  4406 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.151463  4406 tablet_bootstrap.cc:492] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.152064  4406 ts_tablet_manager.cc:1403] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 12:26:12.154464  4406 raft_consensus.cc:359] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.155167  4406 raft_consensus.cc:740] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.156029  4406 consensus_queue.cc:260] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.158169  4406 ts_tablet_manager.cc:1434] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:12.158960  4406 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.173432  4406 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.174427  4406 tablet_bootstrap.cc:492] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.175068  4406 ts_tablet_manager.cc:1403] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:26:12.177467  4406 raft_consensus.cc:359] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.178172  4406 raft_consensus.cc:740] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.178301 30223 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:26:12.178741 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.353s	user 0.255s	sys 0.012s
I20260709 12:26:12.179128  4406 consensus_queue.cc:260] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.181226  4406 ts_tablet_manager.cc:1434] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:12.181838  4406 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.197743  4406 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.198789  4406 tablet_bootstrap.cc:492] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.199479  4406 ts_tablet_manager.cc:1403] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:26:12.202029  4406 raft_consensus.cc:359] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.202742  4406 raft_consensus.cc:740] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.203382  4406 consensus_queue.cc:260] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.206010  4406 ts_tablet_manager.cc:1434] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:12.206739  4406 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.221108  4406 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.222064  4406 tablet_bootstrap.cc:492] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.222769  4406 ts_tablet_manager.cc:1403] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 12:26:12.225356  4406 raft_consensus.cc:359] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.226119  4406 raft_consensus.cc:740] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.226974  4406 consensus_queue.cc:260] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.229012  4406 ts_tablet_manager.cc:1434] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:12.229785  4406 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.243647  4406 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.244622  4406 tablet_bootstrap.cc:492] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.245266  4406 ts_tablet_manager.cc:1403] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:26:12.247090  4406 raft_consensus.cc:359] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.247843  4406 raft_consensus.cc:740] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.248607  4406 consensus_queue.cc:260] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.250662  4406 ts_tablet_manager.cc:1434] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:26:12.251533  4406 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.253836 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:42391
I20260709 12:26:12.253953  4482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:42391 every 8 connection(s)
I20260709 12:26:12.294808  4406 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.295883  4406 tablet_bootstrap.cc:492] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.298023  4414 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.298671  4414 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.296586  4406 ts_tablet_manager.cc:1403] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.012s
I20260709 12:26:12.302081  4406 raft_consensus.cc:359] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.302829  4406 raft_consensus.cc:740] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.303721  4406 consensus_queue.cc:260] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.305197  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.305677  4406 ts_tablet_manager.cc:1434] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:12.306542  4406 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.301012  4414 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
W20260709 12:26:12.307950  3673 leader_election.cc:343] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.311075  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:12.311573  4407 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.312103  4407 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.313392  4419 raft_consensus.cc:493] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.313876  4419 raft_consensus.cc:515] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.314353  4407 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.316255  4419 leader_election.cc:290] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.316911  3783 raft_consensus.cc:2468] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:12.317329  4408 raft_consensus.cc:493] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.317910  4408 raft_consensus.cc:515] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.320781  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:12.320935  4408 leader_election.cc:290] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.325443  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:12.328274  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.330111  4382 raft_consensus.cc:493] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.330626  4382 raft_consensus.cc:515] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.332866  4382 leader_election.cc:290] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.335047  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:12.335667  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:12.336266  3705 raft_consensus.cc:2468] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:12.338799  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:12.340363  3821 leader_election.cc:343] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.340766  3821 leader_election.cc:304] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.342439  4294 raft_consensus.cc:2749] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:12.344326  3673 leader_election.cc:343] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.345191  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.345927  4456 raft_consensus.cc:2468] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:12.346752  4222 raft_consensus.cc:493] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.347388  3675 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.347506  4222 raft_consensus.cc:515] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.348563  3749 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:12.349634  4222 leader_election.cc:290] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.349907  4380 raft_consensus.cc:2804] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.350175  4222 raft_consensus.cc:2804] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.350298  4380 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.350514  4222 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.350721  4380 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.350916  4222 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.351106  4406 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.353724  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:12.354584  4406 tablet_bootstrap.cc:492] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.347426  4484 heartbeater.cc:344] Connected to a master server at 127.29.131.254:37927
I20260709 12:26:12.355774  4484 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:12.356179  4406 ts_tablet_manager.cc:1403] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.016s
I20260709 12:26:12.356772  4484 heartbeater.cc:507] Master 127.29.131.254:37927 requested a full tablet report, sending...
I20260709 12:26:12.357148  3675 leader_election.cc:304] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.358933  4419 raft_consensus.cc:2749] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.352665  4294 raft_consensus.cc:493] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.359858  4294 raft_consensus.cc:515] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.362939  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:12.365722  4294 leader_election.cc:290] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.347841  3821 leader_election.cc:304] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:12.366959  4408 raft_consensus.cc:2804] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.367421  4408 raft_consensus.cc:493] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.368005  4457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.368824  4408 raft_consensus.cc:3060] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.368896  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:12.370158  3821 leader_election.cc:343] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.370610  3821 leader_election.cc:304] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.368076  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.371870  4383 raft_consensus.cc:493] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
W20260709 12:26:12.372608  3747 leader_election.cc:343] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.372344  4383 raft_consensus.cc:515] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.373091  3747 leader_election.cc:304] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
W20260709 12:26:12.374725  3747 leader_election.cc:343] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.374862  4383 leader_election.cc:290] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.375381  4407 raft_consensus.cc:2749] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.375176  4382 raft_consensus.cc:2749] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.377974  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:12.378082  4408 raft_consensus.cc:515] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.381830  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:12.382705  4408 leader_election.cc:290] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.382447  4380 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.358736  4406 raft_consensus.cc:359] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.384171  4406 raft_consensus.cc:740] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.384934  4406 consensus_queue.cc:260] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.385633  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.386788  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:12.386870  3673 leader_election.cc:343] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.387642  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.387567  4456 raft_consensus.cc:2468] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:12.388425  4451 raft_consensus.cc:3060] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.388494  4380 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:12.387006  4406 ts_tablet_manager.cc:1434] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:26:12.391856  4406 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.392694  4222 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.395330  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
W20260709 12:26:12.396589  3747 leader_election.cc:343] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.396625  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:12.397503  3783 raft_consensus.cc:2393] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 2: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:12.398479  4222 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.401852  3821 leader_election.cc:304] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:12.403409  4491 raft_consensus.cc:2804] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.403802  4491 raft_consensus.cc:493] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.404186  4491 raft_consensus.cc:3060] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.404677  4451 raft_consensus.cc:2468] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 2.
I20260709 12:26:12.406358  3675 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.407111  4380 raft_consensus.cc:2749] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.409248  4382 raft_consensus.cc:493] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.409850  4382 raft_consensus.cc:515] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.412484  4382 leader_election.cc:290] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.412868  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:12.413466  3782 raft_consensus.cc:2468] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:12.413971  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.414676  3823 leader_election.cc:304] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:12.417249  4382 raft_consensus.cc:2804] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:12.417378  3821 leader_election.cc:343] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.417663  4382 raft_consensus.cc:493] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.418077  4382 raft_consensus.cc:3060] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.421607  3530 ts_manager.cc:194] Re-registered known tserver with Master: a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.420979  3821 leader_election.cc:304] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:12.424748  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:12.425459  3705 raft_consensus.cc:2393] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 2: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:12.425493  4294 raft_consensus.cc:2804] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.426246  4294 raft_consensus.cc:697] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:12.427114  4294 consensus_queue.cc:237] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.430977  4382 raft_consensus.cc:515] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.437211  4222 raft_consensus.cc:493] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.437713  4222 raft_consensus.cc:515] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.438289  3749 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.439536  4222 leader_election.cc:290] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.439612  4407 raft_consensus.cc:2749] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.440362  4382 leader_election.cc:290] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.441009  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:12.441349  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ff0fe6aa744a2ba04e3a9fe25f8a72" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.442090  4451 raft_consensus.cc:2393] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 2: Already voted for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in this term.
I20260709 12:26:12.443809  3749 leader_election.cc:304] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.444826  4407 raft_consensus.cc:493] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.445176  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.445343  4407 raft_consensus.cc:515] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
W20260709 12:26:12.446640  3821 leader_election.cc:343] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.447435  4407 leader_election.cc:290] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.447950  4407 raft_consensus.cc:3060] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.448077  4406 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.448695  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.449178  4406 tablet_bootstrap.cc:492] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.449467  4451 raft_consensus.cc:2468] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:12.449909  4406 ts_tablet_manager.cc:1403] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.058s	user 0.031s	sys 0.007s
I20260709 12:26:12.450711  3747 leader_election.cc:304] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:12.451574  4356 raft_consensus.cc:2804] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.451920  4356 raft_consensus.cc:493] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.452258  4356 raft_consensus.cc:3060] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.443562  4491 raft_consensus.cc:515] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.454001  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8e3462410045018dfb0c45ce4ac3bf" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:12.454612  3783 raft_consensus.cc:3060] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.454934  4491 leader_election.cc:290] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.458241  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:12.459026  3858 raft_consensus.cc:2393] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 2: Already voted for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in this term.
I20260709 12:26:12.459393  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:12.459465  4406 raft_consensus.cc:359] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.460336  4406 raft_consensus.cc:740] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.461151  4406 consensus_queue.cc:260] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.463488  4406 ts_tablet_manager.cc:1434] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:12.464232  4406 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.469144  4356 raft_consensus.cc:515] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.471467  4407 raft_consensus.cc:2749] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.485532  3782 raft_consensus.cc:2393] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in current term 2: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:12.487466  3783 raft_consensus.cc:2468] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 2.
I20260709 12:26:12.489194  3823 leader_election.cc:304] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.490566  4491 raft_consensus.cc:2804] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.491043  4491 raft_consensus.cc:697] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:12.491482  4294 raft_consensus.cc:493] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.492014  4491 consensus_queue.cc:237] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.479125  3533 catalog_manager.cc:5697] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 2 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.483003  4222 raft_consensus.cc:493] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.492964  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:12.493306  4222 raft_consensus.cc:515] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.493817  3858 raft_consensus.cc:2393] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 2: Already voted for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in this term.
I20260709 12:26:12.495301  4222 leader_election.cc:290] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.496078  4356 leader_election.cc:290] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.496194  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:12.497176  3858 raft_consensus.cc:2468] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:12.497856  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.498484  4456 raft_consensus.cc:3060] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.500000  3749 leader_election.cc:304] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:12.501952  4356 raft_consensus.cc:2804] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.502390  4356 raft_consensus.cc:493] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.503173  4380 raft_consensus.cc:493] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.502902  4356 raft_consensus.cc:3060] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.504561  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.505959  3530 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42544
I20260709 12:26:12.503859  4380 raft_consensus.cc:515] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.492086  4294 raft_consensus.cc:515] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.512872  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:12.514302  3673 leader_election.cc:343] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.515275  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:12.515955  3707 raft_consensus.cc:2468] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:12.517172  4406 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.517485  3823 leader_election.cc:304] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:12.518277  4491 raft_consensus.cc:2804] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.518638  4406 tablet_bootstrap.cc:492] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.518803  4491 raft_consensus.cc:493] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.519374  4406 ts_tablet_manager.cc:1403] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.030s
I20260709 12:26:12.519395  4491 raft_consensus.cc:3060] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.518798  4294 leader_election.cc:290] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.479959  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c7676fe61bd4afb9d0d823e5ecde357" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.521481  4484 heartbeater.cc:499] Master 127.29.131.254:37927 was elected leader, sending a full tablet report...
I20260709 12:26:12.522332  4406 raft_consensus.cc:359] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.523012  4406 raft_consensus.cc:740] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.523933  4380 leader_election.cc:290] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:12.523744  4406 consensus_queue.cc:260] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
W20260709 12:26:12.524652  3747 leader_election.cc:343] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.519506  4381 raft_consensus.cc:493] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.525846  4406 ts_tablet_manager.cc:1434] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:12.526114  4381 raft_consensus.cc:515] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.526746  4406 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.518244  4356 raft_consensus.cc:515] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.528451  4381 leader_election.cc:290] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.529822  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:12.530418  3858 raft_consensus.cc:3060] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.535620  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.539387  3858 raft_consensus.cc:2468] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:12.541079  3749 leader_election.cc:304] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:12.542172  4407 raft_consensus.cc:2804] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.543708  4407 raft_consensus.cc:697] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:12.543835  4456 raft_consensus.cc:2468] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:12.545446  3821 leader_election.cc:304] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.545029  4407 consensus_queue.cc:237] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.549365  4408 raft_consensus.cc:2749] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.526648  4491 raft_consensus.cc:515] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
W20260709 12:26:12.550850  3821 leader_election.cc:343] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.551815  4491 leader_election.cc:290] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.552608  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:12.553195  3858 raft_consensus.cc:2468] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:12.545509  3747 leader_election.cc:304] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:12.546859  4356 leader_election.cc:290] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.554095  4356 raft_consensus.cc:2804] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.554561  4356 raft_consensus.cc:697] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:12.555424  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f4ad9284704c3891115e913b314323" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.555655  4356 consensus_queue.cc:237] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.547019  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:12.547173  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.553246  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.559201  4451 raft_consensus.cc:2468] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:12.564684  4406 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.565949  4406 tablet_bootstrap.cc:492] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.566751  4406 ts_tablet_manager.cc:1403] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.008s
I20260709 12:26:12.570482  4406 raft_consensus.cc:359] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.571391  4406 raft_consensus.cc:740] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.575644  4406 consensus_queue.cc:260] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.578269  4406 ts_tablet_manager.cc:1434] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:26:12.578694  4380 raft_consensus.cc:493] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.579871  4380 raft_consensus.cc:515] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.582551  4380 leader_election.cc:290] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
W20260709 12:26:12.587456  3747 leader_election.cc:343] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.588559  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba08d139f04994b6a33aeb45d32d89" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:12.589140  3707 raft_consensus.cc:3060] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:12.589850  3821 leader_election.cc:343] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.594022  4407 raft_consensus.cc:493] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.594552  4407 raft_consensus.cc:515] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.596684  3707 raft_consensus.cc:2468] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 2.
I20260709 12:26:12.596575  4407 leader_election.cc:290] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.598824  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.600062  4456 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:12.601110  3747 leader_election.cc:304] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:12.601859  4407 raft_consensus.cc:2804] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.602222  4407 raft_consensus.cc:493] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.605727  4407 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.606586  3823 leader_election.cc:304] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.608651  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.609360  4455 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 1.
I20260709 12:26:12.609848  4408 raft_consensus.cc:2804] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.610806  4408 raft_consensus.cc:697] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:12.611816  4408 consensus_queue.cc:237] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.612717  3673 leader_election.cc:304] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:12.613651  3673 leader_election.cc:304] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:12.614699  4381 raft_consensus.cc:2804] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.615116  4381 raft_consensus.cc:493] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.615612  4381 raft_consensus.cc:3060] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.617607  4222 raft_consensus.cc:493] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.618089  4222 raft_consensus.cc:515] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.619751  4414 raft_consensus.cc:2804] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.619951  4222 leader_election.cc:290] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.620249  4414 raft_consensus.cc:493] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.620711  4414 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.621531  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:12.623440  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:12.625109  3530 catalog_manager.cc:5697] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 2 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:12.622799  3747 leader_election.cc:343] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.631732  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" is_pre_election: true
I20260709 12:26:12.636022  4414 raft_consensus.cc:515] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.638259  4414 leader_election.cc:290] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:12.615265  4407 raft_consensus.cc:515] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.645331  3783 raft_consensus.cc:2393] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 051d745694ff46a5a8911cb9e20adf3f in current term 2: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:12.649459  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.650096  4451 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.651675  4222 raft_consensus.cc:493] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.652374  4222 raft_consensus.cc:515] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.654950  4222 leader_election.cc:290] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.656785  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:12.658630  3747 leader_election.cc:343] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.659821  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.579218  4406 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.670228  4408 raft_consensus.cc:493] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.646669  4381 raft_consensus.cc:515] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
W20260709 12:26:12.674151  3675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.196:38747, user_credentials={real_user=slave}} blocked reactor thread for 48842.1us
I20260709 12:26:12.674662  4408 raft_consensus.cc:515] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.679738  4408 leader_election.cc:290] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.680735  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:12.681624  3783 raft_consensus.cc:2468] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 1.
I20260709 12:26:12.682142  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
W20260709 12:26:12.683468  3821 leader_election.cc:343] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.687345  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:12.687924  4455 raft_consensus.cc:3060] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.690728  3823 leader_election.cc:304] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.692261  4491 raft_consensus.cc:2804] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.692644  4491 raft_consensus.cc:493] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.693003  4491 raft_consensus.cc:3060] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.694941  3749 leader_election.cc:304] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902; no voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.697890  4505 raft_consensus.cc:2749] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.675745  4407 leader_election.cc:290] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.696442  4381 leader_election.cc:290] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.701256  4491 raft_consensus.cc:515] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.701807  3675 leader_election.cc:304] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.702112  4451 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:12.702565  4419 raft_consensus.cc:2749] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.703389  3747 leader_election.cc:304] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:12.705250  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:12.706367  4494 raft_consensus.cc:2804] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.706868  4494 raft_consensus.cc:697] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:12.707607  3783 raft_consensus.cc:3060] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.707760  4494 consensus_queue.cc:237] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.711562  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:12.714834  4455 raft_consensus.cc:2468] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:12.715301  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c991e10e24485baedfe7c04d91c638" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:12.715835  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:12.715919  3858 raft_consensus.cc:3060] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.716027  3673 leader_election.cc:304] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:12.716591  3705 raft_consensus.cc:2393] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 2: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:12.717036  4419 raft_consensus.cc:2804] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.717492  4419 raft_consensus.cc:697] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:12.718973  4419 consensus_queue.cc:237] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.721789  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:12.722591  3703 raft_consensus.cc:2468] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 1.
I20260709 12:26:12.722851  3858 raft_consensus.cc:2468] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:12.726665  4491 leader_election.cc:290] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:12.726759  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:12.727820  3703 raft_consensus.cc:2393] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19f38997c19c4127b1162e94bf40b902 in current term 2: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:12.727033  3783 raft_consensus.cc:2468] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 2.
I20260709 12:26:12.728509  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e02443dd35484cd7bb5d7dccce65cc66" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
W20260709 12:26:12.730077  3821 leader_election.cc:343] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.730998  3823 leader_election.cc:304] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.733964  4294 raft_consensus.cc:2804] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.736316  4294 raft_consensus.cc:697] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:12.739362  3749 leader_election.cc:304] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.739586  4294 consensus_queue.cc:237] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.741289  4356 raft_consensus.cc:2804] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.741657  4356 raft_consensus.cc:493] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:12.742002  4356 raft_consensus.cc:3060] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.750504  4356 raft_consensus.cc:515] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.752133  3675 leader_election.cc:304] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.758911  4419 raft_consensus.cc:2749] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:12.764050  4356 leader_election.cc:290] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:12.766312  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:12.767012  3707 raft_consensus.cc:3060] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.766997  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82eee5011c1e428baf96889e563c5913" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
W20260709 12:26:12.768652  3747 leader_election.cc:343] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.772699  4406 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.773778  4406 tablet_bootstrap.cc:492] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.774019  3707 raft_consensus.cc:2468] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:12.774438  4406 ts_tablet_manager.cc:1403] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.195s	user 0.012s	sys 0.023s
I20260709 12:26:12.775868  3749 leader_election.cc:304] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: a423544d890d41e7870787a3a92aaf58
I20260709 12:26:12.777061  4356 raft_consensus.cc:2804] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.777565  4406 raft_consensus.cc:359] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.777748  4356 raft_consensus.cc:697] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:12.777830  3533 catalog_manager.cc:5697] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 2 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.778592  3532 catalog_manager.cc:5697] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 2 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.779181  4356 consensus_queue.cc:237] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.779757  4406 raft_consensus.cc:740] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.779646  3533 catalog_manager.cc:5697] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 2 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.780505  4406 consensus_queue.cc:260] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:12.782671  4406 ts_tablet_manager.cc:1434] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:12.783597  4406 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.791059  3530 catalog_manager.cc:5697] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 2 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.792824  3530 catalog_manager.cc:5697] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 2 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.794270  3530 catalog_manager.cc:5697] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 2 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.804586  4406 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.807158  4406 tablet_bootstrap.cc:492] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.807837  4406 ts_tablet_manager.cc:1403] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 12:26:12.811048  4406 raft_consensus.cc:359] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.811679  4406 raft_consensus.cc:740] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.812268  4406 consensus_queue.cc:260] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.814597  4406 ts_tablet_manager.cc:1434] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:12.815418  4406 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.822388  3533 catalog_manager.cc:5697] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 1 to 2, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 2 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.835107  4406 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.835950  4406 tablet_bootstrap.cc:492] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.836463  4406 ts_tablet_manager.cc:1403] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 12:26:12.838721  4406 raft_consensus.cc:359] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.839712  4406 raft_consensus.cc:740] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.840580  4406 consensus_queue.cc:260] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.847843  4406 ts_tablet_manager.cc:1434] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:12.848731  4406 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.865902  4406 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.866852  4406 tablet_bootstrap.cc:492] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.867925  4406 ts_tablet_manager.cc:1403] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:26:12.870093  4406 raft_consensus.cc:359] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.870736  4406 raft_consensus.cc:740] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.871904  4406 consensus_queue.cc:260] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.873901  4406 ts_tablet_manager.cc:1434] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:12.874677  4406 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.888114  4406 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.888839  4406 tablet_bootstrap.cc:492] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.889385  4406 ts_tablet_manager.cc:1403] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 12:26:12.890990  4406 raft_consensus.cc:359] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.891489  4406 raft_consensus.cc:740] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.892079  4406 consensus_queue.cc:260] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:12.893561  4406 ts_tablet_manager.cc:1434] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:12.894434  4406 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.916750  4406 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.917744  4406 tablet_bootstrap.cc:492] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:12.918443  4406 ts_tablet_manager.cc:1403] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:26:12.928539  4406 raft_consensus.cc:359] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.929246  4406 raft_consensus.cc:740] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.929925  4406 consensus_queue.cc:260] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:12.931857  4406 ts_tablet_manager.cc:1434] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:12.932718  4406 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:12.936843  3783 raft_consensus.cc:1275] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:12.938369  4491 consensus_queue.cc:1048] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.942169  4451 raft_consensus.cc:1275] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:12.945948  4356 consensus_queue.cc:1048] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.948391  4451 raft_consensus.cc:1275] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:12.957154  4491 consensus_queue.cc:1048] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.966572  3858 raft_consensus.cc:1275] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:12.972499  4494 consensus_queue.cc:1048] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:13.008478  3821 consensus_peers.cc:597] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.020452  4406 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.021466  4406 tablet_bootstrap.cc:492] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.022212  4406 ts_tablet_manager.cc:1403] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.090s	user 0.043s	sys 0.040s
I20260709 12:26:13.024811  4406 raft_consensus.cc:359] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.025553  4406 raft_consensus.cc:740] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.026238  4406 consensus_queue.cc:260] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.028122  4406 ts_tablet_manager.cc:1434] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:13.028857  4406 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
W20260709 12:26:13.030365  3747 consensus_peers.cc:597] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.049708  3707 raft_consensus.cc:1275] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.051595  4491 consensus_queue.cc:1048] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.052824  4406 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.053857  4406 tablet_bootstrap.cc:492] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.054463  4406 ts_tablet_manager.cc:1403] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.003s
I20260709 12:26:13.056897  4406 raft_consensus.cc:359] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.057579  4406 raft_consensus.cc:740] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.058430  4406 consensus_queue.cc:260] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.060833  4406 ts_tablet_manager.cc:1434] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.003s
I20260709 12:26:13.064443  3783 raft_consensus.cc:1275] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.067752  4406 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.069665  4294 consensus_queue.cc:1048] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.116766  4406 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.117734  4406 tablet_bootstrap.cc:492] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.118384  4406 ts_tablet_manager.cc:1403] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.011s
I20260709 12:26:13.121049  4406 raft_consensus.cc:359] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.121757  4406 raft_consensus.cc:740] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.122442  4406 consensus_queue.cc:260] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.124466  4406 ts_tablet_manager.cc:1434] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:26:13.124830  3821 consensus_peers.cc:597] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.126049  4453 raft_consensus.cc:1275] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.127457  3854 raft_consensus.cc:1275] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.128989  4406 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.129233  4494 consensus_queue.cc:1048] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.143072  4414 consensus_queue.cc:1048] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.156193  3782 raft_consensus.cc:1275] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.158306  4382 consensus_queue.cc:1048] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.180624  3858 raft_consensus.cc:1275] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.189247  4414 consensus_queue.cc:1048] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:13.196386  3821 consensus_peers.cc:597] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.200119  4453 raft_consensus.cc:1275] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.202018  4505 consensus_queue.cc:1048] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.215358  4406 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.216557  4406 tablet_bootstrap.cc:492] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.217518  4406 ts_tablet_manager.cc:1403] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.008s
I20260709 12:26:13.220466  4406 raft_consensus.cc:359] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.221587  4406 raft_consensus.cc:740] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.225721  3707 raft_consensus.cc:1275] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.226004  3703 raft_consensus.cc:1275] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.230594  4406 consensus_queue.cc:260] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.237953  4505 consensus_queue.cc:1048] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.238586  4494 consensus_queue.cc:1048] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.242599  4406 ts_tablet_manager.cc:1434] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:26:13.276602  4406 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
W20260709 12:26:13.299451  3747 consensus_peers.cc:597] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.323334  4406 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.324322  4406 tablet_bootstrap.cc:492] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.325223  4406 ts_tablet_manager.cc:1403] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.013s
I20260709 12:26:13.327697  4406 raft_consensus.cc:359] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.328233  4406 raft_consensus.cc:740] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.329005  4406 consensus_queue.cc:260] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.335742  4406 ts_tablet_manager.cc:1434] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:13.336601  4406 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.369590  4406 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.370333  4406 tablet_bootstrap.cc:492] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.370833  4406 ts_tablet_manager.cc:1403] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 12:26:13.372881  4406 raft_consensus.cc:359] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.373392  4406 raft_consensus.cc:740] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.374050  4406 consensus_queue.cc:260] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.376171  4406 ts_tablet_manager.cc:1434] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 12:26:13.377493  4406 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.391592  4406 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.392445  4406 tablet_bootstrap.cc:492] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.393172  4406 ts_tablet_manager.cc:1403] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:26:13.395084  4406 raft_consensus.cc:359] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.395715  4406 raft_consensus.cc:740] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.396205  4406 consensus_queue.cc:260] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.397792  4406 ts_tablet_manager.cc:1434] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:13.398792  4406 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.410194  4453 raft_consensus.cc:3060] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.418226  4406 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.419445  4406 tablet_bootstrap.cc:492] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.420320  4406 ts_tablet_manager.cc:1403] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 12:26:13.423393  4406 raft_consensus.cc:359] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.424212  4406 raft_consensus.cc:740] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.425221  4406 consensus_queue.cc:260] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
W20260709 12:26:13.426739  3821 consensus_peers.cc:597] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:13.427491  4406 ts_tablet_manager.cc:1434] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:13.428422  4406 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.448238  4406 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=1 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.449420  4406 tablet_bootstrap.cc:492] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.450173  4406 ts_tablet_manager.cc:1403] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:26:13.452389  4406 raft_consensus.cc:359] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.453061  4406 raft_consensus.cc:740] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.453925  4406 consensus_queue.cc:260] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.456079  4406 ts_tablet_manager.cc:1434] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:13.457346  4406 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.478209  4406 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.478972  4406 tablet_bootstrap.cc:492] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.479547  4406 ts_tablet_manager.cc:1403] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:26:13.481281  4406 raft_consensus.cc:359] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.481793  4406 raft_consensus.cc:740] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.482394  4406 consensus_queue.cc:260] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.484902  4406 ts_tablet_manager.cc:1434] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:26:13.487166  4406 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.507324  4406 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.508391  4406 tablet_bootstrap.cc:492] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.509141  4406 ts_tablet_manager.cc:1403] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:26:13.511979  4406 raft_consensus.cc:359] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.512574  4406 raft_consensus.cc:740] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.513392  4406 consensus_queue.cc:260] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.515545  4406 ts_tablet_manager.cc:1434] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:13.516446  4406 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.532406  4406 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.533345  4406 tablet_bootstrap.cc:492] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.533933  4406 ts_tablet_manager.cc:1403] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 12:26:13.536304  4406 raft_consensus.cc:359] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.536993  4406 raft_consensus.cc:740] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.537598  4406 consensus_queue.cc:260] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.539557  4406 ts_tablet_manager.cc:1434] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:26:13.540378  4406 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.553673  4406 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.554425  4406 tablet_bootstrap.cc:492] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.554903  4406 ts_tablet_manager.cc:1403] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:26:13.556622  4406 raft_consensus.cc:359] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.557118  4406 raft_consensus.cc:740] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.557663  4406 consensus_queue.cc:260] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.562723  4406 ts_tablet_manager.cc:1434] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:26:13.564029  4406 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.578651  4406 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.579679  4406 tablet_bootstrap.cc:492] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.580348  4406 ts_tablet_manager.cc:1403] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 12:26:13.582825  4406 raft_consensus.cc:359] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.583564  4406 raft_consensus.cc:740] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.584340  4406 consensus_queue.cc:260] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.586623  4406 ts_tablet_manager.cc:1434] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:26:13.588176  4406 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.595271  4451 raft_consensus.cc:3060] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.623435  4406 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.627925  4406 tablet_bootstrap.cc:492] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.628782  4406 ts_tablet_manager.cc:1403] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.009s
I20260709 12:26:13.631618  4406 raft_consensus.cc:359] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.632820  4406 raft_consensus.cc:740] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.633764  4406 consensus_queue.cc:260] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.640492  4406 ts_tablet_manager.cc:1434] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:26:13.641644  4406 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
W20260709 12:26:13.651984  3821 consensus_peers.cc:597] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:13.656080  4406 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.656934  4406 tablet_bootstrap.cc:492] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.657603  4406 ts_tablet_manager.cc:1403] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 12:26:13.660147  4406 raft_consensus.cc:359] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.660880  4406 raft_consensus.cc:740] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.661545  4406 consensus_queue.cc:260] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.663551  4406 ts_tablet_manager.cc:1434] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:26:13.665019  4406 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.682178  4406 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.683205  4406 tablet_bootstrap.cc:492] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.683874  4406 ts_tablet_manager.cc:1403] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:26:13.685794  4406 raft_consensus.cc:359] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.686280  4406 raft_consensus.cc:740] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.686764  4406 consensus_queue.cc:260] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.688512  4406 ts_tablet_manager.cc:1434] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:13.689636  4406 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.704084  4406 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.704885  4406 tablet_bootstrap.cc:492] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.705438  4406 ts_tablet_manager.cc:1403] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
W20260709 12:26:13.707729  3673 consensus_peers.cc:597] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:13.707875  4406 raft_consensus.cc:359] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.708539  4406 raft_consensus.cc:740] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.709184  4406 consensus_queue.cc:260] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.711331  4406 ts_tablet_manager.cc:1434] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:13.712740  4406 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.727423  4406 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.728153  4406 tablet_bootstrap.cc:492] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.728744  4406 ts_tablet_manager.cc:1403] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:26:13.730423  4406 raft_consensus.cc:359] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.730919  4406 raft_consensus.cc:740] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.731474  4406 consensus_queue.cc:260] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.733268  4406 ts_tablet_manager.cc:1434] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:13.734273  4406 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.754554  4453 raft_consensus.cc:3060] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.769608  4406 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.770696  4406 tablet_bootstrap.cc:492] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.771431  4406 ts_tablet_manager.cc:1403] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.021s
I20260709 12:26:13.774183  4406 raft_consensus.cc:359] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.774856  4406 raft_consensus.cc:740] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.775739  4406 consensus_queue.cc:260] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.777757  4406 ts_tablet_manager.cc:1434] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:26:13.778558  4406 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.803223  4406 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.803906  4406 tablet_bootstrap.cc:492] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.804527  4406 ts_tablet_manager.cc:1403] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 12:26:13.806442  4406 raft_consensus.cc:359] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.806893  4406 raft_consensus.cc:740] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.807391  4406 consensus_queue.cc:260] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.809264  4406 ts_tablet_manager.cc:1434] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:26:13.810704  4406 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.825502  4406 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.826333  4406 tablet_bootstrap.cc:492] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.827003  4406 ts_tablet_manager.cc:1403] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 12:26:13.829362  4406 raft_consensus.cc:359] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.830029  4406 raft_consensus.cc:740] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.830691  4406 consensus_queue.cc:260] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:13.832731  4406 ts_tablet_manager.cc:1434] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:13.833511  4406 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.846427  4406 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.847443  4406 tablet_bootstrap.cc:492] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.847999  4406 ts_tablet_manager.cc:1403] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:26:13.849793  4406 raft_consensus.cc:359] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.850274  4406 raft_consensus.cc:740] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.850836  4406 consensus_queue.cc:260] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.852317  4406 ts_tablet_manager.cc:1434] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:13.853293  4406 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.866679  4406 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.867702  4406 tablet_bootstrap.cc:492] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.868299  4406 ts_tablet_manager.cc:1403] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:26:13.870448  4406 raft_consensus.cc:359] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.870951  4406 raft_consensus.cc:740] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.871620  4406 consensus_queue.cc:260] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.873152  4406 ts_tablet_manager.cc:1434] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:13.874114  4406 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Bootstrap starting.
I20260709 12:26:13.891125  4406 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.892084  4406 tablet_bootstrap.cc:492] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Bootstrap complete.
I20260709 12:26:13.892702  4406 ts_tablet_manager.cc:1403] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:26:13.895087  4406 raft_consensus.cc:359] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.895841  4406 raft_consensus.cc:740] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.897073  4406 consensus_queue.cc:260] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:13.899048  4406 ts_tablet_manager.cc:1434] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:13.936947  4453 raft_consensus.cc:3060] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.986901  4410 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.987445  4410 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:13.990197  4410 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:14.007426  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:14.008361  3703 raft_consensus.cc:2393] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a423544d890d41e7870787a3a92aaf58 in current term 2: Already voted for candidate 051d745694ff46a5a8911cb9e20adf3f in this term.
I20260709 12:26:14.010589  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19f38997c19c4127b1162e94bf40b902" is_pre_election: true
I20260709 12:26:14.011346  3782 raft_consensus.cc:2393] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a423544d890d41e7870787a3a92aaf58 in current term 2: Already voted for candidate 19f38997c19c4127b1162e94bf40b902 in this term.
I20260709 12:26:14.012454  4402 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a423544d890d41e7870787a3a92aaf58; no voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:14.013273  4410 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.040927  4410 raft_consensus.cc:2749] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:14.064183  4451 raft_consensus.cc:3060] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.437495  4356 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.438006  4356 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:14.439540  4356 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:14.440256  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58" is_pre_election: true
I20260709 12:26:14.440414  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f" is_pre_election: true
I20260709 12:26:14.440979  4451 raft_consensus.cc:2468] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:14.441098  3703 raft_consensus.cc:2468] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:14.442116  3747 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:14.442741  4356 raft_consensus.cc:2804] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:14.443092  4356 raft_consensus.cc:493] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.443389  4356 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.447921  4356 raft_consensus.cc:515] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:14.449460  4356 leader_election.cc:290] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 3 election: Requested vote from peers a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:14.450150  4451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a423544d890d41e7870787a3a92aaf58"
I20260709 12:26:14.450353  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51088fec97844cc94645e93babc0f1a" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:14.450831  4451 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.450868  3705 raft_consensus.cc:3060] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.457772  3705 raft_consensus.cc:2468] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 3.
I20260709 12:26:14.459587  3749 leader_election.cc:304] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:14.460839  4356 raft_consensus.cc:2804] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:14.461555  4356 raft_consensus.cc:697] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 3 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:14.462230  4451 raft_consensus.cc:2468] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 3.
I20260709 12:26:14.462235  4356 consensus_queue.cc:237] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:14.472476  3529 catalog_manager.cc:5697] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 1 to 3, leader changed from a423544d890d41e7870787a3a92aaf58 (127.29.131.193) to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 3 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.947674  3703 raft_consensus.cc:1275] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:14.948912  4407 consensus_queue.cc:1048] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:14.959578  4451 raft_consensus.cc:1275] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:14.961788  4356 consensus_queue.cc:1048] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:22.289963 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.344322  3782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b"
dest_uuid: "19f38997c19c4127b1162e94bf40b902"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:32906
I20260709 12:26:22.345273  3782 raft_consensus.cc:606] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:22.358424  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
mode: GRACEFUL
new_leader_uuid: "051d745694ff46a5a8911cb9e20adf3f"
 from {username='slave'} at 127.0.0.1:56056
I20260709 12:26:22.359032  3854 raft_consensus.cc:606] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Received request to transfer leadership to TS 051d745694ff46a5a8911cb9e20adf3f
I20260709 12:26:22.372740  3703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760"
dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:26:22.373258  3703 raft_consensus.cc:606] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:22.375574  3703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82d2959359ba431d92762be286820259"
dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:26:22.376042  3703 raft_consensus.cc:606] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:22.378360  3782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97a9c64911b442eda89bd4c07b1e6d86"
dest_uuid: "19f38997c19c4127b1162e94bf40b902"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:32906
I20260709 12:26:22.378800  3782 raft_consensus.cc:606] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:22.380975  3782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2"
dest_uuid: "19f38997c19c4127b1162e94bf40b902"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:32906
I20260709 12:26:22.381431  3782 raft_consensus.cc:606] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:22.382529 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:22.384971 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:22.385965 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.442688  4596 raft_consensus.cc:993] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: : Instructing follower 051d745694ff46a5a8911cb9e20adf3f to start an election
I20260709 12:26:22.443373  4603 raft_consensus.cc:1081] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Signalling peer 051d745694ff46a5a8911cb9e20adf3f to start an election
I20260709 12:26:22.444686  3703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1"
dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
 from {username='slave'} at 127.0.0.1:43952
I20260709 12:26:22.445158  3703 raft_consensus.cc:493] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.445472  3703 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.452795  3703 raft_consensus.cc:515] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:22.455439  3703 leader_election.cc:290] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:22.456172  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:22.456951  3782 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.462760  3782 raft_consensus.cc:2468] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:22.464064  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:22.464533  3675 leader_election.cc:304] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:22.464692  3858 raft_consensus.cc:3055] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.465133  3858 raft_consensus.cc:740] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:22.465538  4599 raft_consensus.cc:2804] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.466951  4599 raft_consensus.cc:697] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:22.467979  4599 consensus_queue.cc:237] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:22.468403  3858 consensus_queue.cc:260] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:22.471987  3858 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.481583  3529 catalog_manager.cc:5697] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 1 to 2, leader changed from 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196) to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 2 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.485332  3858 raft_consensus.cc:2468] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:22.486089  4595 raft_consensus.cc:993] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.486585  4595 raft_consensus.cc:1081] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.488207  4451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50436
I20260709 12:26:22.488641  4451 raft_consensus.cc:493] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.488970  4451 raft_consensus.cc:3060] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.506415  4451 raft_consensus.cc:515] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.518368  4608 raft_consensus.cc:993] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.519068  4599 raft_consensus.cc:1081] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.521064  4453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82d2959359ba431d92762be286820259"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50432
I20260709 12:26:22.521579  4453 raft_consensus.cc:493] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.521952  4453 raft_consensus.cc:3060] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.531309  4595 raft_consensus.cc:993] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.531826  4595 raft_consensus.cc:1081] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.534801  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50436
I20260709 12:26:22.536461  4456 raft_consensus.cc:493] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.536912  4456 raft_consensus.cc:3060] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.534030  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:22.549142  3703 raft_consensus.cc:3060] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.554813  4453 raft_consensus.cc:515] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:22.557530  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:22.558089  3782 raft_consensus.cc:3060] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.561617  4451 leader_election.cc:290] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:22.561755  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ccc6a9ef1244c1a196f31efb3d727b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:22.562485  3783 raft_consensus.cc:3055] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.562790  3783 raft_consensus.cc:740] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:22.563634  3783 consensus_queue.cc:260] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.564900  3783 raft_consensus.cc:3060] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.565063  3782 raft_consensus.cc:2468] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:22.566637  4402 leader_election.cc:304] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:22.567458  4453 leader_election.cc:290] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:22.570539  4614 raft_consensus.cc:2804] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.572602  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2959359ba431d92762be286820259" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:22.573210  3705 raft_consensus.cc:3055] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.573489  3705 raft_consensus.cc:740] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:22.577965  3705 consensus_queue.cc:260] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:22.584039  3705 raft_consensus.cc:3060] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.586199  4456 raft_consensus.cc:515] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:22.588928  4456 leader_election.cc:290] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:22.591156  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:22.591814  3782 raft_consensus.cc:3055] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.592098  3782 raft_consensus.cc:740] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:22.592890  3782 consensus_queue.cc:260] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:22.593974  3782 raft_consensus.cc:3060] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.594014  3703 raft_consensus.cc:2468] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:22.596019  3783 raft_consensus.cc:2468] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:22.599033  4402 leader_election.cc:304] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:22.613567  4618 raft_consensus.cc:2804] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.614075  4618 raft_consensus.cc:697] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:22.614594  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10e736dd5544291bdec126ebb6bcea2" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:22.614995  4618 consensus_queue.cc:237] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.615588  3854 raft_consensus.cc:3060] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.626672  3854 raft_consensus.cc:2468] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:22.627525  3782 raft_consensus.cc:2468] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:22.629822  4402 leader_election.cc:304] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:22.631691  4618 raft_consensus.cc:2804] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.632316  4618 raft_consensus.cc:697] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:22.632334  3705 raft_consensus.cc:2468] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:22.634627  4618 consensus_queue.cc:237] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:22.645495  4602 raft_consensus.cc:993] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.646049  4602 raft_consensus.cc:1081] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.646284  4614 raft_consensus.cc:697] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:22.648121  4451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50432
I20260709 12:26:22.647781  4614 consensus_queue.cc:237] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:22.648736  4451 raft_consensus.cc:493] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.651135  4451 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.661059  4451 raft_consensus.cc:515] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.663343  4451 leader_election.cc:290] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 3 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:22.664271  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:22.664537  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e20fad02c8a4e359367d7da0a247760" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:22.664858  3783 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.665068  3705 raft_consensus.cc:3055] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:22.665370  3705 raft_consensus.cc:740] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:22.666229  3705 consensus_queue.cc:260] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.667500  3705 raft_consensus.cc:3060] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.670585  4594 raft_consensus.cc:993] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.671111  4594 raft_consensus.cc:1081] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:22.670966  3529 catalog_manager.cc:5697] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.672852  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97a9c64911b442eda89bd4c07b1e6d86"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50436
I20260709 12:26:22.673483  4456 raft_consensus.cc:493] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.673897  4456 raft_consensus.cc:3060] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.674571  3783 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 3.
I20260709 12:26:22.675690  4402 leader_election.cc:304] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:22.676961  4614 raft_consensus.cc:2804] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:22.677630  4614 raft_consensus.cc:697] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 3 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:22.678588  4614 consensus_queue.cc:237] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.681322  3705 raft_consensus.cc:2468] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 3.
I20260709 12:26:22.683784  4456 raft_consensus.cc:515] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.686167  4456 leader_election.cc:290] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:22.686786  3705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a9c64911b442eda89bd4c07b1e6d86" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:22.687067  3783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a9c64911b442eda89bd4c07b1e6d86" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:22.687404  3705 raft_consensus.cc:3060] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.687708  3783 raft_consensus.cc:3055] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.688063  3783 raft_consensus.cc:740] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:22.688827  3783 consensus_queue.cc:260] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.689944  3783 raft_consensus.cc:3060] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.691645  3529 catalog_manager.cc:5697] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 2 to 3, leader changed from 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.693711  3705 raft_consensus.cc:2468] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:22.693166  3529 catalog_manager.cc:5697] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 19f38997c19c4127b1162e94bf40b902 (127.29.131.195) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.694777  4402 leader_election.cc:304] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:22.695626  4614 raft_consensus.cc:2804] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.696272  3783 raft_consensus.cc:2468] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:22.695709  3529 catalog_manager.cc:5697] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 19f38997c19c4127b1162e94bf40b902 (127.29.131.195) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.696841  4614 raft_consensus.cc:697] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:22.697810  4614 consensus_queue.cc:237] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:22.712724  3529 catalog_manager.cc:5697] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 19f38997c19c4127b1162e94bf40b902 (127.29.131.195) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.005167  3854 raft_consensus.cc:1275] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.006352  4599 consensus_queue.cc:1048] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.030728  3782 raft_consensus.cc:1275] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.036173  4626 consensus_queue.cc:1048] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:23.092381  3705 raft_consensus.cc:1275] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:23.093552  4614 consensus_queue.cc:1048] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.110035  3782 raft_consensus.cc:1275] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:23.111490  3705 raft_consensus.cc:1275] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.112375  4618 consensus_queue.cc:1048] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:23.116320  4618 consensus_queue.cc:1048] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:23.123991  3782 raft_consensus.cc:1275] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.128150  4618 consensus_queue.cc:1048] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.142978  3784 raft_consensus.cc:1275] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.145152  4614 consensus_queue.cc:1048] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.166363  3705 raft_consensus.cc:1275] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.168229  4615 consensus_queue.cc:1048] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:23.170166  3703 raft_consensus.cc:1275] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.171976  4618 consensus_queue.cc:1048] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.183737  3784 raft_consensus.cc:1275] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.188405  4618 consensus_queue.cc:1048] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.208526  3858 raft_consensus.cc:1275] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.208923  3782 raft_consensus.cc:1275] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.213284  4614 consensus_queue.cc:1048] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.215549  4618 consensus_queue.cc:1048] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.431073 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.464881  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:56056
I20260709 12:26:23.465451  3854 raft_consensus.cc:606] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:23.468014  3784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54"
dest_uuid: "19f38997c19c4127b1162e94bf40b902"
mode: GRACEFUL
new_leader_uuid: "051d745694ff46a5a8911cb9e20adf3f"
 from {username='slave'} at 127.0.0.1:32906
I20260709 12:26:23.468448  3784 raft_consensus.cc:606] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Received request to transfer leadership to TS 051d745694ff46a5a8911cb9e20adf3f
I20260709 12:26:23.470780  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:56056
I20260709 12:26:23.471233  3854 raft_consensus.cc:606] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:23.473614  3784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0"
dest_uuid: "19f38997c19c4127b1162e94bf40b902"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:32906
I20260709 12:26:23.474033  3784 raft_consensus.cc:606] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:23.476275  3703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539"
dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:26:23.476776  3703 raft_consensus.cc:606] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:23.477882 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:23.479619 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:23.480343 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.500121  4594 raft_consensus.cc:993] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902: : Instructing follower 051d745694ff46a5a8911cb9e20adf3f to start an election
I20260709 12:26:23.500717  4595 raft_consensus.cc:1081] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Signalling peer 051d745694ff46a5a8911cb9e20adf3f to start an election
I20260709 12:26:23.502676  3707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54"
dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
 from {username='slave'} at 127.0.0.1:43930
I20260709 12:26:23.503208  3707 raft_consensus.cc:493] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.503551  3707 raft_consensus.cc:3060] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.514807  3707 raft_consensus.cc:515] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:23.517079  3707 leader_election.cc:290] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:23.520560  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:23.521173  3854 raft_consensus.cc:3060] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.524256  3784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609c12edc1ed4c239ab26204b6a14f54" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:23.524875  3784 raft_consensus.cc:3055] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.525125  3784 raft_consensus.cc:740] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:23.526049  3784 consensus_queue.cc:260] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:23.527375  3784 raft_consensus.cc:3060] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.527690  3854 raft_consensus.cc:2468] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:23.531385  3675 leader_election.cc:304] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:23.532131  4599 raft_consensus.cc:2804] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.532661  4599 raft_consensus.cc:697] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:23.533468  4599 consensus_queue.cc:237] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:23.533721  3784 raft_consensus.cc:2468] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:23.543426  4594 raft_consensus.cc:993] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:23.544027  4613 raft_consensus.cc:1081] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:23.544111  3533 catalog_manager.cc:5697] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 1 to 2, leader changed from 19f38997c19c4127b1162e94bf40b902 (127.29.131.195) to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 2 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.545629  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50436
I20260709 12:26:23.546181  4456 raft_consensus.cc:493] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.546525  4456 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.571506  4456 raft_consensus.cc:515] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:23.573446  4456 leader_election.cc:290] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 3 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:23.574329  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:23.574972  3782 raft_consensus.cc:3055] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.575315  3782 raft_consensus.cc:740] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:23.576165  3782 consensus_queue.cc:260] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:23.577474  3782 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.574329  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765c44a140f4bba917eb47eac69b8d0" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:23.579838  3707 raft_consensus.cc:3060] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.585287  3707 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 3.
I20260709 12:26:23.586179  4402 leader_election.cc:304] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:23.586906  4618 raft_consensus.cc:2804] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:23.587414  4618 raft_consensus.cc:697] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 3 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:23.587589  3782 raft_consensus.cc:2468] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 3.
I20260709 12:26:23.588436  4618 consensus_queue.cc:237] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:23.600900  3533 catalog_manager.cc:5697] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 2 to 3, leader changed from 19f38997c19c4127b1162e94bf40b902 (127.29.131.195) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.638440  4626 raft_consensus.cc:993] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:23.638967  4599 raft_consensus.cc:1081] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:23.640592  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50432
I20260709 12:26:23.641232  4456 raft_consensus.cc:493] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.641650  4456 raft_consensus.cc:3060] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.648753  4456 raft_consensus.cc:515] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:23.650813  4456 leader_election.cc:290] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:23.651641  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:23.652459  3703 raft_consensus.cc:3055] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.651641  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee89e0b191e547c2ac8538c9895b1539" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:23.652825  3703 raft_consensus.cc:740] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:23.653254  3782 raft_consensus.cc:3060] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.654078  3703 consensus_queue.cc:260] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:23.655350  3703 raft_consensus.cc:3060] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.660393  3782 raft_consensus.cc:2468] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:23.661927  3703 raft_consensus.cc:2468] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:23.662585  4402 leader_election.cc:304] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:23.663455  4615 raft_consensus.cc:2804] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.663909  4615 raft_consensus.cc:697] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:23.664803  4615 consensus_queue.cc:237] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:23.673286  3533 catalog_manager.cc:5697] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.682714  4635 raft_consensus.cc:993] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:23.683257  4603 raft_consensus.cc:1081] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:23.684883  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50422
I20260709 12:26:23.685477  4456 raft_consensus.cc:493] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.685854  4456 raft_consensus.cc:3060] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.692039  4456 raft_consensus.cc:515] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:23.694147  4456 leader_election.cc:290] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:23.695668  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:23.695606  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9268ae2fd54d36b9af1530c630e41a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:23.696378  3854 raft_consensus.cc:3055] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.696480  3782 raft_consensus.cc:3060] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.696756  3854 raft_consensus.cc:740] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:23.697515  3854 consensus_queue.cc:260] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:23.698751  3854 raft_consensus.cc:3060] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.703117  3782 raft_consensus.cc:2468] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:23.704386  4402 leader_election.cc:304] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:23.704852  3854 raft_consensus.cc:2468] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:23.705334  4640 raft_consensus.cc:2804] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.705863  4640 raft_consensus.cc:697] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:23.706750  4640 consensus_queue.cc:237] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:23.718869  3533 catalog_manager.cc:5697] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.935730  3854 raft_consensus.cc:1275] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.936913  4599 consensus_queue.cc:1048] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.947346  3782 raft_consensus.cc:1275] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.954173  4626 consensus_queue.cc:1048] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.015731  3703 raft_consensus.cc:1275] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:24.016918  4640 consensus_queue.cc:1048] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.026814  4635 raft_consensus.cc:993] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:24.027360  4603 raft_consensus.cc:1081] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:24.028988  4451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50422
I20260709 12:26:24.029477  4451 raft_consensus.cc:493] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.029808  4451 raft_consensus.cc:3060] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.036309  4451 raft_consensus.cc:515] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:24.038339  4451 leader_election.cc:290] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:24.039265  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:24.039485  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6adad7c22449a8dfb5592173972d1" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:24.039876  3858 raft_consensus.cc:3055] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.040160  3707 raft_consensus.cc:3060] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.040226  3858 raft_consensus.cc:740] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:24.041160  3858 consensus_queue.cc:260] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:24.042711  3858 raft_consensus.cc:3060] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.046250  3707 raft_consensus.cc:2468] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:24.049475  4402 leader_election.cc:304] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:24.051043  4640 raft_consensus.cc:2804] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.051797  4640 raft_consensus.cc:697] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:24.052605  4640 consensus_queue.cc:237] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:24.063683  3858 raft_consensus.cc:2468] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:24.068974  3782 raft_consensus.cc:1275] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:24.070432  4640 consensus_queue.cc:1048] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.071439  3530 catalog_manager.cc:5697] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.110792  3782 raft_consensus.cc:1275] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.113063  4615 consensus_queue.cc:1048] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.124960  3703 raft_consensus.cc:1275] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.127279  4659 consensus_queue.cc:1048] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.178180  3858 raft_consensus.cc:1275] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.179360  4615 consensus_queue.cc:1048] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.190522  3782 raft_consensus.cc:1275] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.194177  4615 consensus_queue.cc:1048] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.460942  3707 raft_consensus.cc:1275] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.462059  4615 consensus_queue.cc:1048] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.471083  3858 raft_consensus.cc:1275] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.472625  4615 consensus_queue.cc:1048] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.527686 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.569828  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:56056
I20260709 12:26:24.570377  3858 raft_consensus.cc:606] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:24.572876  3707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a"
dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:26:24.573379  3707 raft_consensus.cc:606] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:24.575767  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c4bf7a09d4943c2a597b74475baa619"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
mode: GRACEFUL
new_leader_uuid: "051d745694ff46a5a8911cb9e20adf3f"
 from {username='slave'} at 127.0.0.1:56056
I20260709 12:26:24.576239  3858 raft_consensus.cc:606] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Received request to transfer leadership to TS 051d745694ff46a5a8911cb9e20adf3f
I20260709 12:26:24.578406  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1bfda24e32c4fd597a2a4aad2ca9d23"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:56056
I20260709 12:26:24.578794  3858 raft_consensus.cc:606] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:24.581100  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
mode: GRACEFUL
new_leader_uuid: "19f38997c19c4127b1162e94bf40b902"
 from {username='slave'} at 127.0.0.1:56056
I20260709 12:26:24.581460  3858 raft_consensus.cc:606] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Received request to transfer leadership to TS 19f38997c19c4127b1162e94bf40b902
I20260709 12:26:24.582463 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:24.584059 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:24.584671 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.712145  4635 raft_consensus.cc:993] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a: : Instructing follower 19f38997c19c4127b1162e94bf40b902 to start an election
I20260709 12:26:24.712774  4603 raft_consensus.cc:1081] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Signalling peer 19f38997c19c4127b1162e94bf40b902 to start an election
I20260709 12:26:24.714336  3782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169"
dest_uuid: "19f38997c19c4127b1162e94bf40b902"
 from {username='slave'} at 127.0.0.1:51782
I20260709 12:26:24.714875  3782 raft_consensus.cc:493] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.715265  3782 raft_consensus.cc:3060] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.716948  4635 raft_consensus.cc:993] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:24.717484  4635 raft_consensus.cc:1081] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:24.718954  4451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50422
I20260709 12:26:24.719498  4451 raft_consensus.cc:493] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.719849  4451 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.721446  3782 raft_consensus.cc:515] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:24.724472  3782 leader_election.cc:290] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:24.725159  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:24.725824  3707 raft_consensus.cc:3060] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.725698  4451 raft_consensus.cc:515] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:24.727629  4451 leader_election.cc:290] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 3 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:24.727906  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda50c71ab424bb597fbc66cc9bb5169" candidate_uuid: "19f38997c19c4127b1162e94bf40b902" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:24.728482  3858 raft_consensus.cc:3055] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.728775  3858 raft_consensus.cc:740] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:24.729296  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:24.729588  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f073e484776458c93ec7bacbea4bf62" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:24.729835  3782 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.730221  3854 raft_consensus.cc:3055] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:24.730549  3854 raft_consensus.cc:740] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:24.729606  3858 consensus_queue.cc:260] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:24.731287  3854 consensus_queue.cc:260] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:24.732798  3858 raft_consensus.cc:3060] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.732811  3854 raft_consensus.cc:3060] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.734652  3707 raft_consensus.cc:2468] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:24.736987  3782 raft_consensus.cc:2468] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 3.
I20260709 12:26:24.735965  3749 leader_election.cc:304] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:24.738336  4613 raft_consensus.cc:2804] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.738808  4613 raft_consensus.cc:697] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Becoming Leader. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:24.739661  4613 consensus_queue.cc:237] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:24.740610  3854 raft_consensus.cc:2468] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 3.
I20260709 12:26:24.741222  3858 raft_consensus.cc:2468] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f38997c19c4127b1162e94bf40b902 in term 2.
I20260709 12:26:24.741973  4402 leader_election.cc:304] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:24.742868  4615 raft_consensus.cc:2804] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.743383  4615 raft_consensus.cc:697] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 3 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:24.744226  4615 consensus_queue.cc:237] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:24.757236  3533 catalog_manager.cc:5697] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 reported cstate change: term changed from 1 to 2, leader changed from 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196) to 19f38997c19c4127b1162e94bf40b902 (127.29.131.195). New cstate: current_term: 2 leader_uuid: "19f38997c19c4127b1162e94bf40b902" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.763751  3530 catalog_manager.cc:5697] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 2 to 3, leader changed from 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 3 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.904738  4635 raft_consensus.cc:993] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:24.905258  4603 raft_consensus.cc:1081] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:24.906821  4451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1bfda24e32c4fd597a2a4aad2ca9d23"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50422
I20260709 12:26:24.907413  4451 raft_consensus.cc:493] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.907755  4451 raft_consensus.cc:3060] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.913004  4451 raft_consensus.cc:515] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:24.914765  4451 leader_election.cc:290] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:24.915442  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bfda24e32c4fd597a2a4aad2ca9d23" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:24.915709  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bfda24e32c4fd597a2a4aad2ca9d23" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:24.916060  3858 raft_consensus.cc:3055] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.916299  3703 raft_consensus.cc:3060] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.916405  3858 raft_consensus.cc:740] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:24.917202  3858 consensus_queue.cc:260] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:24.918229  3858 raft_consensus.cc:3060] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.921097  3703 raft_consensus.cc:2468] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:24.922078  4402 leader_election.cc:304] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:24.922749  4615 raft_consensus.cc:2804] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.923265  4615 raft_consensus.cc:697] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:24.923334  3858 raft_consensus.cc:2468] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:24.924329  4615 consensus_queue.cc:237] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:24.933830  4599 raft_consensus.cc:993] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:24.933653  3530 catalog_manager.cc:5697] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.934338  4608 raft_consensus.cc:1081] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:24.936654  4451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50432
I20260709 12:26:24.937180  4451 raft_consensus.cc:493] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.937512  4451 raft_consensus.cc:3060] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.943790  4451 raft_consensus.cc:515] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:24.945600  4451 leader_election.cc:290] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:24.946081  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:24.946669  3703 raft_consensus.cc:3055] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.946986  3703 raft_consensus.cc:740] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:24.947124  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c5bf947f1b451a8b65819c4700b91a" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:24.947744  3782 raft_consensus.cc:3060] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.947710  3703 consensus_queue.cc:260] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:24.950058  3703 raft_consensus.cc:3060] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.953434  3782 raft_consensus.cc:2468] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:24.954515  4402 leader_election.cc:304] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:24.955178  4615 raft_consensus.cc:2804] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.955694  4615 raft_consensus.cc:697] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:24.956223  3703 raft_consensus.cc:2468] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:24.956553  4615 consensus_queue.cc:237] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } }
I20260709 12:26:24.965786  3530 catalog_manager.cc:5697] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:25.066754  4635 raft_consensus.cc:993] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a: : Instructing follower 051d745694ff46a5a8911cb9e20adf3f to start an election
I20260709 12:26:25.067219  4603 raft_consensus.cc:1081] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Signalling peer 051d745694ff46a5a8911cb9e20adf3f to start an election
I20260709 12:26:25.068524  3707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c4bf7a09d4943c2a597b74475baa619"
dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
 from {username='slave'} at 127.0.0.1:43952
I20260709 12:26:25.069105  3707 raft_consensus.cc:493] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.069471  3707 raft_consensus.cc:3060] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.074839  3707 raft_consensus.cc:515] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:25.076296  3707 leader_election.cc:290] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:25.077183  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4bf7a09d4943c2a597b74475baa619" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:25.077160  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4bf7a09d4943c2a597b74475baa619" candidate_uuid: "051d745694ff46a5a8911cb9e20adf3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:25.077953  3782 raft_consensus.cc:3060] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.077992  3858 raft_consensus.cc:3055] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.078449  3858 raft_consensus.cc:740] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:25.079265  3858 consensus_queue.cc:260] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:25.080678  3858 raft_consensus.cc:3060] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.084703  3782 raft_consensus.cc:2468] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:25.085868  3675 leader_election.cc:304] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051d745694ff46a5a8911cb9e20adf3f, 19f38997c19c4127b1162e94bf40b902; no voters: 
I20260709 12:26:25.086607  4599 raft_consensus.cc:2804] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:25.087033  4599 raft_consensus.cc:697] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Becoming Leader. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:25.087832  4599 consensus_queue.cc:237] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:25.089075  3858 raft_consensus.cc:2468] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051d745694ff46a5a8911cb9e20adf3f in term 2.
I20260709 12:26:25.099603  3530 catalog_manager.cc:5697] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f reported cstate change: term changed from 1 to 2, leader changed from 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196) to 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194). New cstate: current_term: 2 leader_uuid: "051d745694ff46a5a8911cb9e20adf3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:25.151142  3858 raft_consensus.cc:1275] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.152467  4594 consensus_queue.cc:1048] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.181869  3707 raft_consensus.cc:1275] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer 19f38997c19c4127b1162e94bf40b902: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.188701  4613 consensus_queue.cc:1048] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.205878  3782 raft_consensus.cc:1275] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:25.207310  4615 consensus_queue.cc:1048] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.236620  3854 raft_consensus.cc:1275] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:25.238161  4659 consensus_queue.cc:1048] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.336705  3782 raft_consensus.cc:1275] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.337911  4659 consensus_queue.cc:1048] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.340458  3707 raft_consensus.cc:1275] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.341842  4659 consensus_queue.cc:1048] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.352613  3703 raft_consensus.cc:1275] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.357884  4618 consensus_queue.cc:1048] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.370088  3858 raft_consensus.cc:1275] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.372517  4615 consensus_queue.cc:1048] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.524817  3858 raft_consensus.cc:1275] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.526027  4608 consensus_queue.cc:1048] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.539444  3782 raft_consensus.cc:1275] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer 051d745694ff46a5a8911cb9e20adf3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.543439  4599 consensus_queue.cc:1048] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.630246 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.670171  3703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1"
dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
mode: GRACEFUL
new_leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:26:25.670814  3703 raft_consensus.cc:606] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Received request to transfer leadership to TS 31fabaa79ceb4ad8b7dfdeaf624f067a
I20260709 12:26:25.673138  3782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b"
dest_uuid: "19f38997c19c4127b1162e94bf40b902"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:32906
I20260709 12:26:25.673600  3782 raft_consensus.cc:606] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:25.674688 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:25.676302 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:25.676964 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.867604  4613 raft_consensus.cc:993] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:25.868099  4594 raft_consensus.cc:1081] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:25.869421  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50436
I20260709 12:26:25.869858  4456 raft_consensus.cc:493] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.870123  4456 raft_consensus.cc:3060] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.874608  4456 raft_consensus.cc:515] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:25.876014  4456 leader_election.cc:290] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747)
I20260709 12:26:25.876607  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:25.876897  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a7b9b8ce0d41fb9a7871b4b85ec07b" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:25.877228  3782 raft_consensus.cc:3055] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.877542  3854 raft_consensus.cc:3060] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.877652  3782 raft_consensus.cc:740] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19f38997c19c4127b1162e94bf40b902, State: Running, Role: LEADER
I20260709 12:26:25.878544  3782 consensus_queue.cc:260] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:25.881021  3782 raft_consensus.cc:3060] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.883267  3854 raft_consensus.cc:2468] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:25.884377  4402 leader_election.cc:304] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:25.885131  4618 raft_consensus.cc:2804] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:25.887138  4618 raft_consensus.cc:697] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:25.887611  3782 raft_consensus.cc:2468] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:25.888090  4618 consensus_queue.cc:237] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:25.900863  3533 catalog_manager.cc:5697] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 19f38997c19c4127b1162e94bf40b902 (127.29.131.195) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.059430  4599 raft_consensus.cc:993] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f: : Instructing follower 31fabaa79ceb4ad8b7dfdeaf624f067a to start an election
I20260709 12:26:26.059938  4599 raft_consensus.cc:1081] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Signalling peer 31fabaa79ceb4ad8b7dfdeaf624f067a to start an election
I20260709 12:26:26.061332  3858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
 from {username='slave'} at 127.0.0.1:43542
I20260709 12:26:26.061847  3858 raft_consensus.cc:493] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.062170  3858 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.068751  3858 raft_consensus.cc:515] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:26.071168  3858 leader_election.cc:290] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 3 election: Requested vote from peers 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805), 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779)
I20260709 12:26:26.071982  3703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:26.072227  3782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad37609bcd442cc90fc2ca70381c4b1" candidate_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19f38997c19c4127b1162e94bf40b902"
I20260709 12:26:26.073156  3703 raft_consensus.cc:3055] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:26.073232  3782 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.075053  3703 raft_consensus.cc:740] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 051d745694ff46a5a8911cb9e20adf3f, State: Running, Role: LEADER
I20260709 12:26:26.076172  3703 consensus_queue.cc:260] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:26.079115  3703 raft_consensus.cc:3060] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.080719  3782 raft_consensus.cc:2468] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 3.
I20260709 12:26:26.081795  3823 leader_election.cc:304] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f38997c19c4127b1162e94bf40b902, 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 
I20260709 12:26:26.083904  4603 raft_consensus.cc:2804] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.084501  4603 raft_consensus.cc:697] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 LEADER]: Becoming Leader. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:26.085855  4603 consensus_queue.cc:237] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } }
I20260709 12:26:26.090904  3703 raft_consensus.cc:2468] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31fabaa79ceb4ad8b7dfdeaf624f067a in term 3.
I20260709 12:26:26.100939  3533 catalog_manager.cc:5697] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a reported cstate change: term changed from 2 to 3, leader changed from 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194) to 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196). New cstate: current_term: 3 leader_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.407044  3782 raft_consensus.cc:1275] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.408289  4618 consensus_queue.cc:1048] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.424723  3858 raft_consensus.cc:1275] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.426860  4659 consensus_queue.cc:1048] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.482115  3707 raft_consensus.cc:1275] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.483611  4697 consensus_queue.cc:1048] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.494203  3784 raft_consensus.cc:1275] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Refusing update from remote peer 31fabaa79ceb4ad8b7dfdeaf624f067a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.495676  4697 consensus_queue.cc:1048] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.719676 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.758379  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260"
dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
mode: GRACEFUL
new_leader_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:56056
I20260709 12:26:26.758955  3854 raft_consensus.cc:606] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Received request to transfer leadership to TS a423544d890d41e7870787a3a92aaf58
I20260709 12:26:26.760121 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:26.761442 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:26.761996 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.990185  4697 raft_consensus.cc:993] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a: : Instructing follower a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:26.990654  4635 raft_consensus.cc:1081] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Signalling peer a423544d890d41e7870787a3a92aaf58 to start an election
I20260709 12:26:26.992343  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260"
dest_uuid: "a423544d890d41e7870787a3a92aaf58"
 from {username='slave'} at 127.0.0.1:50422
I20260709 12:26:26.993023  4456 raft_consensus.cc:493] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.993356  4456 raft_consensus.cc:3060] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.000708  4456 raft_consensus.cc:515] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:27.002182  4456 leader_election.cc:290] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Requested vote from peers 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196:38747), 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805)
I20260709 12:26:27.003281  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a"
I20260709 12:26:27.003412  3707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c018ecf2b4878a97e2a3a13d2a260" candidate_uuid: "a423544d890d41e7870787a3a92aaf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "051d745694ff46a5a8911cb9e20adf3f"
I20260709 12:26:27.003932  3854 raft_consensus.cc:3055] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:27.004133  3707 raft_consensus.cc:3060] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.004333  3854 raft_consensus.cc:740] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31fabaa79ceb4ad8b7dfdeaf624f067a, State: Running, Role: LEADER
I20260709 12:26:27.005168  3854 consensus_queue.cc:260] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:27.006366  3854 raft_consensus.cc:3060] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.013515  3854 raft_consensus.cc:2468] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:27.015877  3707 raft_consensus.cc:2468] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a423544d890d41e7870787a3a92aaf58 in term 2.
I20260709 12:26:27.016883  4402 leader_election.cc:304] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a, a423544d890d41e7870787a3a92aaf58; no voters: 
I20260709 12:26:27.023324  4659 raft_consensus.cc:2804] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.026248  4659 raft_consensus.cc:697] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Becoming Leader. State: Replica: a423544d890d41e7870787a3a92aaf58, State: Running, Role: LEADER
I20260709 12:26:27.027092  4659 consensus_queue.cc:237] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } }
I20260709 12:26:27.037293  3529 catalog_manager.cc:5697] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 reported cstate change: term changed from 1 to 2, leader changed from 31fabaa79ceb4ad8b7dfdeaf624f067a (127.29.131.196) to a423544d890d41e7870787a3a92aaf58 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "a423544d890d41e7870787a3a92aaf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.482462  3854 raft_consensus.cc:1275] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:27.483888  4615 consensus_queue.cc:1048] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.494727  3707 raft_consensus.cc:1275] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Refusing update from remote peer a423544d890d41e7870787a3a92aaf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:27.500193  4659 consensus_queue.cc:1048] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051d745694ff46a5a8911cb9e20adf3f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.795708 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.833622 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:27.834609 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:27.835131 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.874570 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.910085 30223 tablet_server.cc:179] TabletServer@127.29.131.193:42391 shutting down...
W20260709 12:26:27.934686  3747 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 80 similar messages]
W20260709 12:26:27.939461  3747 consensus_peers.cc:597] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:27.941879 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:27.943194 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.944815 30223 raft_consensus.cc:2243] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.945472 30223 raft_consensus.cc:2272] T 2759a53f472748538672660088f60cf4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:27.948509  3821 consensus_peers.cc:597] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:27.949038 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.949846 30223 raft_consensus.cc:2243] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.950327 30223 raft_consensus.cc:2272] T 24ba08d139f04994b6a33aeb45d32d89 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.952661 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.953467 30223 raft_consensus.cc:2243] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:27.954421 30223 raft_consensus.cc:2272] T e10e736dd5544291bdec126ebb6bcea2 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.956525 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.957154 30223 raft_consensus.cc:2243] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:27.957949 30223 raft_consensus.cc:2272] T e30c018ecf2b4878a97e2a3a13d2a260 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.961390 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.962309 30223 raft_consensus.cc:2243] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:27.963080 30223 raft_consensus.cc:2272] T 2ba6adad7c22449a8dfb5592173972d1 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.965476 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.966244 30223 raft_consensus.cc:2243] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.966693 30223 raft_consensus.cc:2272] T cb6c9a2da48a44e29f55803f43d316b4 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.969300 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.970008 30223 raft_consensus.cc:2243] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.970441 30223 raft_consensus.cc:2272] T 1d58d259e3e44cdda99987f566b1716e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:27.971457  3747 consensus_peers.cc:597] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:27.973323 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.974298 30223 raft_consensus.cc:2243] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.974890 30223 raft_consensus.cc:2272] T 18de4c84f23a4190a5a0ac7d94128717 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.977372 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.978256 30223 raft_consensus.cc:2243] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:27.979097 30223 raft_consensus.cc:2272] T 9c9268ae2fd54d36b9af1530c630e41a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.981377 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.982051 30223 raft_consensus.cc:2243] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.982455 30223 raft_consensus.cc:2272] T 57c2564f8ed8426c86a221202e92fec9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.984477 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.985055 30223 raft_consensus.cc:2243] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.985466 30223 raft_consensus.cc:2272] T 82eee5011c1e428baf96889e563c5913 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.987790 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.988811 30223 raft_consensus.cc:2243] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.989305 30223 raft_consensus.cc:2272] T 34817477e5034d50bf4b2f435a675a97 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:27.990993  3673 consensus_peers.cc:597] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:27.991856 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.992539 30223 raft_consensus.cc:2243] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.992890 30223 raft_consensus.cc:2272] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.995115 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.995623 30223 raft_consensus.cc:2243] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:27.996309 30223 raft_consensus.cc:2272] T a1bfda24e32c4fd597a2a4aad2ca9d23 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:27.998397 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:27.999155 30223 raft_consensus.cc:2243] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:27.999676 30223 raft_consensus.cc:2272] T 34086c6e095d4c1db4b41a140eb4db42 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.001839 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.002357 30223 raft_consensus.cc:2243] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.002887 30223 raft_consensus.cc:2272] T 4f8e3462410045018dfb0c45ce4ac3bf P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.005542 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.006215 30223 raft_consensus.cc:2243] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.006758 30223 raft_consensus.cc:2272] T 6bff8ced4a7c47afba587ccdac4e1487 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.009342 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.009881 30223 raft_consensus.cc:2243] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.010217 30223 raft_consensus.cc:2272] T a1a72b5e7b494de79530011f65394787 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.012403 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.012897 30223 raft_consensus.cc:2243] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.013334 30223 raft_consensus.cc:2272] T 4afd7a503cf84f9c8d8418173f48aa05 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.015445 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.016043 30223 raft_consensus.cc:2243] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.016492 30223 raft_consensus.cc:2272] T 52472aa8d3c5489dadf9bea4ae265693 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.018836 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.019641 30223 raft_consensus.cc:2243] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.020623 30223 raft_consensus.cc:2272] T b765c44a140f4bba917eb47eac69b8d0 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.023449 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.024340 30223 raft_consensus.cc:2243] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:28.024426  3673 consensus_peers.cc:597] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.024955 30223 raft_consensus.cc:2272] T 8e8454c8322445ccac78d42179633d56 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.027865 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.028460 30223 raft_consensus.cc:2243] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.029297 30223 raft_consensus.cc:2272] T 34c5bf947f1b451a8b65819c4700b91a P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.031077  3673 consensus_peers.cc:597] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.031761 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.032377 30223 raft_consensus.cc:2243] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.032918 30223 raft_consensus.cc:2272] T e02443dd35484cd7bb5d7dccce65cc66 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.035205 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.035956 30223 raft_consensus.cc:2243] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.036748 30223 raft_consensus.cc:2272] T 14ccc6a9ef1244c1a196f31efb3d727b P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.038791 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.039337 30223 raft_consensus.cc:2243] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.040042 30223 raft_consensus.cc:2272] T 4e20fad02c8a4e359367d7da0a247760 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.041930 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.042441 30223 raft_consensus.cc:2243] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.043140 30223 raft_consensus.cc:2272] T 82d2959359ba431d92762be286820259 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.045030 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.045624 30223 raft_consensus.cc:2243] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.046069 30223 raft_consensus.cc:2272] T c4c991e10e24485baedfe7c04d91c638 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.048449 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.049139 30223 raft_consensus.cc:2243] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.049984 30223 raft_consensus.cc:2272] T 97a9c64911b442eda89bd4c07b1e6d86 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.052412 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.053146 30223 raft_consensus.cc:2243] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.053712 30223 raft_consensus.cc:2272] T a51088fec97844cc94645e93babc0f1a P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.055588 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.056102 30223 raft_consensus.cc:2243] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.056468 30223 raft_consensus.cc:2272] T f651c75d6a434e50a9e9e0e36543be65 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.058472 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.059154 30223 raft_consensus.cc:2243] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.060005 30223 raft_consensus.cc:2272] T ee89e0b191e547c2ac8538c9895b1539 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.062409 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.062944 30223 raft_consensus.cc:2243] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.063362 30223 raft_consensus.cc:2272] T 4c7981cc37ba4740aaf2fbba50d6f1cc P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.065551 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.066309 30223 raft_consensus.cc:2243] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.066834 30223 raft_consensus.cc:2272] T 18f2315d32f6457b80884480feef6a4b P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.069450 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.069967 30223 raft_consensus.cc:2243] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.070367 30223 raft_consensus.cc:2272] T ff2f247912a248ed8aee1a67922b1b22 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.072556 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.073130 30223 raft_consensus.cc:2243] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.074036 30223 raft_consensus.cc:2272] T 0f073e484776458c93ec7bacbea4bf62 P a423544d890d41e7870787a3a92aaf58 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.075038  3821 consensus_peers.cc:597] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.076392 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.076965 30223 raft_consensus.cc:2243] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.077335 30223 raft_consensus.cc:2272] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.079205 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.079843 30223 raft_consensus.cc:2243] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.080283 30223 raft_consensus.cc:2272] T b62f9c73102a4b07a57947eb81059e1e P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.082949 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.083710 30223 raft_consensus.cc:2243] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.084221 30223 raft_consensus.cc:2272] T 85b9d18e76b34cc9968c3e9925c80b96 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.086891 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.087636 30223 raft_consensus.cc:2243] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.088172 30223 raft_consensus.cc:2272] T 306d9965a9184c46bbcc8fb8b12d0887 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.089434  3821 consensus_peers.cc:597] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.090942 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.091575 30223 raft_consensus.cc:2243] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:28.091606  3747 consensus_peers.cc:597] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.092064 30223 raft_consensus.cc:2272] T 220f9aead41d420995c59bc0f03e4cc6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.094012 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.094550 30223 raft_consensus.cc:2243] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.095008 30223 raft_consensus.cc:2272] T 85f4ad9284704c3891115e913b314323 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.096969 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.097446 30223 raft_consensus.cc:2243] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.097868 30223 raft_consensus.cc:2272] T 6c7676fe61bd4afb9d0d823e5ecde357 P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.100474 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.101155 30223 raft_consensus.cc:2243] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.101632 30223 raft_consensus.cc:2272] T 5e083cdabbfa42638fed2591051bc9d6 P a423544d890d41e7870787a3a92aaf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.104118 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:28.104558 30223 raft_consensus.cc:2243] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.105264 30223 raft_consensus.cc:2272] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P a423544d890d41e7870787a3a92aaf58 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.110399  3821 consensus_peers.cc:597] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.121905  3821 consensus_peers.cc:597] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.124682  3747 consensus_peers.cc:597] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.132665  3747 consensus_peers.cc:597] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.134626  3673 consensus_peers.cc:597] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.164641  3821 consensus_peers.cc:597] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.183837 30223 tablet_server.cc:196] TabletServer@127.29.131.193:42391 shutdown complete.
W20260709 12:26:28.187701  3673 consensus_peers.cc:597] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.224020  3673 consensus_peers.cc:597] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.227347  3673 consensus_peers.cc:597] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.228193  3821 consensus_peers.cc:597] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.257849  3673 consensus_peers.cc:597] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.261914  3821 consensus_peers.cc:597] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.272133 30223 tablet_server.cc:179] TabletServer@127.29.131.194:0 shutting down...
W20260709 12:26:28.274562  3673 consensus_peers.cc:597] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.280081  3821 consensus_peers.cc:597] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.296576  3747 consensus_peers.cc:597] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.319334  3821 consensus_peers.cc:597] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.325963 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:28.327415 30223 tablet_replica.cc:333] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.328536 30223 raft_consensus.cc:2243] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.329641 30223 raft_consensus.cc:2272] T 6bff8ced4a7c47afba587ccdac4e1487 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.330343  3747 consensus_peers.cc:597] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.332158 30223 tablet_replica.cc:333] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.332888 30223 raft_consensus.cc:2243] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.333371 30223 raft_consensus.cc:2272] T 5e083cdabbfa42638fed2591051bc9d6 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.336470 30223 tablet_replica.cc:333] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.337257 30223 raft_consensus.cc:2243] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:28.338471  3749 consensus_peers.cc:597] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.337811 30223 raft_consensus.cc:2272] T 2759a53f472748538672660088f60cf4 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.341759 30223 tablet_replica.cc:333] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.342718 30223 raft_consensus.cc:2243] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.343218 30223 raft_consensus.cc:2272] T eda50c71ab424bb597fbc66cc9bb5169 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.346031 30223 tablet_replica.cc:333] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.346952 30223 raft_consensus.cc:2243] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.347563 30223 raft_consensus.cc:2272] T e0ff54594fa04818823d814a68d333dd P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.350387 30223 tablet_replica.cc:333] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.351284 30223 raft_consensus.cc:2243] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:28.351480  3823 consensus_peers.cc:597] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.352528 30223 raft_consensus.cc:2272] T f651c75d6a434e50a9e9e0e36543be65 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.355003 30223 tablet_replica.cc:333] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.355703 30223 raft_consensus.cc:2243] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.356158 30223 raft_consensus.cc:2272] T ee89e0b191e547c2ac8538c9895b1539 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.358554 30223 tablet_replica.cc:333] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.359404 30223 raft_consensus.cc:2243] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.359860 30223 raft_consensus.cc:2272] T 1d58d259e3e44cdda99987f566b1716e P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.361061  3749 consensus_peers.cc:597] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.362383 30223 tablet_replica.cc:333] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.363531 30223 raft_consensus.cc:2243] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.364337 30223 raft_consensus.cc:2272] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.366734 30223 tablet_replica.cc:333] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.367668 30223 raft_consensus.cc:2243] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.368204 30223 raft_consensus.cc:2272] T 220f9aead41d420995c59bc0f03e4cc6 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.370682 30223 tablet_replica.cc:333] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.371557 30223 raft_consensus.cc:2243] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.372171 30223 raft_consensus.cc:2272] T 2aa16bd4043348ff99dd99e5d01ffa01 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.372211  3821 consensus_peers.cc:597] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.374433 30223 tablet_replica.cc:333] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.375016 30223 raft_consensus.cc:2243] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.375444 30223 raft_consensus.cc:2272] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.378373 30223 tablet_replica.cc:333] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.379298 30223 raft_consensus.cc:2243] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.380345 30223 raft_consensus.cc:2272] T c72c02611ee24affaa7740ab42bc482b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.380618  3823 consensus_peers.cc:597] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.383708 30223 tablet_replica.cc:333] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.384860 30223 raft_consensus.cc:2243] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.385972 30223 raft_consensus.cc:2272] T 18f2315d32f6457b80884480feef6a4b P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.388947 30223 tablet_replica.cc:333] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.389777 30223 raft_consensus.cc:2243] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.390343 30223 raft_consensus.cc:2272] T 1a4342bbb0ea4e338952846096527efc P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.392338  3749 consensus_peers.cc:597] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.393009 30223 tablet_replica.cc:333] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.393836 30223 raft_consensus.cc:2243] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:28.393851  3747 consensus_peers.cc:597] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.394373 30223 raft_consensus.cc:2272] T 85b9d18e76b34cc9968c3e9925c80b96 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.396883 30223 tablet_replica.cc:333] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.397470 30223 raft_consensus.cc:2243] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.398234 30223 raft_consensus.cc:2272] T cb6c9a2da48a44e29f55803f43d316b4 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.400964 30223 tablet_replica.cc:333] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.401799 30223 raft_consensus.cc:2243] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.402361 30223 raft_consensus.cc:2272] T 52472aa8d3c5489dadf9bea4ae265693 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.405042 30223 tablet_replica.cc:333] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.405869 30223 raft_consensus.cc:2243] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:26:28.406569  3747 consensus_peers.cc:597] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.406680 30223 raft_consensus.cc:2272] T 609c12edc1ed4c239ab26204b6a14f54 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.409776 30223 tablet_replica.cc:333] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.410650 30223 raft_consensus.cc:2243] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.411700 30223 raft_consensus.cc:2272] T 5c4bf7a09d4943c2a597b74475baa619 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.411916  3749 consensus_peers.cc:597] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.414173 30223 tablet_replica.cc:333] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.414841 30223 raft_consensus.cc:2243] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.415479 30223 raft_consensus.cc:2272] T 4afd7a503cf84f9c8d8418173f48aa05 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.418174 30223 tablet_replica.cc:333] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.418835 30223 raft_consensus.cc:2243] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.419963 30223 raft_consensus.cc:2272] T fe6c38732d3b4d4a92be8805b1e20070 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.422626  3823 consensus_peers.cc:597] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.422646 30223 tablet_replica.cc:333] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.423491 30223 raft_consensus.cc:2243] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.424682 30223 raft_consensus.cc:2272] T c3e785fdbe084aef961fc9cf1821b023 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.427332 30223 tablet_replica.cc:333] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.427932 30223 raft_consensus.cc:2243] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.428342 30223 raft_consensus.cc:2272] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.428534  3747 consensus_peers.cc:597] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.430354 30223 tablet_replica.cc:333] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.431042 30223 raft_consensus.cc:2243] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.431517 30223 raft_consensus.cc:2272] T a51088fec97844cc94645e93babc0f1a P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.433475 30223 tablet_replica.cc:333] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.434060 30223 raft_consensus.cc:2243] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.434474 30223 raft_consensus.cc:2272] T 13785e12812d4092839867d05c4bdd56 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.436362 30223 tablet_replica.cc:333] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.436932 30223 raft_consensus.cc:2243] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.437342 30223 raft_consensus.cc:2272] T 97a9c64911b442eda89bd4c07b1e6d86 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.439309 30223 tablet_replica.cc:333] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.439898 30223 raft_consensus.cc:2243] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.440348 30223 raft_consensus.cc:2272] T b07cd2a3e0cb4de9a4e366ccadc47722 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.442396 30223 tablet_replica.cc:333] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.442939 30223 raft_consensus.cc:2243] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.443507 30223 raft_consensus.cc:2272] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.445963 30223 tablet_replica.cc:333] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.446745 30223 raft_consensus.cc:2243] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.447665 30223 raft_consensus.cc:2272] T 34086c6e095d4c1db4b41a140eb4db42 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.449621 30223 tablet_replica.cc:333] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.450157 30223 raft_consensus.cc:2243] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.450922 30223 raft_consensus.cc:2272] T 18de4c84f23a4190a5a0ac7d94128717 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.452907 30223 tablet_replica.cc:333] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.453454 30223 raft_consensus.cc:2243] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.453914 30223 raft_consensus.cc:2272] T e30c018ecf2b4878a97e2a3a13d2a260 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.456641 30223 tablet_replica.cc:333] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.457268 30223 raft_consensus.cc:2243] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.457692 30223 raft_consensus.cc:2272] T 82eee5011c1e428baf96889e563c5913 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.459827 30223 tablet_replica.cc:333] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.460345 30223 raft_consensus.cc:2243] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.460893 30223 raft_consensus.cc:2272] T 14ccc6a9ef1244c1a196f31efb3d727b P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.462790 30223 tablet_replica.cc:333] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.463358 30223 raft_consensus.cc:2243] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.463773 30223 raft_consensus.cc:2272] T 2ad37609bcd442cc90fc2ca70381c4b1 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.465754 30223 tablet_replica.cc:333] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.466272 30223 raft_consensus.cc:2243] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.466681 30223 raft_consensus.cc:2272] T 4e20fad02c8a4e359367d7da0a247760 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.468576 30223 tablet_replica.cc:333] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.469169 30223 raft_consensus.cc:2243] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.469666 30223 raft_consensus.cc:2272] T 24ba08d139f04994b6a33aeb45d32d89 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.472365 30223 tablet_replica.cc:333] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.472945 30223 raft_consensus.cc:2243] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.473884 30223 raft_consensus.cc:2272] T c4c991e10e24485baedfe7c04d91c638 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.474254  3747 consensus_peers.cc:597] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 -> Peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Couldn't send request to peer a423544d890d41e7870787a3a92aaf58. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.476135 30223 tablet_replica.cc:333] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.476747 30223 raft_consensus.cc:2243] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.477154 30223 raft_consensus.cc:2272] T 82d2959359ba431d92762be286820259 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.479089 30223 tablet_replica.cc:333] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.479807 30223 raft_consensus.cc:2243] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.480628 30223 raft_consensus.cc:2272] T db1ec401d95f483b988f72f1db907352 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.482838 30223 tablet_replica.cc:333] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.483434 30223 raft_consensus.cc:2243] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.484607 30223 raft_consensus.cc:2272] T 57c2564f8ed8426c86a221202e92fec9 P 051d745694ff46a5a8911cb9e20adf3f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.485870  3749 consensus_peers.cc:597] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.487394 30223 tablet_replica.cc:333] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
W20260709 12:26:28.487394  3749 consensus_peers.cc:597] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.488278 30223 raft_consensus.cc:2243] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.488689 30223 raft_consensus.cc:2272] T 2ba6adad7c22449a8dfb5592173972d1 P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.490521 30223 tablet_replica.cc:333] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.490958 30223 raft_consensus.cc:2243] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.491348 30223 raft_consensus.cc:2272] T b765c44a140f4bba917eb47eac69b8d0 P 051d745694ff46a5a8911cb9e20adf3f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.493440 30223 tablet_replica.cc:333] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f: stopping tablet replica
I20260709 12:26:28.494020 30223 raft_consensus.cc:2243] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.494452 30223 raft_consensus.cc:2272] T 34c5bf947f1b451a8b65819c4700b91a P 051d745694ff46a5a8911cb9e20adf3f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.495931  3749 consensus_peers.cc:597] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.542719  3749 consensus_peers.cc:597] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.570511 30223 tablet_server.cc:196] TabletServer@127.29.131.194:0 shutdown complete.
W20260709 12:26:28.574018  3823 consensus_peers.cc:597] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.629395  3823 consensus_peers.cc:597] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.633769  3823 consensus_peers.cc:597] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.634341  3823 consensus_peers.cc:597] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.634886  3823 consensus_peers.cc:597] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.637678  3749 consensus_peers.cc:597] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.667559 30223 tablet_server.cc:179] TabletServer@127.29.131.195:0 shutting down...
I20260709 12:26:28.705662 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:28.706601 30223 tablet_replica.cc:333] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.707659 30223 raft_consensus.cc:2243] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.708523 30223 raft_consensus.cc:2272] T 5e083cdabbfa42638fed2591051bc9d6 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.710659 30223 tablet_replica.cc:333] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.711333 30223 raft_consensus.cc:2243] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.711941 30223 raft_consensus.cc:2272] T b62f9c73102a4b07a57947eb81059e1e P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.714581 30223 tablet_replica.cc:333] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.715376 30223 raft_consensus.cc:2243] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.715904 30223 raft_consensus.cc:2272] T f651c75d6a434e50a9e9e0e36543be65 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.718369 30223 tablet_replica.cc:333] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.719002 30223 raft_consensus.cc:2243] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.719521 30223 raft_consensus.cc:2272] T ee89e0b191e547c2ac8538c9895b1539 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.721872 30223 tablet_replica.cc:333] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.722635 30223 raft_consensus.cc:2243] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.723500 30223 raft_consensus.cc:2272] T eda50c71ab424bb597fbc66cc9bb5169 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.725314  3823 consensus_peers.cc:597] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Couldn't send request to peer 19f38997c19c4127b1162e94bf40b902. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.725885 30223 tablet_replica.cc:333] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.726557 30223 raft_consensus.cc:2243] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.727391 30223 raft_consensus.cc:2272] T 6c7676fe61bd4afb9d0d823e5ecde357 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.728789  3823 consensus_peers.cc:597] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Couldn't send request to peer 19f38997c19c4127b1162e94bf40b902. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.729460 30223 tablet_replica.cc:333] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.730100 30223 raft_consensus.cc:2243] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.730854 30223 raft_consensus.cc:2272] T 85f4ad9284704c3891115e913b314323 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.732795 30223 tablet_replica.cc:333] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.733350 30223 raft_consensus.cc:2243] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.734081 30223 raft_consensus.cc:2272] T e0ff54594fa04818823d814a68d333dd P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.736035 30223 tablet_replica.cc:333] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.736590 30223 raft_consensus.cc:2243] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.737008 30223 raft_consensus.cc:2272] T 34817477e5034d50bf4b2f435a675a97 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.738807 30223 tablet_replica.cc:333] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.739411 30223 raft_consensus.cc:2243] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.739807 30223 raft_consensus.cc:2272] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.741600 30223 tablet_replica.cc:333] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.742131 30223 raft_consensus.cc:2243] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.742539 30223 raft_consensus.cc:2272] T c72c02611ee24affaa7740ab42bc482b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.744319 30223 tablet_replica.cc:333] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.744860 30223 raft_consensus.cc:2243] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.745288 30223 raft_consensus.cc:2272] T 18f2315d32f6457b80884480feef6a4b P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.747135 30223 tablet_replica.cc:333] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.747731 30223 raft_consensus.cc:2243] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.748502 30223 raft_consensus.cc:2272] T ff2f247912a248ed8aee1a67922b1b22 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.750577 30223 tablet_replica.cc:333] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.751392 30223 raft_consensus.cc:2243] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.752022 30223 raft_consensus.cc:2272] T 1a4342bbb0ea4e338952846096527efc P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.754495 30223 tablet_replica.cc:333] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.755020 30223 raft_consensus.cc:2243] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.755848 30223 raft_consensus.cc:2272] T 52472aa8d3c5489dadf9bea4ae265693 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.758512 30223 tablet_replica.cc:333] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.759138 30223 raft_consensus.cc:2243] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.759701 30223 raft_consensus.cc:2272] T 609c12edc1ed4c239ab26204b6a14f54 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.761699 30223 tablet_replica.cc:333] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.762183 30223 raft_consensus.cc:2243] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.762864 30223 raft_consensus.cc:2272] T 4afd7a503cf84f9c8d8418173f48aa05 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.764612 30223 tablet_replica.cc:333] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.765055 30223 raft_consensus.cc:2243] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.765419 30223 raft_consensus.cc:2272] T 5c4bf7a09d4943c2a597b74475baa619 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.767171 30223 tablet_replica.cc:333] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.767710 30223 raft_consensus.cc:2243] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.768059 30223 raft_consensus.cc:2272] T 18de4c84f23a4190a5a0ac7d94128717 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.769630 30223 tablet_replica.cc:333] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.770097 30223 raft_consensus.cc:2243] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.770434 30223 raft_consensus.cc:2272] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.772159 30223 tablet_replica.cc:333] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.772593 30223 raft_consensus.cc:2243] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.772919 30223 raft_consensus.cc:2272] T 0f073e484776458c93ec7bacbea4bf62 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.774452 30223 tablet_replica.cc:333] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.774904 30223 raft_consensus.cc:2243] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.775666 30223 raft_consensus.cc:2272] T a51088fec97844cc94645e93babc0f1a P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.777689 30223 tablet_replica.cc:333] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.778199 30223 raft_consensus.cc:2243] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.778609 30223 raft_consensus.cc:2272] T b07cd2a3e0cb4de9a4e366ccadc47722 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.780645 30223 tablet_replica.cc:333] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.781167 30223 raft_consensus.cc:2243] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.781908 30223 raft_consensus.cc:2272] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.783771 30223 tablet_replica.cc:333] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.784318 30223 raft_consensus.cc:2243] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.784722 30223 raft_consensus.cc:2272] T 4f8e3462410045018dfb0c45ce4ac3bf P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.786818 30223 tablet_replica.cc:333] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.787392 30223 raft_consensus.cc:2243] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.787807 30223 raft_consensus.cc:2272] T fe6c38732d3b4d4a92be8805b1e20070 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.789844 30223 tablet_replica.cc:333] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
W20260709 12:26:28.790313  3823 consensus_peers.cc:597] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.790580 30223 raft_consensus.cc:2243] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.791101 30223 raft_consensus.cc:2272] T c3e785fdbe084aef961fc9cf1821b023 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.793051 30223 tablet_replica.cc:333] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.793542 30223 raft_consensus.cc:2243] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.793908 30223 raft_consensus.cc:2272] T e10e736dd5544291bdec126ebb6bcea2 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.795672 30223 tablet_replica.cc:333] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.796129 30223 raft_consensus.cc:2243] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.796844 30223 raft_consensus.cc:2272] T 13785e12812d4092839867d05c4bdd56 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.798576 30223 tablet_replica.cc:333] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.799031 30223 raft_consensus.cc:2243] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.799467 30223 raft_consensus.cc:2272] T 97a9c64911b442eda89bd4c07b1e6d86 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.801285 30223 tablet_replica.cc:333] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.801994 30223 raft_consensus.cc:2243] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.802423 30223 raft_consensus.cc:2272] T 4e20fad02c8a4e359367d7da0a247760 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.804719 30223 tablet_replica.cc:333] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.805433 30223 raft_consensus.cc:2243] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.805907 30223 raft_consensus.cc:2272] T 2ad37609bcd442cc90fc2ca70381c4b1 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.808200 30223 tablet_replica.cc:333] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
W20260709 12:26:28.808161  3823 consensus_peers.cc:597] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 051d745694ff46a5a8911cb9e20adf3f (127.29.131.194:41805): Couldn't send request to peer 051d745694ff46a5a8911cb9e20adf3f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.809218 30223 raft_consensus.cc:2243] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.809790 30223 raft_consensus.cc:2272] T db1ec401d95f483b988f72f1db907352 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.812356 30223 tablet_replica.cc:333] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.813050 30223 raft_consensus.cc:2243] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.813920 30223 raft_consensus.cc:2272] T 82eee5011c1e428baf96889e563c5913 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.815864 30223 tablet_replica.cc:333] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.816401 30223 raft_consensus.cc:2243] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.816800 30223 raft_consensus.cc:2272] T e02443dd35484cd7bb5d7dccce65cc66 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.818890 30223 tablet_replica.cc:333] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.819478 30223 raft_consensus.cc:2243] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.819876 30223 raft_consensus.cc:2272] T 14ccc6a9ef1244c1a196f31efb3d727b P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.821969 30223 tablet_replica.cc:333] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.822504 30223 raft_consensus.cc:2243] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.822901 30223 raft_consensus.cc:2272] T b765c44a140f4bba917eb47eac69b8d0 P 19f38997c19c4127b1162e94bf40b902 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.824759 30223 tablet_replica.cc:333] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.825276 30223 raft_consensus.cc:2243] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.825687 30223 raft_consensus.cc:2272] T 34c5bf947f1b451a8b65819c4700b91a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.827641 30223 tablet_replica.cc:333] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.828142 30223 raft_consensus.cc:2243] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.828585 30223 raft_consensus.cc:2272] T 8e8454c8322445ccac78d42179633d56 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.830480 30223 tablet_replica.cc:333] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.830978 30223 raft_consensus.cc:2243] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.831806 30223 raft_consensus.cc:2272] T a1a72b5e7b494de79530011f65394787 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.833576 30223 tablet_replica.cc:333] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.834065 30223 raft_consensus.cc:2243] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.834470 30223 raft_consensus.cc:2272] T 9c9268ae2fd54d36b9af1530c630e41a P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.836215 30223 tablet_replica.cc:333] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.836704 30223 raft_consensus.cc:2243] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.837111 30223 raft_consensus.cc:2272] T 2aa16bd4043348ff99dd99e5d01ffa01 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.838877 30223 tablet_replica.cc:333] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.839407 30223 raft_consensus.cc:2243] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:28.840138 30223 raft_consensus.cc:2272] T 306d9965a9184c46bbcc8fb8b12d0887 P 19f38997c19c4127b1162e94bf40b902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.841912 30223 tablet_replica.cc:333] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902: stopping tablet replica
I20260709 12:26:28.842360 30223 raft_consensus.cc:2243] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.842815 30223 raft_consensus.cc:2272] T 82d2959359ba431d92762be286820259 P 19f38997c19c4127b1162e94bf40b902 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.847023  3823 consensus_peers.cc:597] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Couldn't send request to peer 19f38997c19c4127b1162e94bf40b902. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:28.868875  3823 consensus_peers.cc:597] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Couldn't send request to peer 19f38997c19c4127b1162e94bf40b902. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:28.916893 30223 tablet_server.cc:196] TabletServer@127.29.131.195:0 shutdown complete.
I20260709 12:26:28.985739  4732 raft_consensus.cc:493] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:28.986394  4732 raft_consensus.cc:515] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:28.988559  4732 leader_election.cc:290] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
W20260709 12:26:28.992645  3823 leader_election.cc:336] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Network error: Client connection negotiation failed: client connection to 127.29.131.195:36779: connect: Connection refused (error 111)
W20260709 12:26:28.993286  3821 leader_election.cc:336] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111)
I20260709 12:26:28.993618  3821 leader_election.cc:304] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:28.994251  4732 raft_consensus.cc:2749] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:28.994477 30223 tablet_server.cc:179] TabletServer@127.29.131.196:0 shutting down...
W20260709 12:26:29.026328  3823 consensus_peers.cc:597] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Couldn't send request to peer 19f38997c19c4127b1162e94bf40b902. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.195:36779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.034714 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:29.035629 30223 tablet_replica.cc:333] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.036252 30223 raft_consensus.cc:2243] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.036695 30223 raft_consensus.cc:2272] T eda50c71ab424bb597fbc66cc9bb5169 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.038579 30223 tablet_replica.cc:333] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.039201 30223 raft_consensus.cc:2243] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.039737 30223 raft_consensus.cc:2272] T e0ff54594fa04818823d814a68d333dd P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.042490 30223 tablet_replica.cc:333] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.043463 30223 raft_consensus.cc:2243] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.044006 30223 raft_consensus.cc:2272] T 6c7676fe61bd4afb9d0d823e5ecde357 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:29.044170  3823 consensus_peers.cc:597] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Couldn't send request to peer 19f38997c19c4127b1162e94bf40b902. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.195:36779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.046242 30223 tablet_replica.cc:333] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.046811 30223 raft_consensus.cc:2243] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.047200 30223 raft_consensus.cc:2272] T 85f4ad9284704c3891115e913b314323 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.049295 30223 tablet_replica.cc:333] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.049914 30223 raft_consensus.cc:2243] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.050803 30223 raft_consensus.cc:2272] T 2759a53f472748538672660088f60cf4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.052960 30223 tablet_replica.cc:333] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.053594 30223 raft_consensus.cc:2243] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.054533 30223 raft_consensus.cc:2272] T 1d58d259e3e44cdda99987f566b1716e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.054558  4697 raft_consensus.cc:493] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a423544d890d41e7870787a3a92aaf58)
I20260709 12:26:29.055174  4697 raft_consensus.cc:515] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f38997c19c4127b1162e94bf40b902" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 36779 } } peers { permanent_uuid: "31fabaa79ceb4ad8b7dfdeaf624f067a" member_type: VOTER last_known_addr { host: "127.29.131.196" port: 38747 } } peers { permanent_uuid: "a423544d890d41e7870787a3a92aaf58" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 42391 } }
I20260709 12:26:29.057528  4697 leader_election.cc:290] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779), a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391)
I20260709 12:26:29.057632 30223 tablet_replica.cc:333] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.058542 30223 raft_consensus.cc:2243] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.059091 30223 raft_consensus.cc:2272] T 4c7981cc37ba4740aaf2fbba50d6f1cc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:29.061371  3821 leader_election.cc:336] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a423544d890d41e7870787a3a92aaf58 (127.29.131.193:42391): Network error: Client connection negotiation failed: client connection to 127.29.131.193:42391: connect: Connection refused (error 111)
W20260709 12:26:29.062018  3823 leader_election.cc:336] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Network error: Client connection negotiation failed: client connection to 127.29.131.195:36779: connect: Connection refused (error 111)
I20260709 12:26:29.062103 30223 tablet_replica.cc:333] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.062382  3823 leader_election.cc:304] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31fabaa79ceb4ad8b7dfdeaf624f067a; no voters: 19f38997c19c4127b1162e94bf40b902, a423544d890d41e7870787a3a92aaf58
I20260709 12:26:29.062887 30223 raft_consensus.cc:2243] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.062968  4697 raft_consensus.cc:2749] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:29.063630 30223 raft_consensus.cc:2272] T c72c02611ee24affaa7740ab42bc482b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.065547 30223 tablet_replica.cc:333] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.066053 30223 raft_consensus.cc:2243] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.066421 30223 raft_consensus.cc:2272] T e2a7b9b8ce0d41fb9a7871b4b85ec07b P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.068377 30223 tablet_replica.cc:333] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.068925 30223 raft_consensus.cc:2243] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.069715 30223 raft_consensus.cc:2272] T 34817477e5034d50bf4b2f435a675a97 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.071497 30223 tablet_replica.cc:333] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.072026 30223 raft_consensus.cc:2243] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.072765 30223 raft_consensus.cc:2272] T 547fe2b2ec4f42d4b2386ea1c9a7d2b9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.074723 30223 tablet_replica.cc:333] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.075318 30223 raft_consensus.cc:2243] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.076071 30223 raft_consensus.cc:2272] T e02443dd35484cd7bb5d7dccce65cc66 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.077937 30223 tablet_replica.cc:333] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.078513 30223 raft_consensus.cc:2243] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.078917 30223 raft_consensus.cc:2272] T cb6c9a2da48a44e29f55803f43d316b4 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.080827 30223 tablet_replica.cc:333] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.081394 30223 raft_consensus.cc:2243] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.081810 30223 raft_consensus.cc:2272] T ff2f247912a248ed8aee1a67922b1b22 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.083731 30223 tablet_replica.cc:333] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.084281 30223 raft_consensus.cc:2243] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.085084 30223 raft_consensus.cc:2272] T 1a4342bbb0ea4e338952846096527efc P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.087121 30223 tablet_replica.cc:333] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.087698 30223 raft_consensus.cc:2243] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.088102 30223 raft_consensus.cc:2272] T b62f9c73102a4b07a57947eb81059e1e P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.089949 30223 tablet_replica.cc:333] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.090478 30223 raft_consensus.cc:2243] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.091259 30223 raft_consensus.cc:2272] T 85b9d18e76b34cc9968c3e9925c80b96 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.092975 30223 tablet_replica.cc:333] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.093438 30223 raft_consensus.cc:2243] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.093780 30223 raft_consensus.cc:2272] T 609c12edc1ed4c239ab26204b6a14f54 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.095777 30223 tablet_replica.cc:333] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.096298 30223 raft_consensus.cc:2243] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.096714 30223 raft_consensus.cc:2272] T 5c4bf7a09d4943c2a597b74475baa619 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.098618 30223 tablet_replica.cc:333] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.099197 30223 raft_consensus.cc:2243] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.099946 30223 raft_consensus.cc:2272] T b07cd2a3e0cb4de9a4e366ccadc47722 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.101828 30223 tablet_replica.cc:333] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.102339 30223 raft_consensus.cc:2243] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.102715 30223 raft_consensus.cc:2272] T 34086c6e095d4c1db4b41a140eb4db42 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.104581 30223 tablet_replica.cc:333] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.105096 30223 raft_consensus.cc:2243] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.105494 30223 raft_consensus.cc:2272] T 61b8f4bd05ad4d3bb5289e38f6ba5a61 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.107332 30223 tablet_replica.cc:333] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.107824 30223 raft_consensus.cc:2243] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.108516 30223 raft_consensus.cc:2272] T 4f8e3462410045018dfb0c45ce4ac3bf P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.110329 30223 tablet_replica.cc:333] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.110867 30223 raft_consensus.cc:2243] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.111304 30223 raft_consensus.cc:2272] T 0f073e484776458c93ec7bacbea4bf62 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.113035 30223 tablet_replica.cc:333] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.113545 30223 raft_consensus.cc:2243] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.114266 30223 raft_consensus.cc:2272] T 26ff0fe6aa744a2ba04e3a9fe25f8a72 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.116045 30223 tablet_replica.cc:333] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.116554 30223 raft_consensus.cc:2243] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.116981 30223 raft_consensus.cc:2272] T fe6c38732d3b4d4a92be8805b1e20070 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.118767 30223 tablet_replica.cc:333] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.119340 30223 raft_consensus.cc:2243] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.119747 30223 raft_consensus.cc:2272] T c3e785fdbe084aef961fc9cf1821b023 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.122273 30223 tablet_replica.cc:333] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.122998 30223 raft_consensus.cc:2243] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.123854 30223 raft_consensus.cc:2272] T 24ba08d139f04994b6a33aeb45d32d89 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.126381 30223 tablet_replica.cc:333] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.126925 30223 raft_consensus.cc:2243] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.127403 30223 raft_consensus.cc:2272] T c4c991e10e24485baedfe7c04d91c638 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.129424 30223 tablet_replica.cc:333] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.130041 30223 raft_consensus.cc:2243] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.130443 30223 raft_consensus.cc:2272] T a1bfda24e32c4fd597a2a4aad2ca9d23 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.132356 30223 tablet_replica.cc:333] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.132870 30223 raft_consensus.cc:2243] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:29.133181  3823 consensus_peers.cc:597] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a -> Peer 19f38997c19c4127b1162e94bf40b902 (127.29.131.195:36779): Couldn't send request to peer 19f38997c19c4127b1162e94bf40b902. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.195:36779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.133296 30223 raft_consensus.cc:2272] T 6bff8ced4a7c47afba587ccdac4e1487 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.135306 30223 tablet_replica.cc:333] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.135845 30223 raft_consensus.cc:2243] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.136253 30223 raft_consensus.cc:2272] T a1a72b5e7b494de79530011f65394787 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.138039 30223 tablet_replica.cc:333] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.138545 30223 raft_consensus.cc:2243] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.139329 30223 raft_consensus.cc:2272] T 8e8454c8322445ccac78d42179633d56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.141145 30223 tablet_replica.cc:333] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.141667 30223 raft_consensus.cc:2243] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.142391 30223 raft_consensus.cc:2272] T 2ad37609bcd442cc90fc2ca70381c4b1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.144291 30223 tablet_replica.cc:333] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.144784 30223 raft_consensus.cc:2243] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.145274 30223 raft_consensus.cc:2272] T db1ec401d95f483b988f72f1db907352 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.147763 30223 tablet_replica.cc:333] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.148434 30223 raft_consensus.cc:2243] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.148883 30223 raft_consensus.cc:2272] T 13785e12812d4092839867d05c4bdd56 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.150792 30223 tablet_replica.cc:333] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.151350 30223 raft_consensus.cc:2243] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.152066 30223 raft_consensus.cc:2272] T 220f9aead41d420995c59bc0f03e4cc6 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.153887 30223 tablet_replica.cc:333] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.154409 30223 raft_consensus.cc:2243] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.155108 30223 raft_consensus.cc:2272] T 2aa16bd4043348ff99dd99e5d01ffa01 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.156937 30223 tablet_replica.cc:333] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.157418 30223 raft_consensus.cc:2243] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.157814 30223 raft_consensus.cc:2272] T 306d9965a9184c46bbcc8fb8b12d0887 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.159593 30223 tablet_replica.cc:333] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.160063 30223 raft_consensus.cc:2243] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.160473 30223 raft_consensus.cc:2272] T 9c9268ae2fd54d36b9af1530c630e41a P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.162204 30223 tablet_replica.cc:333] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.162691 30223 raft_consensus.cc:2243] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.163094 30223 raft_consensus.cc:2272] T 57c2564f8ed8426c86a221202e92fec9 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.164947 30223 tablet_replica.cc:333] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.165418 30223 raft_consensus.cc:2243] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.165800 30223 raft_consensus.cc:2272] T 2ba6adad7c22449a8dfb5592173972d1 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.167912 30223 tablet_replica.cc:333] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.168424 30223 raft_consensus.cc:2243] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.168812 30223 raft_consensus.cc:2272] T e10e736dd5544291bdec126ebb6bcea2 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.170514 30223 tablet_replica.cc:333] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a: stopping tablet replica
I20260709 12:26:29.170953 30223 raft_consensus.cc:2243] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.171368 30223 raft_consensus.cc:2272] T e30c018ecf2b4878a97e2a3a13d2a260 P 31fabaa79ceb4ad8b7dfdeaf624f067a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.238690 30223 tablet_server.cc:196] TabletServer@127.29.131.196:0 shutdown complete.
I20260709 12:26:29.321396 30223 master.cc:562] Master@127.29.131.254:37927 shutting down...
I20260709 12:26:29.346923 30223 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.347560 30223 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.347932 30223 tablet_replica.cc:333] T 00000000000000000000000000000000 P 25d93ee0e30a4073a1f48aef29ef7a23: stopping tablet replica
I20260709 12:26:29.369711 30223 master.cc:584] Master@127.29.131.254:37927 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (29582 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:26:29.457828 30223 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.131.254:36467
I20260709 12:26:29.459014 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:29.465122  4735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.465451  4736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.465623  4738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:29.466593 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:29.467828 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:29.468009 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:29.468204 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599989468167 us; error 0 us; skew 500 ppm
I20260709 12:26:29.468755 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:29.471556 30223 webserver.cc:533] Webserver started at http://127.29.131.254:42879/ using document root <none> and password file <none>
I20260709 12:26:29.472080 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:29.472273 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:29.472560 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:29.473640 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/master-0-root/instance:
uuid: "bbefebf4496441b389d7243021b41ced"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:29.478097 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:26:29.481498  4743 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.482347 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:29.482697 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/master-0-root
uuid: "bbefebf4496441b389d7243021b41ced"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:29.482998 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:29.491164 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:29.492426 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:29.530469 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.254:36467
I20260709 12:26:29.530719  4794 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.254:36467 every 8 connection(s)
I20260709 12:26:29.534478  4795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:29.547436  4795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced: Bootstrap starting.
I20260709 12:26:29.552341  4795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:29.556768  4795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced: No bootstrap required, opened a new log
I20260709 12:26:29.558993  4795 raft_consensus.cc:359] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbefebf4496441b389d7243021b41ced" member_type: VOTER }
I20260709 12:26:29.559437  4795 raft_consensus.cc:385] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:29.559691  4795 raft_consensus.cc:740] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbefebf4496441b389d7243021b41ced, State: Initialized, Role: FOLLOWER
I20260709 12:26:29.560269  4795 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbefebf4496441b389d7243021b41ced" member_type: VOTER }
I20260709 12:26:29.560726  4795 raft_consensus.cc:399] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:29.560953  4795 raft_consensus.cc:493] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:29.561218  4795 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:29.565722  4795 raft_consensus.cc:515] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbefebf4496441b389d7243021b41ced" member_type: VOTER }
I20260709 12:26:29.566254  4795 leader_election.cc:304] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbefebf4496441b389d7243021b41ced; no voters: 
I20260709 12:26:29.567478  4795 leader_election.cc:290] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:29.567925  4798 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:29.569303  4798 raft_consensus.cc:697] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 1 LEADER]: Becoming Leader. State: Replica: bbefebf4496441b389d7243021b41ced, State: Running, Role: LEADER
I20260709 12:26:29.570001  4798 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbefebf4496441b389d7243021b41ced" member_type: VOTER }
I20260709 12:26:29.570573  4795 sys_catalog.cc:565] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:29.576026  4800 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbefebf4496441b389d7243021b41ced. Latest consensus state: current_term: 1 leader_uuid: "bbefebf4496441b389d7243021b41ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbefebf4496441b389d7243021b41ced" member_type: VOTER } }
I20260709 12:26:29.576813  4800 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:29.583576  4799 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbefebf4496441b389d7243021b41ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbefebf4496441b389d7243021b41ced" member_type: VOTER } }
I20260709 12:26:29.584461  4799 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:29.588729  4804 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:29.596309  4804 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:29.597796 30223 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:29.608445  4804 catalog_manager.cc:1383] Generated new cluster ID: f4beeacd7aca4496b254f3c31f060333
I20260709 12:26:29.608752  4804 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:29.633661  4804 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:29.634967  4804 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:29.648041  4804 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced: Generated new TSK 0
I20260709 12:26:29.648626  4804 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:29.666462 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:29.672616  4816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.673774  4817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:29.675632 30223 server_base.cc:1061] running on GCE node
W20260709 12:26:29.675783  4819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:29.676769 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:29.677004 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:29.677193 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599989677170 us; error 0 us; skew 500 ppm
I20260709 12:26:29.677716 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:29.680003 30223 webserver.cc:533] Webserver started at http://127.29.131.193:37995/ using document root <none> and password file <none>
I20260709 12:26:29.680509 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:29.680722 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:29.680992 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:29.682039 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root/instance:
uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:29.686511 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:29.689788  4824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.690501 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:29.690812 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:29.691126 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:29.729883 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:29.731146 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:29.732687 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:29.734902 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:29.735132 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.735395 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:29.735620 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.774804 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:43787
I20260709 12:26:29.774914  4886 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:43787 every 8 connection(s)
I20260709 12:26:29.779992 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:29.786876  4891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.789261  4892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.789916  4894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:29.792201 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:29.793341  4887 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36467
I20260709 12:26:29.793730  4887 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:29.793779 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:29.794122 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:29.794301 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599989794266 us; error 0 us; skew 500 ppm
I20260709 12:26:29.794579  4887 heartbeater.cc:507] Master 127.29.131.254:36467 requested a full tablet report, sending...
I20260709 12:26:29.794976 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:29.796820  4760 ts_manager.cc:194] Registered new tserver with Master: 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787)
I20260709 12:26:29.798010 30223 webserver.cc:533] Webserver started at http://127.29.131.194:37489/ using document root <none> and password file <none>
I20260709 12:26:29.798602 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:29.798800 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:29.798758  4760 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40604
I20260709 12:26:29.799353 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:29.800760 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-1-root/instance:
uuid: "b5f4fb663a49499fa17618b9e121ee4f"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:29.805320 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:26:29.808792  4899 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.809552 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:26:29.809875 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-1-root
uuid: "b5f4fb663a49499fa17618b9e121ee4f"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:29.810168 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:29.840557 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:29.841861 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:29.843429 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:29.845870 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:29.846091 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.846338 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:29.846510 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.886662 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.194:44847
I20260709 12:26:29.886785  4961 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.194:44847 every 8 connection(s)
I20260709 12:26:29.891804 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:29.898901  4965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.899710  4966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.903402  4968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:29.904048 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:29.904232  4962 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36467
I20260709 12:26:29.904807  4962 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:29.905122 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:29.905387 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:29.905566 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599989905549 us; error 0 us; skew 500 ppm
I20260709 12:26:29.905649  4962 heartbeater.cc:507] Master 127.29.131.254:36467 requested a full tablet report, sending...
I20260709 12:26:29.906183 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:29.908049  4760 ts_manager.cc:194] Registered new tserver with Master: b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:29.909053 30223 webserver.cc:533] Webserver started at http://127.29.131.195:35213/ using document root <none> and password file <none>
I20260709 12:26:29.909746 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:29.909987 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:29.909952  4760 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40620
I20260709 12:26:29.910655 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:29.912164 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-2-root/instance:
uuid: "bd882edfca2b46aca0d0e66278597e9e"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:29.916538 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:26:29.919930  4973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.920724 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:26:29.921067 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-2-root
uuid: "bd882edfca2b46aca0d0e66278597e9e"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:29.921412 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:29.930531 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:29.931648 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:29.932928 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:29.935003 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:29.935199 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.935478 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:29.935638 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.975437 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.195:39505
I20260709 12:26:29.975553  5035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.195:39505 every 8 connection(s)
I20260709 12:26:29.989305  5036 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36467
I20260709 12:26:29.989802  5036 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:29.990490  5036 heartbeater.cc:507] Master 127.29.131.254:36467 requested a full tablet report, sending...
I20260709 12:26:29.992530  4760 ts_manager.cc:194] Registered new tserver with Master: bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:29.993185 30223 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014532339s
I20260709 12:26:29.994035  4760 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40622
I20260709 12:26:30.017851  4760 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40634:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:30.020823  4760 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:30.102723  4927 tablet_service.cc:1511] Processing CreateTablet for tablet 2844196e09f547febbcfda9dbcc908f2 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:30.104221  4927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2844196e09f547febbcfda9dbcc908f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.103896  4924 tablet_service.cc:1511] Processing CreateTablet for tablet a81f70a12410402e9cc3921c92192dc5 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:30.105297  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81f70a12410402e9cc3921c92192dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.106243  4926 tablet_service.cc:1511] Processing CreateTablet for tablet d643ecda3bc7487b813de68ef99fb96a (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:30.107632  4926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d643ecda3bc7487b813de68ef99fb96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.107978  4923 tablet_service.cc:1511] Processing CreateTablet for tablet a9890be6830e48bda79ded614ec90293 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:30.109318  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9890be6830e48bda79ded614ec90293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.110298  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 7b78f8af4c624113bf61a0b4c5e954ee (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:30.111646  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78f8af4c624113bf61a0b4c5e954ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.112941  4922 tablet_service.cc:1511] Processing CreateTablet for tablet 45dde00fc1134422a7c5e40a01a3e4e0 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:30.114252  4922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dde00fc1134422a7c5e40a01a3e4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.120817  4921 tablet_service.cc:1511] Processing CreateTablet for tablet 4189e77ec0394a87ace96fd3548b727f (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:30.122262  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4189e77ec0394a87ace96fd3548b727f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.125751  4920 tablet_service.cc:1511] Processing CreateTablet for tablet e7f147db3c2f4fe0a64896bcd40d0d3e (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:30.127081  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f147db3c2f4fe0a64896bcd40d0d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.132388  4919 tablet_service.cc:1511] Processing CreateTablet for tablet b797bc65a873405cabf67f542a11c8db (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:30.133721  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b797bc65a873405cabf67f542a11c8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.136495  4918 tablet_service.cc:1511] Processing CreateTablet for tablet c4a23239ef6845e089d021769a95ed83 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:30.137914  4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a23239ef6845e089d021769a95ed83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.159266  4852 tablet_service.cc:1511] Processing CreateTablet for tablet 2844196e09f547febbcfda9dbcc908f2 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:30.160673  4852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2844196e09f547febbcfda9dbcc908f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.165230  4851 tablet_service.cc:1511] Processing CreateTablet for tablet d643ecda3bc7487b813de68ef99fb96a (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:30.166744  4851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d643ecda3bc7487b813de68ef99fb96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.166800  4846 tablet_service.cc:1511] Processing CreateTablet for tablet 4189e77ec0394a87ace96fd3548b727f (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:30.168291  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4189e77ec0394a87ace96fd3548b727f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.168490  4849 tablet_service.cc:1511] Processing CreateTablet for tablet a81f70a12410402e9cc3921c92192dc5 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:30.169883  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81f70a12410402e9cc3921c92192dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.170173  5051 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:30.171402  4847 tablet_service.cc:1511] Processing CreateTablet for tablet 45dde00fc1134422a7c5e40a01a3e4e0 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:30.172814  4845 tablet_service.cc:1511] Processing CreateTablet for tablet e7f147db3c2f4fe0a64896bcd40d0d3e (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:30.172853  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dde00fc1134422a7c5e40a01a3e4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.175108  4850 tablet_service.cc:1511] Processing CreateTablet for tablet 7b78f8af4c624113bf61a0b4c5e954ee (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:30.176437  4850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78f8af4c624113bf61a0b4c5e954ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.176870  5051 tablet_bootstrap.cc:654] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.173957  4848 tablet_service.cc:1511] Processing CreateTablet for tablet a9890be6830e48bda79ded614ec90293 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:30.180591  4848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9890be6830e48bda79ded614ec90293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.170231  4844 tablet_service.cc:1511] Processing CreateTablet for tablet b797bc65a873405cabf67f542a11c8db (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:30.184636  4844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b797bc65a873405cabf67f542a11c8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.187723  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f147db3c2f4fe0a64896bcd40d0d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.171461  4843 tablet_service.cc:1511] Processing CreateTablet for tablet c4a23239ef6845e089d021769a95ed83 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:30.190122  5051 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:30.190603  5051 ts_tablet_manager.cc:1403] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 12:26:30.190804  4843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a23239ef6845e089d021769a95ed83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.195118  5051 raft_consensus.cc:359] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.195940  5051 raft_consensus.cc:385] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.196237  5051 raft_consensus.cc:740] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.200268  5051 consensus_queue.cc:260] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.220463  5001 tablet_service.cc:1511] Processing CreateTablet for tablet 2844196e09f547febbcfda9dbcc908f2 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:30.224815  5053 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.226389  5000 tablet_service.cc:1511] Processing CreateTablet for tablet d643ecda3bc7487b813de68ef99fb96a (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:30.228660  4998 tablet_service.cc:1511] Processing CreateTablet for tablet a81f70a12410402e9cc3921c92192dc5 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:30.224908  4999 tablet_service.cc:1511] Processing CreateTablet for tablet 7b78f8af4c624113bf61a0b4c5e954ee (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:30.222419  5001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2844196e09f547febbcfda9dbcc908f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.231834  5053 tablet_bootstrap.cc:654] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.241794  4999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78f8af4c624113bf61a0b4c5e954ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.243759  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81f70a12410402e9cc3921c92192dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.247649  5000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d643ecda3bc7487b813de68ef99fb96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.254228  4997 tablet_service.cc:1511] Processing CreateTablet for tablet a9890be6830e48bda79ded614ec90293 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:30.256276  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9890be6830e48bda79ded614ec90293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.265954  4996 tablet_service.cc:1511] Processing CreateTablet for tablet 45dde00fc1134422a7c5e40a01a3e4e0 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:30.269973  4996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dde00fc1134422a7c5e40a01a3e4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.270556  5051 ts_tablet_manager.cc:1434] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.080s	user 0.029s	sys 0.035s
I20260709 12:26:30.271387  4962 heartbeater.cc:499] Master 127.29.131.254:36467 was elected leader, sending a full tablet report...
I20260709 12:26:30.274248  5053 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.274793  5053 ts_tablet_manager.cc:1403] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.005s
I20260709 12:26:30.277925  5053 raft_consensus.cc:359] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.278018  4995 tablet_service.cc:1511] Processing CreateTablet for tablet 4189e77ec0394a87ace96fd3548b727f (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:30.278708  5053 raft_consensus.cc:385] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.289618  5053 raft_consensus.cc:740] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.290017  4995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4189e77ec0394a87ace96fd3548b727f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.279942  4994 tablet_service.cc:1511] Processing CreateTablet for tablet e7f147db3c2f4fe0a64896bcd40d0d3e (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:30.304744  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f147db3c2f4fe0a64896bcd40d0d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.306031  5051 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:30.281162  4993 tablet_service.cc:1511] Processing CreateTablet for tablet b797bc65a873405cabf67f542a11c8db (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:30.282407  4992 tablet_service.cc:1511] Processing CreateTablet for tablet c4a23239ef6845e089d021769a95ed83 (DEFAULT_TABLE table=test-workload [id=e26244d0dc7e4ae1959c52241a2bf2f0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:30.309466  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b797bc65a873405cabf67f542a11c8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.310160  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a23239ef6845e089d021769a95ed83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.293020  5053 consensus_queue.cc:260] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.335139  5054 raft_consensus.cc:493] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.335784  5054 raft_consensus.cc:515] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.341327  5054 leader_election.cc:290] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.346397  4887 heartbeater.cc:499] Master 127.29.131.254:36467 was elected leader, sending a full tablet report...
I20260709 12:26:30.346783  5053 ts_tablet_manager.cc:1434] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.072s	user 0.012s	sys 0.001s
I20260709 12:26:30.347048  5056 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.347958  5053 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.357371  5053 tablet_bootstrap.cc:654] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.358180  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:30.358973  4862 raft_consensus.cc:2468] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 0.
I20260709 12:26:30.360697  4903 leader_election.cc:304] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:30.361554  5054 raft_consensus.cc:2804] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.362011  5054 raft_consensus.cc:493] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.362417  5054 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.373905  5054 raft_consensus.cc:515] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.378839  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.379871  5051 tablet_bootstrap.cc:654] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:30.380600  4901 leader_election.cc:343] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.381979  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:30.382594  4862 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.385380  5056 tablet_bootstrap.cc:654] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.388777  4862 raft_consensus.cc:2468] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 1.
I20260709 12:26:30.389995  4903 leader_election.cc:304] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:30.392102  5053 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.392863  5053 ts_tablet_manager.cc:1403] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.004s
I20260709 12:26:30.396904  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:30.396495  5053 raft_consensus.cc:359] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.397558  5053 raft_consensus.cc:385] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.397953  5053 raft_consensus.cc:740] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
W20260709 12:26:30.398355  4901 leader_election.cc:343] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.399415  5054 leader_election.cc:290] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.398931  5053 consensus_queue.cc:260] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.400038  5054 raft_consensus.cc:2804] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.400496  5054 raft_consensus.cc:697] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:30.401332  5054 consensus_queue.cc:237] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.411419  5053 ts_tablet_manager.cc:1434] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:30.412297  5056 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:30.412662  5053 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.412848  5056 ts_tablet_manager.cc:1403] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.010s
I20260709 12:26:30.418991  5056 raft_consensus.cc:359] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.419751  5056 raft_consensus.cc:385] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.420012  5056 raft_consensus.cc:740] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.420233  5053 tablet_bootstrap.cc:654] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.421000  5056 consensus_queue.cc:260] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.421875  5051 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:30.422598  5051 ts_tablet_manager.cc:1403] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.126s	user 0.017s	sys 0.028s
I20260709 12:26:30.425935  5036 heartbeater.cc:499] Master 127.29.131.254:36467 was elected leader, sending a full tablet report...
I20260709 12:26:30.426014  5051 raft_consensus.cc:359] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.426839  5051 raft_consensus.cc:385] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.427143  5051 raft_consensus.cc:740] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.427412  5053 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.427935  5053 ts_tablet_manager.cc:1403] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.016s	user 0.001s	sys 0.012s
I20260709 12:26:30.427908  5051 consensus_queue.cc:260] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.430294  5051 ts_tablet_manager.cc:1434] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:30.425920  4760 catalog_manager.cc:5697] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.430586  5053 raft_consensus.cc:359] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.431288  5051 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:30.431392  5053 raft_consensus.cc:385] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.431869  5053 raft_consensus.cc:740] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.432631  5053 consensus_queue.cc:260] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.434794  5053 ts_tablet_manager.cc:1434] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:30.437230  5053 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.438325  5051 tablet_bootstrap.cc:654] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.439854  5056 ts_tablet_manager.cc:1434] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:26:30.440934  5056 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.443642  5053 tablet_bootstrap.cc:654] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.449604  5056 tablet_bootstrap.cc:654] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.454770  5051 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:30.455351  5051 ts_tablet_manager.cc:1403] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.006s
I20260709 12:26:30.457286  5054 raft_consensus.cc:493] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.458048  5054 raft_consensus.cc:515] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.460278  5053 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.460844  5053 ts_tablet_manager.cc:1403] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.024s	user 0.023s	sys 0.000s
I20260709 12:26:30.460789  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:30.461638  5051 raft_consensus.cc:359] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
W20260709 12:26:30.462397  4903 leader_election.cc:343] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.462440  5051 raft_consensus.cc:385] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.463043  5051 raft_consensus.cc:740] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.463608  5054 leader_election.cc:290] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.463944  5051 consensus_queue.cc:260] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.464993  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.466240  5051 ts_tablet_manager.cc:1434] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
W20260709 12:26:30.466970  4901 leader_election.cc:343] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.467316  5051 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:30.467640  4901 leader_election.cc:304] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:30.469244  5054 raft_consensus.cc:2749] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:30.471251  5053 raft_consensus.cc:359] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.472433  5053 raft_consensus.cc:385] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.472968  5053 raft_consensus.cc:740] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.473870  5051 tablet_bootstrap.cc:654] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.474015  5053 consensus_queue.cc:260] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.477247  5053 ts_tablet_manager.cc:1434] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:26:30.478329  5053 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.484753  5053 tablet_bootstrap.cc:654] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.498730  5053 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.499325  5053 ts_tablet_manager.cc:1403] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 12:26:30.500206  5051 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:30.500384  5056 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:30.500751  5051 ts_tablet_manager.cc:1403] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.020s
I20260709 12:26:30.500952  5056 ts_tablet_manager.cc:1403] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.014s
I20260709 12:26:30.502283  5053 raft_consensus.cc:359] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.503161  5053 raft_consensus.cc:385] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.503021  5051 raft_consensus.cc:359] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.503574  5053 raft_consensus.cc:740] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.503821  5051 raft_consensus.cc:385] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.504201  5051 raft_consensus.cc:740] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.503981  5056 raft_consensus.cc:359] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.504827  5056 raft_consensus.cc:385] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.504411  5053 consensus_queue.cc:260] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.505139  5056 raft_consensus.cc:740] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.505122  5051 consensus_queue.cc:260] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.506253  5056 consensus_queue.cc:260] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.506893  5053 ts_tablet_manager.cc:1434] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:30.507931  5053 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.509363  5051 ts_tablet_manager.cc:1434] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:26:30.510982  5051 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:30.511508  5056 ts_tablet_manager.cc:1434] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:26:30.512791  5056 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.517036  5051 tablet_bootstrap.cc:654] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.519198  5056 tablet_bootstrap.cc:654] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.528190  5053 tablet_bootstrap.cc:654] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.528582  5056 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:30.529160  5056 ts_tablet_manager.cc:1403] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 12:26:30.532262  5056 raft_consensus.cc:359] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.532948  5051 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:30.533021  5053 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.533000  5056 raft_consensus.cc:385] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.533631  5051 ts_tablet_manager.cc:1403] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 12:26:30.533823  5053 ts_tablet_manager.cc:1403] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 12:26:30.533707  5056 raft_consensus.cc:740] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.534798  5056 consensus_queue.cc:260] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.536523  5053 raft_consensus.cc:359] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.537043  5056 ts_tablet_manager.cc:1434] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:26:30.537091  5053 raft_consensus.cc:385] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.537624  5053 raft_consensus.cc:740] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.538172  5056 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.538390  5053 consensus_queue.cc:260] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.538578  5051 raft_consensus.cc:359] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.539376  5051 raft_consensus.cc:385] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.539662  5051 raft_consensus.cc:740] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.540436  5051 consensus_queue.cc:260] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.543035  5051 ts_tablet_manager.cc:1434] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:26:30.544071  5051 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:30.545066  5056 tablet_bootstrap.cc:654] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.545815  5053 ts_tablet_manager.cc:1434] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:30.546790  5053 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.551440  5051 tablet_bootstrap.cc:654] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.552947  5053 tablet_bootstrap.cc:654] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.560406  5064 raft_consensus.cc:493] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.560933  5064 raft_consensus.cc:515] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.568486  5053 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.569056  5053 ts_tablet_manager.cc:1403] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 12:26:30.572016  5053 raft_consensus.cc:359] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.572856  5053 raft_consensus.cc:385] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.573146  5053 raft_consensus.cc:740] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.573846  5053 consensus_queue.cc:260] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.577158  5053 ts_tablet_manager.cc:1434] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:30.578471  5053 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.579728  5064 leader_election.cc:290] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:30.587078  5053 tablet_bootstrap.cc:654] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.589008  5051 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:30.589645  5051 ts_tablet_manager.cc:1403] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.013s
W20260709 12:26:30.592710  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:30.595767  5051 raft_consensus.cc:359] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.596263  5057 raft_consensus.cc:493] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.596825  5051 raft_consensus.cc:385] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.597282  5051 raft_consensus.cc:740] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.597074  5057 raft_consensus.cc:515] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.598387  5051 consensus_queue.cc:260] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.604490  5051 ts_tablet_manager.cc:1434] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:26:30.605553  5051 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:30.607110  5054 raft_consensus.cc:493] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.607676  5054 raft_consensus.cc:515] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.622680  5053 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.623343  5053 ts_tablet_manager.cc:1403] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.027s
I20260709 12:26:30.623795  5054 leader_election.cc:290] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.618412  5057 leader_election.cc:290] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.628664  5057 raft_consensus.cc:493] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.629041  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.629738  5011 raft_consensus.cc:2468] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 0.
I20260709 12:26:30.630221  5053 raft_consensus.cc:359] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.630924  5053 raft_consensus.cc:385] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.629109  5057 raft_consensus.cc:515] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.631196  5053 raft_consensus.cc:740] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.632015  5053 consensus_queue.cc:260] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.632856  5057 leader_election.cc:290] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.634341  4901 leader_election.cc:304] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:30.636109  5054 raft_consensus.cc:2804] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.636467  5054 raft_consensus.cc:493] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.636857  5054 raft_consensus.cc:3060] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.641141  5056 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:30.641690  5056 ts_tablet_manager.cc:1403] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.104s	user 0.022s	sys 0.039s
I20260709 12:26:30.645084  5051 tablet_bootstrap.cc:654] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.653295  5056 raft_consensus.cc:359] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.658615  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:30.660776  5053 ts_tablet_manager.cc:1434] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.007s
I20260709 12:26:30.661590  5053 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:30.660197  5056 raft_consensus.cc:385] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.664975  5056 raft_consensus.cc:740] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.670576  5054 raft_consensus.cc:515] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.671661  5053 tablet_bootstrap.cc:654] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.672375  5056 consensus_queue.cc:260] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.674188  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:30.674723  5056 ts_tablet_manager.cc:1434] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.033s	user 0.001s	sys 0.004s
W20260709 12:26:30.676501  4974 leader_election.cc:343] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.677541  5054 leader_election.cc:290] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.678146  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:30.678671  5056 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.678762  5011 raft_consensus.cc:3060] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.685894  5056 tablet_bootstrap.cc:654] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.687330  5053 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.687865  5053 ts_tablet_manager.cc:1403] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.003s
W20260709 12:26:30.688060  4903 leader_election.cc:343] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.690445  5053 raft_consensus.cc:359] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.691147  5053 raft_consensus.cc:385] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.691576  5053 raft_consensus.cc:740] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.692119  5011 raft_consensus.cc:2468] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 1.
I20260709 12:26:30.692485  5053 consensus_queue.cc:260] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.693495  4901 leader_election.cc:304] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:30.694384  5054 raft_consensus.cc:2804] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.694895  5054 raft_consensus.cc:697] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:30.695739  5054 consensus_queue.cc:237] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.699600  5051 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:30.699837  5083 raft_consensus.cc:493] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.700321  5051 ts_tablet_manager.cc:1403] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.000s
I20260709 12:26:30.700539  5083 raft_consensus.cc:515] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.703758  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:30.704655  4862 raft_consensus.cc:2468] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 0.
I20260709 12:26:30.705905  5083 leader_election.cc:290] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.707741  5053 ts_tablet_manager.cc:1434] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:26:30.711213  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:30.711313  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.712056  4862 raft_consensus.cc:3060] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.713572  4977 leader_election.cc:304] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:30.714038  5051 raft_consensus.cc:359] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.714820  5064 raft_consensus.cc:2804] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.715370  5064 raft_consensus.cc:493] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.714851  5051 raft_consensus.cc:385] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.715730  5064 raft_consensus.cc:3060] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.717617  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
W20260709 12:26:30.718875  4826 leader_election.cc:343] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.719808  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:30.720698  5053 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
W20260709 12:26:30.723603  4825 leader_election.cc:343] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.723985  5056 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:30.720930  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.724498  5056 ts_tablet_manager.cc:1403] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.012s
I20260709 12:26:30.724929  5010 raft_consensus.cc:2393] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in current term 1: Already voted for candidate b5f4fb663a49499fa17618b9e121ee4f in this term.
I20260709 12:26:30.721300  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:30.727607  5056 raft_consensus.cc:359] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.728173  4936 raft_consensus.cc:2468] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 0.
I20260709 12:26:30.728363  5056 raft_consensus.cc:385] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.727152  4758 catalog_manager.cc:5697] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.728688  4825 leader_election.cc:304] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece; no voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:30.728727  5056 raft_consensus.cc:740] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.729039  4862 raft_consensus.cc:2468] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 1.
I20260709 12:26:30.730094  5083 raft_consensus.cc:2749] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:30.730508  5057 raft_consensus.cc:493] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.731279  5053 tablet_bootstrap.cc:654] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.731062  5057 raft_consensus.cc:515] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.721856  5051 raft_consensus.cc:740] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.733206  5057 leader_election.cc:290] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.721273  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.732846  5051 consensus_queue.cc:260] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.735134  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.735809  5051 ts_tablet_manager.cc:1434] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 12:26:30.736879  5051 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
W20260709 12:26:30.737244  4826 leader_election.cc:343] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.738101  4825 leader_election.cc:304] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:30.738456  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:30.739125  5064 raft_consensus.cc:515] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.739379  4936 raft_consensus.cc:2468] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 0.
I20260709 12:26:30.741384  5064 leader_election.cc:290] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:30.741783  5011 raft_consensus.cc:2393] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in current term 1: Already voted for candidate bd882edfca2b46aca0d0e66278597e9e in this term.
I20260709 12:26:30.742527  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
W20260709 12:26:30.743855  4974 leader_election.cc:343] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.744041  5057 raft_consensus.cc:2804] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.744473  5057 raft_consensus.cc:493] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.744803  5057 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.745661  4826 leader_election.cc:304] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece; no voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:30.747349  5083 raft_consensus.cc:3060] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.752274  5057 raft_consensus.cc:515] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.730357  5056 consensus_queue.cc:260] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.756031  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:30.756563  5056 ts_tablet_manager.cc:1434] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:26:30.757664  5056 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.764011  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:30.764029  5056 tablet_bootstrap.cc:654] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.764703  4936 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.764632  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:30.765723  4825 leader_election.cc:304] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: bd882edfca2b46aca0d0e66278597e9e
W20260709 12:26:30.766634  4826 leader_election.cc:343] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.754460  5057 leader_election.cc:290] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Requested vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.767521  5057 raft_consensus.cc:2804] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.767869  5057 raft_consensus.cc:493] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.768185  5057 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.773110  4936 raft_consensus.cc:2468] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 1.
I20260709 12:26:30.764046  5051 tablet_bootstrap.cc:654] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.778980  5054 raft_consensus.cc:493] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.779747  4825 leader_election.cc:304] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:30.779775  5054 raft_consensus.cc:515] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.781174  5051 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:30.781669  5051 ts_tablet_manager.cc:1403] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 12:26:30.781872  5057 raft_consensus.cc:515] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.784644  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:30.785249  5057 leader_election.cc:290] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Requested vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.785367  4936 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.785893  5057 raft_consensus.cc:2804] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.786561  5057 raft_consensus.cc:697] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 LEADER]: Becoming Leader. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Running, Role: LEADER
I20260709 12:26:30.786875  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dde00fc1134422a7c5e40a01a3e4e0" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:30.787398  5057 consensus_queue.cc:237] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
W20260709 12:26:30.788728  4903 leader_election.cc:343] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.791867  5054 leader_election.cc:290] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.790650  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:30.792985  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dde00fc1134422a7c5e40a01a3e4e0" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.793771  5010 raft_consensus.cc:2468] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 0.
I20260709 12:26:30.794135  5056 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
W20260709 12:26:30.794102  4826 leader_election.cc:343] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.793035  5083 raft_consensus.cc:2749] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:30.794874  5056 ts_tablet_manager.cc:1403] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.006s
I20260709 12:26:30.795426  4936 raft_consensus.cc:2468] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 1.
I20260709 12:26:30.795568  4901 leader_election.cc:304] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece
I20260709 12:26:30.792910  5051 raft_consensus.cc:359] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.796392  5051 raft_consensus.cc:385] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.796666  5051 raft_consensus.cc:740] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.797336  4825 leader_election.cc:304] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:30.798208  5089 raft_consensus.cc:2804] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.798935  5054 raft_consensus.cc:2804] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.799492  5054 raft_consensus.cc:493] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.798259  5056 raft_consensus.cc:359] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.799957  5054 raft_consensus.cc:3060] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.799995  5056 raft_consensus.cc:385] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.800567  5056 raft_consensus.cc:740] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.801491  5056 consensus_queue.cc:260] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.797559  5051 consensus_queue.cc:260] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.803772  5056 ts_tablet_manager.cc:1434] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:30.804852  5056 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.802323  4862 raft_consensus.cc:2468] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 1.
I20260709 12:26:30.807401  4977 leader_election.cc:304] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:30.808306  5064 raft_consensus.cc:2804] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.811868  5056 tablet_bootstrap.cc:654] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.815819  5053 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: No bootstrap required, opened a new log
I20260709 12:26:30.816422  5053 ts_tablet_manager.cc:1403] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.096s	user 0.035s	sys 0.020s
I20260709 12:26:30.816887  5051 ts_tablet_manager.cc:1434] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:26:30.819849  5053 raft_consensus.cc:359] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.820796  5053 raft_consensus.cc:385] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.821141  5053 raft_consensus.cc:740] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.822006  5053 consensus_queue.cc:260] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.823195  4757 catalog_manager.cc:5697] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193). New cstate: current_term: 1 leader_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.824550  5056 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:30.825029  5053 ts_tablet_manager.cc:1434] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:30.825112  5056 ts_tablet_manager.cc:1403] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:26:30.828370  5054 raft_consensus.cc:515] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.828444  5056 raft_consensus.cc:359] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.829454  5056 raft_consensus.cc:385] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.829830  5056 raft_consensus.cc:740] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.830627  5056 consensus_queue.cc:260] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.832451  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dde00fc1134422a7c5e40a01a3e4e0" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:30.833577  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dde00fc1134422a7c5e40a01a3e4e0" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:30.833961  5051 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:30.834179  5011 raft_consensus.cc:3060] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.835579  5064 raft_consensus.cc:697] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:30.836488  5064 consensus_queue.cc:237] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.838949  5051 tablet_bootstrap.cc:654] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.834203  4862 raft_consensus.cc:3060] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.840034  5089 raft_consensus.cc:697] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 LEADER]: Becoming Leader. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Running, Role: LEADER
I20260709 12:26:30.840508  5054 leader_election.cc:290] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.841002  5089 consensus_queue.cc:237] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.846248  5064 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.846552  4759 catalog_manager.cc:5697] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 0 to 1, leader changed from <none> to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 1 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.849356  4862 raft_consensus.cc:2468] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 1.
I20260709 12:26:30.846968  5064 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.851046  5056 ts_tablet_manager.cc:1434] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:26:30.853915  5056 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.854380  5064 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:30.851845  5011 raft_consensus.cc:2468] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 1.
I20260709 12:26:30.856153  4903 leader_election.cc:304] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:30.857656  5054 raft_consensus.cc:2804] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.857708  5093 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.858706  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:30.858529  5093 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
W20260709 12:26:30.860879  4974 leader_election.cc:343] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.862900  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.863629  5010 raft_consensus.cc:2468] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 0.
I20260709 12:26:30.864107  5093 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.864992  5054 raft_consensus.cc:697] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:30.865237  4826 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:30.864456  5057 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.866446  5057 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.866176  5054 consensus_queue.cc:237] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.868700  5057 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.869202  5061 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.885532  5061 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.884828  4757 catalog_manager.cc:5697] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193). New cstate: current_term: 1 leader_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.887707  5061 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.869863  5093 raft_consensus.cc:2804] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.888818  5093 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.889173  5093 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.871107  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:30.894032  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
W20260709 12:26:30.895124  4825 leader_election.cc:343] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.872092  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:30.874850  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:30.899339  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:30.875922  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.902549  4861 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 0.
W20260709 12:26:30.896806  4901 leader_election.cc:343] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.901870  5056 tablet_bootstrap.cc:654] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:30.904026  4826 leader_election.cc:343] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.902271  4935 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 0.
I20260709 12:26:30.905210  4903 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:30.906886  4825 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:30.908562  5061 raft_consensus.cc:2804] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.908701  5089 raft_consensus.cc:2804] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.908995  5061 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.909113  5089 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.909406  5061 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.909528  5089 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.912200  5100 consensus_queue.cc:1048] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:30.929023  5100 raft_consensus.cc:493] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.934142  5100 raft_consensus.cc:515] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.947018  5093 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.948454  4862 raft_consensus.cc:2393] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd882edfca2b46aca0d0e66278597e9e in current term 1: Already voted for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in this term.
I20260709 12:26:30.948395  5061 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.949352  5093 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Requested vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.950194  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:30.951479  4977 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:30.951551  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
W20260709 12:26:30.951915  4825 leader_election.cc:343] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.952402  5010 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.952692  5100 leader_election.cc:290] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.954114  5061 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.954274  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:30.955322  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:30.956579  5051 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
W20260709 12:26:30.956609  4901 leader_election.cc:343] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.957015  5094 raft_consensus.cc:493] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:30.959144  4901 leader_election.cc:343] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:30.958973  5094 raft_consensus.cc:515] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.960083  5051 ts_tablet_manager.cc:1403] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.126s	user 0.040s	sys 0.035s
I20260709 12:26:30.960790  5056 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:30.961171  5094 leader_election.cc:290] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:30.961351  5056 ts_tablet_manager.cc:1403] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.019s
I20260709 12:26:30.962168  5010 raft_consensus.cc:2468] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 1.
I20260709 12:26:30.962689  5064 raft_consensus.cc:2749] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:30.962828  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:30.963814  4935 raft_consensus.cc:2393] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd882edfca2b46aca0d0e66278597e9e in current term 1: Already voted for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in this term.
I20260709 12:26:30.963918  5051 raft_consensus.cc:359] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.964125  5056 raft_consensus.cc:359] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.964679  5051 raft_consensus.cc:385] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.964910  5056 raft_consensus.cc:385] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.965103  5051 raft_consensus.cc:740] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.965353  5056 raft_consensus.cc:740] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.957304  5089 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.966149  5056 consensus_queue.cc:260] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.966120  5051 consensus_queue.cc:260] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:30.968504  5089 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Requested vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:30.968665  5056 ts_tablet_manager.cc:1434] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:30.968971  5051 ts_tablet_manager.cc:1434] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:26:30.971657  5056 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:30.975354  5051 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f: Bootstrap starting.
I20260709 12:26:31.012178  4758 catalog_manager.cc:5697] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.015802  5064 raft_consensus.cc:493] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.016562  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.017187  4826 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:31.017988  4862 raft_consensus.cc:2468] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 0.
I20260709 12:26:31.017336  5064 raft_consensus.cc:515] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.023921  5094 raft_consensus.cc:493] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.024138  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:31.025503  4860 raft_consensus.cc:2393] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f4fb663a49499fa17618b9e121ee4f in current term 1: Already voted for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in this term.
I20260709 12:26:31.025236  5094 raft_consensus.cc:515] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.028216  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:31.029408  4935 raft_consensus.cc:2393] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in current term 1: Already voted for candidate b5f4fb663a49499fa17618b9e121ee4f in this term.
I20260709 12:26:31.031317  5089 raft_consensus.cc:2804] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:31.038316  5010 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.044788  5064 leader_election.cc:290] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:31.046746  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:31.048843  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:31.049760  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.050285  5089 raft_consensus.cc:697] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 LEADER]: Becoming Leader. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Running, Role: LEADER
I20260709 12:26:31.050738  4860 raft_consensus.cc:2468] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 0.
I20260709 12:26:31.052044  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
W20260709 12:26:31.052490  4974 leader_election.cc:343] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:31.052251  5089 consensus_queue.cc:237] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.053962  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
W20260709 12:26:31.057709  4826 leader_election.cc:343] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:31.058147  4903 leader_election.cc:304] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:31.059706  4977 leader_election.cc:304] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:31.032034  5094 leader_election.cc:290] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:31.058377  4826 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece; no voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:31.060899  4977 leader_election.cc:304] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:31.061792  5093 raft_consensus.cc:2749] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.062654  5064 raft_consensus.cc:2804] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:31.063120  5064 raft_consensus.cc:493] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.063607  5064 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.065241  4903 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:31.067651  5100 raft_consensus.cc:2804] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:31.068230  5100 raft_consensus.cc:493] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.068717  5056 tablet_bootstrap.cc:654] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:31.068670  5100 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.069921  5104 raft_consensus.cc:2749] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.079469  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.082587  5104 consensus_queue.cc:1048] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:31.083206  4759 catalog_manager.cc:5697] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193). New cstate: current_term: 1 leader_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.085268  5064 raft_consensus.cc:515] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.088829  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
W20260709 12:26:31.090334  4974 leader_election.cc:343] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:31.091017  5064 leader_election.cc:290] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:31.093596  5094 raft_consensus.cc:2749] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.097901  4977 leader_election.cc:304] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:31.099160  5108 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.101868  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:31.102560  4861 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.106766  5051 tablet_bootstrap.cc:654] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:31.099336  5100 raft_consensus.cc:515] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.110944  5100 leader_election.cc:290] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:31.112635  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
W20260709 12:26:31.114454  4901 leader_election.cc:343] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:31.120879  4861 raft_consensus.cc:2468] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 1.
I20260709 12:26:31.121439  5108 raft_consensus.cc:2749] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.121284  5104 consensus_queue.cc:1048] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.122146  4977 leader_election.cc:304] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:31.124503  5094 raft_consensus.cc:2804] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:31.125092  5094 raft_consensus.cc:697] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:31.126307  5094 consensus_queue.cc:237] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.129431  5056 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:31.130156  5056 ts_tablet_manager.cc:1403] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.159s	user 0.009s	sys 0.014s
I20260709 12:26:31.134124  5056 raft_consensus.cc:359] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.134907  5056 raft_consensus.cc:385] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:31.135685  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:31.136461  4861 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.137997  5064 raft_consensus.cc:493] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.138688  5064 raft_consensus.cc:515] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.135205  5056 raft_consensus.cc:740] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:31.142001  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:31.142597  5056 consensus_queue.cc:260] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.143181  4935 raft_consensus.cc:2393] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd882edfca2b46aca0d0e66278597e9e in current term 1: Already voted for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in this term.
I20260709 12:26:31.144351  5064 leader_election.cc:290] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:31.146938  4862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.149811  4977 leader_election.cc:304] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:31.150780  5064 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.150740  5054 consensus_queue.cc:1048] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:31.153393  4861 raft_consensus.cc:2468] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 1.
I20260709 12:26:31.163858  4903 leader_election.cc:304] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:31.165431  5104 raft_consensus.cc:2804] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:31.166420  5104 raft_consensus.cc:697] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:31.168463  5104 consensus_queue.cc:237] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.172210  5051 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f: No bootstrap required, opened a new log
I20260709 12:26:31.173171  5064 raft_consensus.cc:2749] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.175696  5051 ts_tablet_manager.cc:1403] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f: Time spent bootstrapping tablet: real 0.205s	user 0.025s	sys 0.031s
I20260709 12:26:31.179615  5051 raft_consensus.cc:359] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.180279  5051 raft_consensus.cc:385] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:31.180495  5051 raft_consensus.cc:740] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Initialized, Role: FOLLOWER
I20260709 12:26:31.181300  5051 consensus_queue.cc:260] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.183725  5051 ts_tablet_manager.cc:1434] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:31.187130  5056 ts_tablet_manager.cc:1434] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.057s	user 0.011s	sys 0.011s
I20260709 12:26:31.188772  5056 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e: Bootstrap starting.
I20260709 12:26:31.192420  4759 catalog_manager.cc:5697] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 0 to 1, leader changed from <none> to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 1 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.195209  5056 tablet_bootstrap.cc:654] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:31.199483  5056 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e: No bootstrap required, opened a new log
I20260709 12:26:31.199847  5056 ts_tablet_manager.cc:1403] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:26:31.201722  4757 catalog_manager.cc:5697] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 1 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.202327  5056 raft_consensus.cc:359] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.203076  5056 raft_consensus.cc:385] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:31.203382  5056 raft_consensus.cc:740] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Initialized, Role: FOLLOWER
I20260709 12:26:31.204098  5056 consensus_queue.cc:260] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.206185  5056 ts_tablet_manager.cc:1434] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:31.266702  5104 consensus_queue.cc:1048] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.270926  5089 consensus_queue.cc:1048] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.281864  5061 consensus_queue.cc:1048] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:31.287220  5057 consensus_queue.cc:1048] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:31.292433  5061 raft_consensus.cc:493] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.293416  5061 raft_consensus.cc:515] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.297081  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.297194  5061 leader_election.cc:290] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:31.297609  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:31.298030  4861 raft_consensus.cc:2393] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f4fb663a49499fa17618b9e121ee4f in current term 1: Already voted for candidate bd882edfca2b46aca0d0e66278597e9e in this term.
I20260709 12:26:31.299280  4903 leader_election.cc:304] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:31.300412  5061 raft_consensus.cc:3060] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.313211  5061 raft_consensus.cc:2749] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.330426  5057 consensus_queue.cc:1048] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.342340  5093 consensus_queue.cc:1048] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.395771  5114 consensus_queue.cc:1048] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.407449  5064 consensus_queue.cc:1048] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:31.413070  4963 tablet.cc:2406] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:31.431640  5061 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.432212  5061 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.433894  5061 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:31.434621  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.435034  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:31.436120  5010 raft_consensus.cc:2393] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f4fb663a49499fa17618b9e121ee4f in current term 1: Already voted for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in this term.
I20260709 12:26:31.437196  4901 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:31.437911  5061 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.442850  5061 raft_consensus.cc:2749] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.520030  5064 raft_consensus.cc:493] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.520581  5064 raft_consensus.cc:515] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.522397  5064 leader_election.cc:290] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:31.523536  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.523558  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:31.524266  4861 raft_consensus.cc:2393] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd882edfca2b46aca0d0e66278597e9e in current term 1: Already voted for candidate b5f4fb663a49499fa17618b9e121ee4f in this term.
I20260709 12:26:31.525378  4977 leader_election.cc:304] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:31.526077  5064 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.531548  5064 raft_consensus.cc:2749] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.540338  5093 consensus_queue.cc:1048] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.548131  5064 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.548619  5064 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.550765  5064 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:31.552433  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:31.552917  5057 consensus_queue.cc:1048] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.553395  4936 raft_consensus.cc:2393] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd882edfca2b46aca0d0e66278597e9e in current term 1: Already voted for candidate b5f4fb663a49499fa17618b9e121ee4f in this term.
I20260709 12:26:31.554690  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.556028  4861 raft_consensus.cc:2393] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd882edfca2b46aca0d0e66278597e9e in current term 1: Already voted for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in this term.
I20260709 12:26:31.560552  4977 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:31.565778  5104 raft_consensus.cc:493] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.566249  5104 raft_consensus.cc:515] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:31.567421  5064 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.568475  5104 leader_election.cc:290] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:31.569690  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" is_pre_election: true
I20260709 12:26:31.570533  4861 raft_consensus.cc:2393] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f4fb663a49499fa17618b9e121ee4f in current term 1: Already voted for candidate bd882edfca2b46aca0d0e66278597e9e in this term.
I20260709 12:26:31.570420  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:31.572134  4901 leader_election.cc:304] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:31.573094  5104 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:31.575312  5064 raft_consensus.cc:2749] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:31.579602  5104 raft_consensus.cc:2749] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:31.595993  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:31.651335  5064 consensus_queue.cc:1048] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.662360  5114 consensus_queue.cc:1048] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.697237  5104 consensus_queue.cc:1048] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.714299  5133 consensus_queue.cc:1048] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:32.599341  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:32.633505  5057 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.634128  5057 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:32.635905  5057 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:32.636842  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:32.636958  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:32.637452  4936 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 1.
I20260709 12:26:32.637555  5009 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 1.
I20260709 12:26:32.638839  4825 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:32.639631  5057 raft_consensus.cc:2804] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:32.640048  5057 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.640318  5057 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.647317  5057 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:32.649057  5057 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 2 election: Requested vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:32.649657  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:32.650187  4936 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.650099  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:32.650820  5009 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.656098  5009 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 2.
I20260709 12:26:32.656100  4936 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f2b6a9b07cf4d2789458f9bb8a9aece in term 2.
I20260709 12:26:32.657142  4826 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:32.657881  5057 raft_consensus.cc:2804] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:32.658382  5057 raft_consensus.cc:697] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 LEADER]: Becoming Leader. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Running, Role: LEADER
I20260709 12:26:32.659149  5057 consensus_queue.cc:237] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:32.666115  4759 catalog_manager.cc:5697] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece reported cstate change: term changed from 0 to 2, leader changed from <none> to 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193). New cstate: current_term: 2 leader_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.050714  4936 raft_consensus.cc:1275] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Refusing update from remote peer 7f2b6a9b07cf4d2789458f9bb8a9aece: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:33.051874  5138 consensus_queue.cc:1048] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:33.066246  5010 raft_consensus.cc:1275] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Refusing update from remote peer 7f2b6a9b07cf4d2789458f9bb8a9aece: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:33.068034  5138 consensus_queue.cc:1048] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:33.084020 30223 ts_manager.cc:295] Set tserver state for 7f2b6a9b07cf4d2789458f9bb8a9aece to MAINTENANCE_MODE
I20260709 12:26:33.085265 30223 tablet_server.cc:179] TabletServer@127.29.131.193:0 shutting down...
I20260709 12:26:33.119923 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:33.120736 30223 tablet_replica.cc:333] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.121472 30223 raft_consensus.cc:2243] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.122015 30223 raft_consensus.cc:2272] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.124590 30223 tablet_replica.cc:333] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.125267 30223 raft_consensus.cc:2243] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.126025 30223 raft_consensus.cc:2272] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.128333 30223 tablet_replica.cc:333] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.128928 30223 raft_consensus.cc:2243] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.129366 30223 raft_consensus.cc:2272] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.131594 30223 tablet_replica.cc:333] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.132174 30223 raft_consensus.cc:2243] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.132602 30223 raft_consensus.cc:2272] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.134737 30223 tablet_replica.cc:333] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.135779 30223 raft_consensus.cc:2243] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.136636 30223 raft_consensus.cc:2272] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.139329 30223 tablet_replica.cc:333] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.140000 30223 raft_consensus.cc:2243] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.140461 30223 raft_consensus.cc:2272] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.142783 30223 tablet_replica.cc:333] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.143388 30223 raft_consensus.cc:2243] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.144156 30223 raft_consensus.cc:2272] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.146171 30223 tablet_replica.cc:333] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.146705 30223 raft_consensus.cc:2243] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.147552 30223 raft_consensus.cc:2272] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.149801 30223 tablet_replica.cc:333] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.150279 30223 raft_consensus.cc:2243] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.150753 30223 raft_consensus.cc:2272] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.152753 30223 tablet_replica.cc:333] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: stopping tablet replica
I20260709 12:26:33.153263 30223 raft_consensus.cc:2243] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.153720 30223 raft_consensus.cc:2272] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.156420  4977 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 88 similar messages]
W20260709 12:26:33.160012  4977 consensus_peers.cc:597] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.189896 30223 tablet_server.cc:196] TabletServer@127.29.131.193:0 shutdown complete.
W20260709 12:26:33.219446  4903 consensus_peers.cc:597] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.253041  4903 consensus_peers.cc:597] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.329596  4903 consensus_peers.cc:597] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.464547  4977 consensus_peers.cc:597] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.551393  4903 consensus_peers.cc:597] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.600330  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:34.297605  5156 raft_consensus.cc:493] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.298312  5156 raft_consensus.cc:515] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.300216  5156 leader_election.cc:290] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:34.301419  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
W20260709 12:26:34.304082  4903 leader_election.cc:336] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.304459  4903 leader_election.cc:304] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:34.305147  5156 raft_consensus.cc:2749] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.403838  5156 raft_consensus.cc:493] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.404371  5156 raft_consensus.cc:515] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.406481  5156 leader_election.cc:290] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:34.407581  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
W20260709 12:26:34.409113  4903 leader_election.cc:336] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.409451  4903 leader_election.cc:304] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:34.409988  5156 raft_consensus.cc:2749] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.476488  5155 raft_consensus.cc:493] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.477012  5155 raft_consensus.cc:515] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.479084  5155 leader_election.cc:290] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:34.480386  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:34.481202  4936 raft_consensus.cc:2468] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 1.
I20260709 12:26:34.482324  4974 leader_election.cc:304] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 
W20260709 12:26:34.483050  4977 leader_election.cc:336] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.483294  5155 raft_consensus.cc:2804] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:34.483703  5155 raft_consensus.cc:493] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.484062  5155 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.485253  5158 raft_consensus.cc:493] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.485795  5158 raft_consensus.cc:515] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.488040  5158 leader_election.cc:290] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:34.489073  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:34.489758  4936 raft_consensus.cc:2468] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 1.
I20260709 12:26:34.490815  4974 leader_election.cc:304] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:34.491562  5158 raft_consensus.cc:2804] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:34.491297  5155 raft_consensus.cc:515] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.492050  5158 raft_consensus.cc:493] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.492532  5158 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:34.492945  4977 leader_election.cc:336] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.493444  5155 leader_election.cc:290] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:34.494586  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:34.495257  4936 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:34.497303  4977 leader_election.cc:336] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.500080  5158 raft_consensus.cc:515] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.502218  5158 leader_election.cc:290] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:34.503374  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:34.503818  4936 raft_consensus.cc:2468] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:34.503988  4935 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.505064  4974 leader_election.cc:304] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece
I20260709 12:26:34.505702  5158 raft_consensus.cc:2804] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.506173  5158 raft_consensus.cc:697] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
W20260709 12:26:34.506307  4977 leader_election.cc:336] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.507117  5158 consensus_queue.cc:237] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.510846  4935 raft_consensus.cc:2468] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:34.511971  4974 leader_election.cc:304] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece
I20260709 12:26:34.512789  5158 raft_consensus.cc:2804] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.513309  5158 raft_consensus.cc:697] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:34.514336  5158 consensus_queue.cc:237] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.514990  4758 catalog_manager.cc:5697] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 1 to 2, leader changed from 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 2 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:34.531435  4758 catalog_manager.cc:5697] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 1 to 2, leader changed from 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 2 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:34.549647  5158 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.550239  5158 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.552098  5158 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:34.553335  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
W20260709 12:26:34.555485  4977 leader_election.cc:336] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.555902  4977 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:34.556521  5158 raft_consensus.cc:2749] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.562348  5156 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.562819  5156 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.564420  5156 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:34.565677  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
W20260709 12:26:34.568118  4903 leader_election.cc:336] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.568486  4903 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:34.569106  5156 raft_consensus.cc:2749] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:34.571477  5158 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.572052  5158 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.573762  5158 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:34.574847  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f" is_pre_election: true
I20260709 12:26:34.575593  4935 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:34.576455  4974 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:34.577116  5158 raft_consensus.cc:2804] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:34.577519  5158 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
W20260709 12:26:34.577652  4977 leader_election.cc:336] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.577929  5158 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.583045  5158 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.584815  5158 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:34.586012  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:34.586648  4935 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:34.588222  4977 leader_election.cc:336] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.592163  4935 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 3.
I20260709 12:26:34.593137  4974 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece
I20260709 12:26:34.593833  5158 raft_consensus.cc:2804] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:34.594283  5158 raft_consensus.cc:697] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:34.594985  5158 consensus_queue.cc:237] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.595504  5156 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.596083  5156 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.598263  5156 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:34.599948  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e" is_pre_election: true
I20260709 12:26:34.600726  5010 raft_consensus.cc:2468] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 1.
W20260709 12:26:34.601460  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:34.603942  4901 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:34.605605  5156 raft_consensus.cc:2804] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:34.606003  5156 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f2b6a9b07cf4d2789458f9bb8a9aece)
I20260709 12:26:34.606441  5156 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:34.607633  4903 leader_election.cc:336] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.610693  4758 catalog_manager.cc:5697] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 2 to 3, leader changed from 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 3 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:34.613940  5156 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.615947  5156 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:34.619632  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:34.620270  5010 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:34.620600  4903 leader_election.cc:336] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111)
I20260709 12:26:34.627275  5010 raft_consensus.cc:2468] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 2.
I20260709 12:26:34.628495  4901 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 7f2b6a9b07cf4d2789458f9bb8a9aece
I20260709 12:26:34.629184  5156 raft_consensus.cc:2804] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.630226  5156 raft_consensus.cc:697] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:34.630920  5156 consensus_queue.cc:237] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:34.637750  4758 catalog_manager.cc:5697] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 1 to 2, leader changed from 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 2 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.930109  4935 raft_consensus.cc:1275] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.931406  5158 consensus_queue.cc:1048] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:34.947625  4977 consensus_peers.cc:597] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:35.015833  4977 consensus_peers.cc:597] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.018254  4935 raft_consensus.cc:1275] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:35.019570  5171 consensus_queue.cc:1048] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:35.031396  4977 consensus_peers.cc:597] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.082427  4935 raft_consensus.cc:1275] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:35.083597  5158 consensus_queue.cc:1048] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:35.112902  4903 consensus_peers.cc:597] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.133067  5010 raft_consensus.cc:1275] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:35.134339  5156 consensus_queue.cc:1048] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:35.489136  4977 consensus_peers.cc:597] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.602444  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:35.744110  4903 consensus_peers.cc:597] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.801831  4903 consensus_peers.cc:597] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.958758  4903 consensus_peers.cc:597] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.044194  4903 consensus_peers.cc:597] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.081346  4977 consensus_peers.cc:597] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.603718  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:37.413335  4977 consensus_peers.cc:597] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.034024  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:38.044334  4977 consensus_peers.cc:597] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.058238  4977 consensus_peers.cc:597] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.060773  4977 consensus_peers.cc:597] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.194638  4903 consensus_peers.cc:597] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.201776  4903 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111) [suppressed 94 similar messages]
W20260709 12:26:38.433113  4903 consensus_peers.cc:597] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.460786  4903 consensus_peers.cc:597] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.467871  4903 consensus_peers.cc:597] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:38.968725 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:38.976794  5190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:38.976900  5189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:38.978957  5192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:38.978984 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:38.980837 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:38.981122 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:38.981334 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783599998981320 us; error 0 us; skew 500 ppm
I20260709 12:26:38.981927 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:38.985577 30223 webserver.cc:533] Webserver started at http://127.29.131.193:37995/ using document root <none> and password file <none>
I20260709 12:26:38.986148 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:38.986477 30223 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:26:38.990609 30223 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:26:38.994935  5197 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.995873 30223 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:26:38.996212 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-n640"
I20260709 12:26:38.996628 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:39.009889 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:39.011341 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:39.012928 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:39.018177  5204 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:26:39.025960  5032 debug-util.cc:398] Leaking SignalData structure 0x7b080004ffe0 after lost signal to thread 30226
W20260709 12:26:39.027205  5032 debug-util.cc:398] Leaking SignalData structure 0x7b0800240640 after lost signal to thread 4794
W20260709 12:26:39.028597  5032 debug-util.cc:398] Leaking SignalData structure 0x7b080027d4c0 after lost signal to thread 4961
W20260709 12:26:39.029805  5032 debug-util.cc:398] Leaking SignalData structure 0x7b0800235e60 after lost signal to thread 5035
W20260709 12:26:39.035120  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:39.098201 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:26:39.098623 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.082s	user 0.003s	sys 0.000s
I20260709 12:26:39.098977 30223 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:26:39.107070  5204 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:39.132753  5204 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.133761  5204 tablet_bootstrap.cc:492] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.134433  5204 ts_tablet_manager.cc:1403] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.006s
I20260709 12:26:39.137216  5204 raft_consensus.cc:359] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.137982  5204 raft_consensus.cc:740] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.138759  5204 consensus_queue.cc:260] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.141645  5204 ts_tablet_manager.cc:1434] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 12:26:39.142557  5204 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:39.157073 30223 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:26:39.157478 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.059s	user 0.057s	sys 0.000s
I20260709 12:26:39.161332  5204 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.162467  5204 tablet_bootstrap.cc:492] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.163260  5204 ts_tablet_manager.cc:1403] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:26:39.166486  5204 raft_consensus.cc:359] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.167490  5204 raft_consensus.cc:740] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.168476  5204 consensus_queue.cc:260] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.171131  5204 ts_tablet_manager.cc:1434] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:26:39.172143  5204 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
W20260709 12:26:39.194592  4977 consensus_peers.cc:597] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:39.201536  5204 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.204250  5204 tablet_bootstrap.cc:492] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.204991  5204 ts_tablet_manager.cc:1403] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.016s
I20260709 12:26:39.208434  5204 raft_consensus.cc:359] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.209239  5204 raft_consensus.cc:740] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.210078  5204 consensus_queue.cc:260] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.212123  5204 ts_tablet_manager.cc:1434] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:39.212975  5204 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
W20260709 12:26:39.232808  4903 consensus_peers.cc:597] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:39.240156  5204 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.241237  5204 tablet_bootstrap.cc:492] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.241883  5204 ts_tablet_manager.cc:1403] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.010s
I20260709 12:26:39.245316  5204 raft_consensus.cc:359] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.246202  5204 raft_consensus.cc:740] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.247076  5204 consensus_queue.cc:260] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.249766  5204 ts_tablet_manager.cc:1434] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 12:26:39.250903  5204 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:39.267494  5204 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.268545  5204 tablet_bootstrap.cc:492] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.269236  5204 ts_tablet_manager.cc:1403] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:26:39.271946  5204 raft_consensus.cc:359] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.272733  5204 raft_consensus.cc:740] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.273638  5204 consensus_queue.cc:260] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.275887  5204 ts_tablet_manager.cc:1434] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:39.276736  5204 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:39.291319  5204 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.292306  5204 tablet_bootstrap.cc:492] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.292408 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:43787
I20260709 12:26:39.292636  5269 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:43787 every 8 connection(s)
I20260709 12:26:39.293046  5204 ts_tablet_manager.cc:1403] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:26:39.295313  5204 raft_consensus.cc:359] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.295842  5204 raft_consensus.cc:740] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.296527  5204 consensus_queue.cc:260] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.298846  5204 ts_tablet_manager.cc:1434] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:26:39.299700  5204 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:39.308632 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:39.324218  5204 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.325579  5204 tablet_bootstrap.cc:492] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.326437  5204 ts_tablet_manager.cc:1403] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.004s
I20260709 12:26:39.329944  5204 raft_consensus.cc:359] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.330798  5204 raft_consensus.cc:740] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.331899  5204 consensus_queue.cc:260] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.334820  5204 ts_tablet_manager.cc:1434] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:26:39.335934  5204 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:39.355181  5204 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.356252  5204 tablet_bootstrap.cc:492] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.356932  5204 ts_tablet_manager.cc:1403] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:26:39.357065  5010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
mode: GRACEFUL
new_leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60650
I20260709 12:26:39.357918  5010 raft_consensus.cc:606] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Received request to transfer leadership to TS b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:39.359544  5204 raft_consensus.cc:359] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.360286  5204 raft_consensus.cc:740] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.361188  5204 consensus_queue.cc:260] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.363442  5204 ts_tablet_manager.cc:1434] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:39.363898  5270 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36467
I20260709 12:26:39.364238  5204 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:39.364310  5270 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:39.365410  5270 heartbeater.cc:507] Master 127.29.131.254:36467 requested a full tablet report, sending...
I20260709 12:26:39.372762  4759 ts_manager.cc:194] Re-registered known tserver with Master: 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787)
I20260709 12:26:39.376899  4935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
mode: GRACEFUL
new_leader_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:51368
I20260709 12:26:39.377637  4935 raft_consensus.cc:606] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Received request to transfer leadership to TS bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:39.381455  5010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
mode: GRACEFUL
new_leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60650
I20260709 12:26:39.382241  5010 raft_consensus.cc:606] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Received request to transfer leadership to TS b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:39.383948 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:39.385569 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:39.386560 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:39.391746  5204 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.392725  5204 tablet_bootstrap.cc:492] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.393348  5204 ts_tablet_manager.cc:1403] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.003s
I20260709 12:26:39.395918  5204 raft_consensus.cc:359] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.396564  5204 raft_consensus.cc:740] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.397243  5204 consensus_queue.cc:260] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.398445  4759 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43212
I20260709 12:26:39.399453  5204 ts_tablet_manager.cc:1434] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:39.400655  5204 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap starting.
I20260709 12:26:39.401278  5181 raft_consensus.cc:993] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e: : Instructing follower b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:39.401796  5181 raft_consensus.cc:1081] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Signalling peer b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:39.403002  5270 heartbeater.cc:499] Master 127.29.131.254:36467 was elected leader, sending a full tablet report...
I20260709 12:26:39.403717  4935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:26:39.404378  4935 raft_consensus.cc:493] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:39.404848  4935 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.412849  4935 raft_consensus.cc:515] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.421257  4935 leader_election.cc:290] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:39.422385  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:39.423046  5010 raft_consensus.cc:3055] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.423455  5010 raft_consensus.cc:740] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:39.424396  5010 consensus_queue.cc:260] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.425860  5010 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.435688  5010 raft_consensus.cc:2468] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 2.
I20260709 12:26:39.437105  4901 leader_election.cc:304] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:39.437824  5204 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:39.438251  5179 raft_consensus.cc:2804] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.438825  5179 raft_consensus.cc:697] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:39.439796  5179 consensus_queue.cc:237] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.439000  5204 tablet_bootstrap.cc:492] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Bootstrap complete.
I20260709 12:26:39.441349  5204 ts_tablet_manager.cc:1403] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.016s
I20260709 12:26:39.444235  5204 raft_consensus.cc:359] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.447475  5204 raft_consensus.cc:740] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f2b6a9b07cf4d2789458f9bb8a9aece, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.448184  5204 consensus_queue.cc:260] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.450372  5204 ts_tablet_manager.cc:1434] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:39.452495  4758 catalog_manager.cc:5697] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 1 to 2, leader changed from bd882edfca2b46aca0d0e66278597e9e (127.29.131.195) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 2 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.455668  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:39.456386  5239 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.464502  5240 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.479125  5239 raft_consensus.cc:2468] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 2.
I20260709 12:26:39.508263  5240 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.551808  5240 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.638567  5240 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.685232  5205 raft_consensus.cc:993] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e: : Instructing follower b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:39.685791  5205 raft_consensus.cc:1081] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Signalling peer b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:39.687493  5249 raft_consensus.cc:993] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f: : Instructing follower bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:39.687943  4935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:26:39.688048  5249 raft_consensus.cc:1081] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Signalling peer bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:39.688786  4935 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:39.689291  4935 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.690227  5010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:41530
I20260709 12:26:39.690871  5010 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:39.691298  5010 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.699656  4935 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.701543  5010 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.702049  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:39.702909  5240 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.703553  4935 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 4 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:39.703754  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:39.704428  5009 raft_consensus.cc:3055] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:39.704828  5009 raft_consensus.cc:740] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:39.704720  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:39.705494  5239 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.705861  5009 consensus_queue.cc:260] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.707325  5009 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.711024  5240 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 4.
I20260709 12:26:39.712282  4903 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:39.712947  5239 raft_consensus.cc:2468] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 3.
I20260709 12:26:39.713152  5249 raft_consensus.cc:2804] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:39.713781  5249 raft_consensus.cc:697] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 4 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:39.714336  4977 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:39.715281  5181 raft_consensus.cc:2804] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:39.715200  5009 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 4.
I20260709 12:26:39.715996  5181 raft_consensus.cc:697] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:39.714737  5249 consensus_queue.cc:237] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.716955  5181 consensus_queue.cc:237] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.722415  5010 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:39.723686  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:39.724399  4935 raft_consensus.cc:3055] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.724812  4935 raft_consensus.cc:740] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:39.725736  4935 consensus_queue.cc:260] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:39.725162  4759 catalog_manager.cc:5697] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 3 to 4, leader changed from bd882edfca2b46aca0d0e66278597e9e (127.29.131.195) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 4 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.727049  4935 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.728156  4758 catalog_manager.cc:5697] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 2 to 3, leader changed from b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 3 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.735929  4935 raft_consensus.cc:2468] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 3.
I20260709 12:26:39.997711  5010 raft_consensus.cc:1275] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.999157  5297 consensus_queue.cc:1048] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.023718  5240 raft_consensus.cc:1275] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.025604  5295 consensus_queue.cc:1048] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:40.036271  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:40.116812  5010 raft_consensus.cc:1275] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:40.118151  5295 consensus_queue.cc:1048] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.128631  5240 raft_consensus.cc:1275] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:40.130097  5249 consensus_queue.cc:1048] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.203157  4935 raft_consensus.cc:1275] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:40.205080  5303 consensus_queue.cc:1048] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:40.206559  5239 raft_consensus.cc:1275] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:40.208413  5303 consensus_queue.cc:1048] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:40.398008 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:40.406581  4936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
mode: GRACEFUL
new_leader_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:51368
I20260709 12:26:40.407359  4936 raft_consensus.cc:606] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Received request to transfer leadership to TS bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:40.410418  5010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
mode: GRACEFUL
new_leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60650
I20260709 12:26:40.410928  5010 raft_consensus.cc:606] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Received request to transfer leadership to TS b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:40.413522  4936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
mode: GRACEFUL
new_leader_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:51368
I20260709 12:26:40.414109  4936 raft_consensus.cc:606] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 4 LEADER]: Received request to transfer leadership to TS bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:40.415398 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:40.415889 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:40.416441 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:40.566540  5297 raft_consensus.cc:993] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f: : Instructing follower bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:40.567091  5249 raft_consensus.cc:1081] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Signalling peer bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:40.568753  5010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:41530
I20260709 12:26:40.569244  5010 raft_consensus.cc:493] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.569553  5010 raft_consensus.cc:3060] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.574321  5010 raft_consensus.cc:515] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.575984  5010 leader_election.cc:290] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Requested vote from peers b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847), 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787)
I20260709 12:26:40.576876  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:40.577165  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2844196e09f547febbcfda9dbcc908f2" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:40.577623  4936 raft_consensus.cc:3055] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.577862  5240 raft_consensus.cc:3060] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.578111  4936 raft_consensus.cc:740] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:40.579325  4936 consensus_queue.cc:260] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.580740  4936 raft_consensus.cc:3060] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.584867  5240 raft_consensus.cc:2468] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:40.585925  4977 leader_election.cc:304] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:40.586619  5303 raft_consensus.cc:2804] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.587119  5303 raft_consensus.cc:697] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:40.588100  5303 consensus_queue.cc:237] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.588980  4936 raft_consensus.cc:2468] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:40.596581  4759 catalog_manager.cc:5697] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 1 to 2, leader changed from b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 2 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.636763  5297 raft_consensus.cc:993] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f: : Instructing follower bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:40.637269  5249 raft_consensus.cc:1081] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 4 LEADER]: Signalling peer bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:40.638731  5010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:41530
I20260709 12:26:40.639207  5010 raft_consensus.cc:493] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.639554  5010 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.645144  5010 raft_consensus.cc:515] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.647053  5010 leader_election.cc:290] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 5 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:40.647403  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:40.647830  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78f8af4c624113bf61a0b4c5e954ee" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:40.648136  5240 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.648523  4936 raft_consensus.cc:3055] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:40.648864  4936 raft_consensus.cc:740] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:40.649597  4936 consensus_queue.cc:260] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.650591  4936 raft_consensus.cc:3060] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.656106  4936 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 5.
I20260709 12:26:40.655968  5240 raft_consensus.cc:2468] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 5.
I20260709 12:26:40.657392  4977 leader_election.cc:304] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:40.658179  5303 raft_consensus.cc:2804] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:40.658687  5303 raft_consensus.cc:697] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 5 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:40.659605  5303 consensus_queue.cc:237] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.666854  4759 catalog_manager.cc:5697] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 4 to 5, leader changed from b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 5 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.788691  5181 raft_consensus.cc:993] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e: : Instructing follower b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:40.789156  5303 raft_consensus.cc:1081] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Signalling peer b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:40.790803  4936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:26:40.791374  4936 raft_consensus.cc:493] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.791690  4936 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.796918  4936 raft_consensus.cc:515] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.798677  4936 leader_election.cc:290] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:40.799583  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:40.799964  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4189e77ec0394a87ace96fd3548b727f" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:40.800242  5240 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.800594  5010 raft_consensus.cc:3055] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:40.800904  5010 raft_consensus.cc:740] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:40.801658  5010 consensus_queue.cc:260] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.802802  5010 raft_consensus.cc:3060] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.807029  5240 raft_consensus.cc:2468] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 3.
I20260709 12:26:40.808358  4903 leader_election.cc:304] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:40.809106  5249 raft_consensus.cc:2804] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.809441  5010 raft_consensus.cc:2468] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 3.
I20260709 12:26:40.809619  5249 raft_consensus.cc:697] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:40.810751  5249 consensus_queue.cc:237] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:40.818773  4759 catalog_manager.cc:5697] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 2 to 3, leader changed from bd882edfca2b46aca0d0e66278597e9e (127.29.131.195) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 3 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:41.037477  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:41.089380  4936 raft_consensus.cc:1275] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.095213  5181 consensus_queue.cc:1048] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:41.117174  5240 raft_consensus.cc:1275] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.118809  5181 consensus_queue.cc:1048] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.139866  4936 raft_consensus.cc:1275] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 5 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:41.142097  5181 consensus_queue.cc:1048] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:41.162806  5240 raft_consensus.cc:1275] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 5 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:41.164692  5303 consensus_queue.cc:1048] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:41.265748  5010 raft_consensus.cc:1275] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:41.267556  5249 consensus_queue.cc:1048] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:41.283893  5240 raft_consensus.cc:1275] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:41.287774  5297 consensus_queue.cc:1048] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:41.423540 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:41.439157  4936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
mode: GRACEFUL
new_leader_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:51368
I20260709 12:26:41.440039  4936 raft_consensus.cc:606] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Received request to transfer leadership to TS bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:41.443856  5010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
mode: GRACEFUL
new_leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60650
I20260709 12:26:41.444379  5010 raft_consensus.cc:606] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Received request to transfer leadership to TS b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:41.447706  5010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
mode: GRACEFUL
new_leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60650
I20260709 12:26:41.448257  5010 raft_consensus.cc:606] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Received request to transfer leadership to TS b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:41.449558 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:41.450140 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:41.451217 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:41.626626  5312 raft_consensus.cc:993] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e: : Instructing follower b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:41.627137  5181 raft_consensus.cc:1081] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Signalling peer b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:41.629081  4936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:26:41.629683  4936 raft_consensus.cc:493] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:41.630038  4936 raft_consensus.cc:3060] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.637992  4936 raft_consensus.cc:515] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.640317  4936 leader_election.cc:290] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:41.641372  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:41.641611  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a23239ef6845e089d021769a95ed83" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:41.642269  5239 raft_consensus.cc:3060] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.642319  5010 raft_consensus.cc:3055] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:41.642979  5010 raft_consensus.cc:740] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:41.644122  5010 consensus_queue.cc:260] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.645365  5010 raft_consensus.cc:3060] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.653959  5239 raft_consensus.cc:2468] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 2.
I20260709 12:26:41.655400  5010 raft_consensus.cc:2468] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 2.
I20260709 12:26:41.655499  4903 leader_election.cc:304] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:41.656620  5297 raft_consensus.cc:2804] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:41.657155  5297 raft_consensus.cc:697] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:41.658207  5297 consensus_queue.cc:237] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.666718  4759 catalog_manager.cc:5697] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 1 to 2, leader changed from bd882edfca2b46aca0d0e66278597e9e (127.29.131.195) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 2 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.722259  5312 raft_consensus.cc:993] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e: : Instructing follower b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:41.722765  5181 raft_consensus.cc:1081] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Signalling peer b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:41.724368  4936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:26:41.724836  4936 raft_consensus.cc:493] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:41.725155  4936 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.730013  4936 raft_consensus.cc:515] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.731974  4936 leader_election.cc:290] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:41.732537  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:41.732385  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d643ecda3bc7487b813de68ef99fb96a" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:41.733116  5010 raft_consensus.cc:3055] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:41.733331  5010 raft_consensus.cc:740] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:41.733327  5239 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.734547  5010 consensus_queue.cc:260] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.735991  5010 raft_consensus.cc:3060] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.741147  5239 raft_consensus.cc:2468] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 3.
I20260709 12:26:41.742329  4903 leader_election.cc:304] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:41.743296  5322 raft_consensus.cc:2804] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:41.743872  5322 raft_consensus.cc:697] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:41.743908  5010 raft_consensus.cc:2468] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 3.
I20260709 12:26:41.745244  5322 consensus_queue.cc:237] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.747859  5323 raft_consensus.cc:993] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f: : Instructing follower bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:41.748383  5297 raft_consensus.cc:1081] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Signalling peer bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:41.749979  5010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:41530
I20260709 12:26:41.750535  5010 raft_consensus.cc:493] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:41.750887  5010 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.755131  4759 catalog_manager.cc:5697] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 2 to 3, leader changed from bd882edfca2b46aca0d0e66278597e9e (127.29.131.195) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 3 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.757331  5010 raft_consensus.cc:515] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.760298  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:41.760499  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:41.761112  4936 raft_consensus.cc:3055] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:41.761137  5239 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.761898  4936 raft_consensus.cc:740] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:41.762876  4936 consensus_queue.cc:260] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.763862  4936 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.761518  5010 leader_election.cc:290] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:41.769198  4936 raft_consensus.cc:2468] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:41.770457  4974 leader_election.cc:304] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5f4fb663a49499fa17618b9e121ee4f, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:41.771170  5181 raft_consensus.cc:2804] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:41.771692  5181 raft_consensus.cc:697] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:41.772610  5181 consensus_queue.cc:237] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:41.776176  5239 raft_consensus.cc:2468] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:41.782516  4759 catalog_manager.cc:5697] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 1 to 2, leader changed from b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 2 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:42.038790  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:42.083033  5010 raft_consensus.cc:1275] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:42.084576  5323 consensus_queue.cc:1048] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:42.104462  5239 raft_consensus.cc:1275] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:42.105715  5323 consensus_queue.cc:1048] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:42.210927  4936 raft_consensus.cc:1275] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:42.212409  5312 consensus_queue.cc:1048] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:42.222090  5239 raft_consensus.cc:1275] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:42.223961  5181 consensus_queue.cc:1048] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:42.248842  5010 raft_consensus.cc:1275] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:42.250013  5323 consensus_queue.cc:1048] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:42.261461  5239 raft_consensus.cc:1275] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:42.263785  5322 consensus_queue.cc:1048] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:42.458688 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:42.465909  5010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
mode: GRACEFUL
new_leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60650
I20260709 12:26:42.466434  5010 raft_consensus.cc:606] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Received request to transfer leadership to TS b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:42.469065  4936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9890be6830e48bda79ded614ec90293"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
mode: GRACEFUL
new_leader_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:51368
I20260709 12:26:42.469517  4936 raft_consensus.cc:606] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Received request to transfer leadership to TS bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:42.471912  4936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
mode: GRACEFUL
new_leader_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:51368
I20260709 12:26:42.472299  4936 raft_consensus.cc:606] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Received request to transfer leadership to TS bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:42.473335 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:42.473806 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:42.474284 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:42.634945  5323 raft_consensus.cc:993] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f: : Instructing follower bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:42.635496  5322 raft_consensus.cc:1081] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Signalling peer bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:42.637259  5010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9890be6830e48bda79ded614ec90293"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:41530
I20260709 12:26:42.637895  5010 raft_consensus.cc:493] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:42.638293  5010 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:42.643203  5010 raft_consensus.cc:515] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.644615  5010 leader_election.cc:290] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:42.645341  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:42.645625  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:42.646036  5239 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:42.646234  4936 raft_consensus.cc:3055] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:42.646649  4936 raft_consensus.cc:740] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:42.647488  4936 consensus_queue.cc:260] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.648674  4936 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:42.652408  5239 raft_consensus.cc:2468] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:42.653729  4977 leader_election.cc:304] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:42.654465  5181 raft_consensus.cc:2804] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:42.654928  5181 raft_consensus.cc:697] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:42.654914  4936 raft_consensus.cc:2468] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 2.
I20260709 12:26:42.656162  5181 consensus_queue.cc:237] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.664024  4759 catalog_manager.cc:5697] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 1 to 2, leader changed from b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 2 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:42.674448  5323 raft_consensus.cc:993] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f: : Instructing follower bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:42.674981  5322 raft_consensus.cc:1081] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Signalling peer bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:42.676573  5010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:41530
I20260709 12:26:42.677083  5010 raft_consensus.cc:493] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:42.677453  5010 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.682734  5010 raft_consensus.cc:515] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.684119  5010 leader_election.cc:290] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:42.685063  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:42.685218  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f147db3c2f4fe0a64896bcd40d0d3e" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:42.685786  5239 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.685782  4936 raft_consensus.cc:3055] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:42.686371  4936 raft_consensus.cc:740] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:42.687064  4936 consensus_queue.cc:260] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.688083  4936 raft_consensus.cc:3060] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.691699  5239 raft_consensus.cc:2468] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 3.
I20260709 12:26:42.692473  4936 raft_consensus.cc:2468] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 3.
I20260709 12:26:42.692788  4977 leader_election.cc:304] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:42.693661  5181 raft_consensus.cc:2804] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:42.694126  5181 raft_consensus.cc:697] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:42.695040  5181 consensus_queue.cc:237] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.701928  4759 catalog_manager.cc:5697] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 2 to 3, leader changed from b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 3 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:42.750798  5338 raft_consensus.cc:993] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e: : Instructing follower b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:42.751310  5181 raft_consensus.cc:1081] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Signalling peer b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:42.752902  4936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:26:42.753414  4936 raft_consensus.cc:493] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:42.753688  4936 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.760416  4936 raft_consensus.cc:515] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.762216  4936 leader_election.cc:290] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:42.763075  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:42.763217  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:42.763775  5239 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.763809  5010 raft_consensus.cc:3055] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:42.764199  5010 raft_consensus.cc:740] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:42.764876  5010 consensus_queue.cc:260] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.765934  5010 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.770166  5239 raft_consensus.cc:2468] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 3.
I20260709 12:26:42.771449  4903 leader_election.cc:304] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:42.771660  5010 raft_consensus.cc:2468] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 3.
I20260709 12:26:42.772315  5322 raft_consensus.cc:2804] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:42.772789  5322 raft_consensus.cc:697] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:42.773530  5322 consensus_queue.cc:237] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:42.779954  4759 catalog_manager.cc:5697] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 2 to 3, leader changed from bd882edfca2b46aca0d0e66278597e9e (127.29.131.195) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 3 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:43.039933  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:43.105629  4936 raft_consensus.cc:1275] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:43.107092  5181 consensus_queue.cc:1048] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:43.113966  4936 raft_consensus.cc:1275] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:43.119781  5181 consensus_queue.cc:1048] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.120296  5239 raft_consensus.cc:1275] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:43.122008  5338 consensus_queue.cc:1048] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:43.133401  5240 raft_consensus.cc:1275] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:43.135283  5349 consensus_queue.cc:1048] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.202919  5239 raft_consensus.cc:1275] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:43.204203  5297 consensus_queue.cc:1048] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.211997  5010 raft_consensus.cc:1275] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:43.213445  5323 consensus_queue.cc:1048] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.480460 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:43.489538  4936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
mode: GRACEFUL
new_leader_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:51368
I20260709 12:26:43.490218  4936 raft_consensus.cc:606] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Received request to transfer leadership to TS bd882edfca2b46aca0d0e66278597e9e
I20260709 12:26:43.492738  5010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9890be6830e48bda79ded614ec90293"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
mode: GRACEFUL
new_leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60650
I20260709 12:26:43.493222  5010 raft_consensus.cc:606] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Received request to transfer leadership to TS b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:43.495560  5010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
mode: GRACEFUL
new_leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60650
I20260709 12:26:43.496057  5010 raft_consensus.cc:606] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Received request to transfer leadership to TS b5f4fb663a49499fa17618b9e121ee4f
I20260709 12:26:43.497087 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:43.497563 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:43.498167 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:43.632932  5349 raft_consensus.cc:993] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e: : Instructing follower b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:43.633373  5181 raft_consensus.cc:1081] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Signalling peer b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:43.634976  4936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:26:43.635500  4936 raft_consensus.cc:493] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.635777  4936 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.640547  4936 raft_consensus.cc:515] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.641911  4936 leader_election.cc:290] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 4 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:43.642946  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:43.643261  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797bc65a873405cabf67f542a11c8db" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:43.643548  5010 raft_consensus.cc:3055] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.643894  5010 raft_consensus.cc:740] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:43.643950  5239 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.645068  5010 consensus_queue.cc:260] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.646423  5010 raft_consensus.cc:3060] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.652097  5239 raft_consensus.cc:2468] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 4.
I20260709 12:26:43.653427  4903 leader_election.cc:304] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:43.653505  5010 raft_consensus.cc:2468] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 4.
I20260709 12:26:43.654126  5323 raft_consensus.cc:2804] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.654599  5323 raft_consensus.cc:697] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 4 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:43.655982  5323 consensus_queue.cc:237] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.658545  5338 raft_consensus.cc:993] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e: : Instructing follower b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:43.659127  5181 raft_consensus.cc:1081] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Signalling peer b5f4fb663a49499fa17618b9e121ee4f to start an election
I20260709 12:26:43.661190  4936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9890be6830e48bda79ded614ec90293"
dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:26:43.661644  4936 raft_consensus.cc:493] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.661998  4936 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.664364  4757 catalog_manager.cc:5697] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 3 to 4, leader changed from bd882edfca2b46aca0d0e66278597e9e (127.29.131.195) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 4 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.666867  4936 raft_consensus.cc:515] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.669245  4936 leader_election.cc:290] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), bd882edfca2b46aca0d0e66278597e9e (127.29.131.195:39505)
I20260709 12:26:43.669945  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:43.670388  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9890be6830e48bda79ded614ec90293" candidate_uuid: "b5f4fb663a49499fa17618b9e121ee4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
I20260709 12:26:43.670701  5239 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.671029  5010 raft_consensus.cc:3055] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:43.671430  5010 raft_consensus.cc:740] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:43.672248  5010 consensus_queue.cc:260] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.673518  5010 raft_consensus.cc:3060] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.678438  5239 raft_consensus.cc:2468] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 3.
I20260709 12:26:43.679828  4903 leader_election.cc:304] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, b5f4fb663a49499fa17618b9e121ee4f; no voters: 
I20260709 12:26:43.680651  5323 raft_consensus.cc:2804] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:43.681102  5010 raft_consensus.cc:2468] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f4fb663a49499fa17618b9e121ee4f in term 3.
I20260709 12:26:43.681150  5323 raft_consensus.cc:697] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Becoming Leader. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:43.682313  5323 consensus_queue.cc:237] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.688824  4757 catalog_manager.cc:5697] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f reported cstate change: term changed from 2 to 3, leader changed from bd882edfca2b46aca0d0e66278597e9e (127.29.131.195) to b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194). New cstate: current_term: 3 leader_uuid: "b5f4fb663a49499fa17618b9e121ee4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.841398  5356 raft_consensus.cc:993] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f: : Instructing follower bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:43.841941  5361 raft_consensus.cc:1081] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Signalling peer bd882edfca2b46aca0d0e66278597e9e to start an election
I20260709 12:26:43.843408  5010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5"
dest_uuid: "bd882edfca2b46aca0d0e66278597e9e"
 from {username='slave'} at 127.0.0.1:41530
I20260709 12:26:43.843955  5010 raft_consensus.cc:493] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.844322  5010 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.849254  5010 raft_consensus.cc:515] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.850742  5010 leader_election.cc:290] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 4 election: Requested vote from peers 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787), b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847)
I20260709 12:26:43.851619  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece"
I20260709 12:26:43.851820  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f70a12410402e9cc3921c92192dc5" candidate_uuid: "bd882edfca2b46aca0d0e66278597e9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b5f4fb663a49499fa17618b9e121ee4f"
I20260709 12:26:43.852236  5239 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.852304  4936 raft_consensus.cc:3055] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.852682  4936 raft_consensus.cc:740] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f4fb663a49499fa17618b9e121ee4f, State: Running, Role: LEADER
I20260709 12:26:43.853403  4936 consensus_queue.cc:260] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.854511  4936 raft_consensus.cc:3060] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.858666  5239 raft_consensus.cc:2468] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 4.
I20260709 12:26:43.859790  4977 leader_election.cc:304] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f2b6a9b07cf4d2789458f9bb8a9aece, bd882edfca2b46aca0d0e66278597e9e; no voters: 
I20260709 12:26:43.860534  5181 raft_consensus.cc:2804] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.860743  4936 raft_consensus.cc:2468] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd882edfca2b46aca0d0e66278597e9e in term 4.
I20260709 12:26:43.861022  5181 raft_consensus.cc:697] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 4 LEADER]: Becoming Leader. State: Replica: bd882edfca2b46aca0d0e66278597e9e, State: Running, Role: LEADER
I20260709 12:26:43.861989  5181 consensus_queue.cc:237] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } }
I20260709 12:26:43.868490  4757 catalog_manager.cc:5697] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e reported cstate change: term changed from 3 to 4, leader changed from b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194) to bd882edfca2b46aca0d0e66278597e9e (127.29.131.195). New cstate: current_term: 4 leader_uuid: "bd882edfca2b46aca0d0e66278597e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:44.040910  4808 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:44.065448  5010 raft_consensus.cc:1275] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:44.066759  5361 consensus_queue.cc:1048] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:44.074658  5239 raft_consensus.cc:1275] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:44.076937  5361 consensus_queue.cc:1048] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:44.080719  5239 raft_consensus.cc:1275] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:44.084014  5361 consensus_queue.cc:1048] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:44.096180  5010 raft_consensus.cc:1275] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Refusing update from remote peer b5f4fb663a49499fa17618b9e121ee4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:44.097977  5368 consensus_queue.cc:1048] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd882edfca2b46aca0d0e66278597e9e" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:44.275816  5239 raft_consensus.cc:1275] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:44.277016  5338 consensus_queue.cc:1048] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f2b6a9b07cf4d2789458f9bb8a9aece" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:44.285215  4936 raft_consensus.cc:1275] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Refusing update from remote peer bd882edfca2b46aca0d0e66278597e9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:44.287107  5338 consensus_queue.cc:1048] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f4fb663a49499fa17618b9e121ee4f" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:44.504823 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.534761 30223 tablet_server.cc:179] TabletServer@127.29.131.193:43787 shutting down...
W20260709 12:26:44.538959  4903 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 21 similar messages]
W20260709 12:26:44.543082  4903 consensus_peers.cc:597] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.562897 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:44.563817 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.564971 30223 raft_consensus.cc:2243] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.565609 30223 raft_consensus.cc:2272] T 4189e77ec0394a87ace96fd3548b727f P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.568001 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.568534 30223 raft_consensus.cc:2243] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.568903 30223 raft_consensus.cc:2272] T 2844196e09f547febbcfda9dbcc908f2 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.570868 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.571476 30223 raft_consensus.cc:2243] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.571907 30223 raft_consensus.cc:2272] T d643ecda3bc7487b813de68ef99fb96a P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.573910 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.574433 30223 raft_consensus.cc:2243] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.574854 30223 raft_consensus.cc:2272] T b797bc65a873405cabf67f542a11c8db P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.578434 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.579280 30223 raft_consensus.cc:2243] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.579788 30223 raft_consensus.cc:2272] T 7b78f8af4c624113bf61a0b4c5e954ee P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.582175 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.582719 30223 raft_consensus.cc:2243] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.583173 30223 raft_consensus.cc:2272] T e7f147db3c2f4fe0a64896bcd40d0d3e P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.585390 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.585920 30223 raft_consensus.cc:2243] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.586333 30223 raft_consensus.cc:2272] T a81f70a12410402e9cc3921c92192dc5 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.588913 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.589514 30223 raft_consensus.cc:2243] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.589937 30223 raft_consensus.cc:2272] T c4a23239ef6845e089d021769a95ed83 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.592310 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.592991 30223 raft_consensus.cc:2243] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.593532 30223 raft_consensus.cc:2272] T a9890be6830e48bda79ded614ec90293 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.596700 30223 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:44.597296 30223 raft_consensus.cc:2243] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.597720 30223 raft_consensus.cc:2272] T 45dde00fc1134422a7c5e40a01a3e4e0 P 7f2b6a9b07cf4d2789458f9bb8a9aece [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.625006  4903 consensus_peers.cc:597] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.632576 30223 tablet_server.cc:196] TabletServer@127.29.131.193:43787 shutdown complete.
W20260709 12:26:44.653216  4977 consensus_peers.cc:597] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.664072 30223 tablet_server.cc:179] TabletServer@127.29.131.194:0 shutting down...
W20260709 12:26:44.672096  4977 consensus_peers.cc:597] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.673245  4974 consensus_peers.cc:597] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e -> Peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Couldn't send request to peer b5f4fb663a49499fa17618b9e121ee4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.676723  4977 consensus_peers.cc:597] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.680831  4903 consensus_peers.cc:597] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f -> Peer 7f2b6a9b07cf4d2789458f9bb8a9aece (127.29.131.193:43787): Couldn't send request to peer 7f2b6a9b07cf4d2789458f9bb8a9aece. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.696480 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:44.697383 30223 tablet_replica.cc:333] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.698508 30223 raft_consensus.cc:2243] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.699555 30223 raft_consensus.cc:2272] T b797bc65a873405cabf67f542a11c8db P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.702083 30223 tablet_replica.cc:333] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.702702 30223 raft_consensus.cc:2243] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.703104 30223 raft_consensus.cc:2272] T 7b78f8af4c624113bf61a0b4c5e954ee P b5f4fb663a49499fa17618b9e121ee4f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.705019 30223 tablet_replica.cc:333] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.705489 30223 raft_consensus.cc:2243] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.706255 30223 raft_consensus.cc:2272] T 45dde00fc1134422a7c5e40a01a3e4e0 P b5f4fb663a49499fa17618b9e121ee4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.708664 30223 tablet_replica.cc:333] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.709358 30223 raft_consensus.cc:2243] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.710296 30223 raft_consensus.cc:2272] T c4a23239ef6845e089d021769a95ed83 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.712522 30223 tablet_replica.cc:333] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.713187 30223 raft_consensus.cc:2243] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.713922 30223 raft_consensus.cc:2272] T a9890be6830e48bda79ded614ec90293 P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.716564 30223 tablet_replica.cc:333] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.717253 30223 raft_consensus.cc:2243] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.717972 30223 raft_consensus.cc:2272] T d643ecda3bc7487b813de68ef99fb96a P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.720225 30223 tablet_replica.cc:333] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.720754 30223 raft_consensus.cc:2243] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.721210 30223 raft_consensus.cc:2272] T 2844196e09f547febbcfda9dbcc908f2 P b5f4fb663a49499fa17618b9e121ee4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.723333 30223 tablet_replica.cc:333] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.723850 30223 raft_consensus.cc:2243] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.724598 30223 raft_consensus.cc:2272] T 4189e77ec0394a87ace96fd3548b727f P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.726754 30223 tablet_replica.cc:333] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.727373 30223 raft_consensus.cc:2243] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.727792 30223 raft_consensus.cc:2272] T e7f147db3c2f4fe0a64896bcd40d0d3e P b5f4fb663a49499fa17618b9e121ee4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.729995 30223 tablet_replica.cc:333] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f: stopping tablet replica
I20260709 12:26:44.730706 30223 raft_consensus.cc:2243] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.731143 30223 raft_consensus.cc:2272] T a81f70a12410402e9cc3921c92192dc5 P b5f4fb663a49499fa17618b9e121ee4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.764389 30223 tablet_server.cc:196] TabletServer@127.29.131.194:0 shutdown complete.
W20260709 12:26:44.784929  4974 consensus_peers.cc:597] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e -> Peer b5f4fb663a49499fa17618b9e121ee4f (127.29.131.194:44847): Couldn't send request to peer b5f4fb663a49499fa17618b9e121ee4f. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:44847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.790347 30223 tablet_server.cc:179] TabletServer@127.29.131.195:0 shutting down...
I20260709 12:26:44.815027 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:44.815843 30223 tablet_replica.cc:333] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.816790 30223 raft_consensus.cc:2243] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.817631 30223 raft_consensus.cc:2272] T 7b78f8af4c624113bf61a0b4c5e954ee P bd882edfca2b46aca0d0e66278597e9e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.820034 30223 tablet_replica.cc:333] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.820536 30223 raft_consensus.cc:2243] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.821254 30223 raft_consensus.cc:2272] T e7f147db3c2f4fe0a64896bcd40d0d3e P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.823388 30223 tablet_replica.cc:333] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.823922 30223 raft_consensus.cc:2243] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.824669 30223 raft_consensus.cc:2272] T a81f70a12410402e9cc3921c92192dc5 P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.827692 30223 tablet_replica.cc:333] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.828224 30223 raft_consensus.cc:2243] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.828619 30223 raft_consensus.cc:2272] T 45dde00fc1134422a7c5e40a01a3e4e0 P bd882edfca2b46aca0d0e66278597e9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.830927 30223 tablet_replica.cc:333] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.831548 30223 raft_consensus.cc:2243] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.831912 30223 raft_consensus.cc:2272] T a9890be6830e48bda79ded614ec90293 P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.834137 30223 tablet_replica.cc:333] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.834635 30223 raft_consensus.cc:2243] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.834987 30223 raft_consensus.cc:2272] T c4a23239ef6845e089d021769a95ed83 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.836887 30223 tablet_replica.cc:333] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.837332 30223 raft_consensus.cc:2243] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.837683 30223 raft_consensus.cc:2272] T b797bc65a873405cabf67f542a11c8db P bd882edfca2b46aca0d0e66278597e9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.840144 30223 tablet_replica.cc:333] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.840590 30223 raft_consensus.cc:2243] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.840952 30223 raft_consensus.cc:2272] T 4189e77ec0394a87ace96fd3548b727f P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.842831 30223 tablet_replica.cc:333] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.843297 30223 raft_consensus.cc:2243] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.843662 30223 raft_consensus.cc:2272] T d643ecda3bc7487b813de68ef99fb96a P bd882edfca2b46aca0d0e66278597e9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.845530 30223 tablet_replica.cc:333] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e: stopping tablet replica
I20260709 12:26:44.845929 30223 raft_consensus.cc:2243] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.846609 30223 raft_consensus.cc:2272] T 2844196e09f547febbcfda9dbcc908f2 P bd882edfca2b46aca0d0e66278597e9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.896914 30223 tablet_server.cc:196] TabletServer@127.29.131.195:0 shutdown complete.
I20260709 12:26:44.921029 30223 master.cc:562] Master@127.29.131.254:36467 shutting down...
I20260709 12:26:44.944916 30223 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.945493 30223 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.945838 30223 tablet_replica.cc:333] T 00000000000000000000000000000000 P bbefebf4496441b389d7243021b41ced: stopping tablet replica
I20260709 12:26:44.967383 30223 master.cc:584] Master@127.29.131.254:36467 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15556 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:26:45.014441 30223 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.131.254:46825
I20260709 12:26:45.015656 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:45.021498  5380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:45.021492  5379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:45.022353  5382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:45.023767 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:45.024724 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:45.024897 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:45.025086 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600005025052 us; error 0 us; skew 500 ppm
I20260709 12:26:45.025615 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:45.027972 30223 webserver.cc:533] Webserver started at http://127.29.131.254:40313/ using document root <none> and password file <none>
I20260709 12:26:45.028486 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:45.028681 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:45.029002 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:45.030462 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/master-0-root/instance:
uuid: "418fa72eb3ec42359323b11ced0b6721"
format_stamp: "Formatted at 2026-07-09 12:26:45 on dist-test-slave-n640"
I20260709 12:26:45.034663 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:45.037894  5387 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.038618 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:45.038945 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/master-0-root
uuid: "418fa72eb3ec42359323b11ced0b6721"
format_stamp: "Formatted at 2026-07-09 12:26:45 on dist-test-slave-n640"
I20260709 12:26:45.039223 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:45.053153 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:45.054405 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:45.092886 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.254:46825
I20260709 12:26:45.092996  5438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.254:46825 every 8 connection(s)
I20260709 12:26:45.096836  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.107656  5439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721: Bootstrap starting.
I20260709 12:26:45.112522  5439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.116729  5439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721: No bootstrap required, opened a new log
I20260709 12:26:45.118979  5439 raft_consensus.cc:359] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "418fa72eb3ec42359323b11ced0b6721" member_type: VOTER }
I20260709 12:26:45.119402  5439 raft_consensus.cc:385] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.119643  5439 raft_consensus.cc:740] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 418fa72eb3ec42359323b11ced0b6721, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.120236  5439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "418fa72eb3ec42359323b11ced0b6721" member_type: VOTER }
I20260709 12:26:45.120685  5439 raft_consensus.cc:399] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:45.120886  5439 raft_consensus.cc:493] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:45.121191  5439 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.126101  5439 raft_consensus.cc:515] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "418fa72eb3ec42359323b11ced0b6721" member_type: VOTER }
I20260709 12:26:45.126619  5439 leader_election.cc:304] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 418fa72eb3ec42359323b11ced0b6721; no voters: 
I20260709 12:26:45.127815  5439 leader_election.cc:290] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:45.128193  5442 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.129601  5442 raft_consensus.cc:697] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 1 LEADER]: Becoming Leader. State: Replica: 418fa72eb3ec42359323b11ced0b6721, State: Running, Role: LEADER
I20260709 12:26:45.130309  5442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "418fa72eb3ec42359323b11ced0b6721" member_type: VOTER }
I20260709 12:26:45.131049  5439 sys_catalog.cc:565] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:45.136474  5443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "418fa72eb3ec42359323b11ced0b6721" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "418fa72eb3ec42359323b11ced0b6721" member_type: VOTER } }
I20260709 12:26:45.136792  5444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 418fa72eb3ec42359323b11ced0b6721. Latest consensus state: current_term: 1 leader_uuid: "418fa72eb3ec42359323b11ced0b6721" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "418fa72eb3ec42359323b11ced0b6721" member_type: VOTER } }
I20260709 12:26:45.137454  5443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:45.137647  5444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:45.140393  5450 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:45.145462  5450 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:45.148536 30223 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:45.154850  5450 catalog_manager.cc:1383] Generated new cluster ID: 8a03fcf59d974785baff6915d6aa71e9
I20260709 12:26:45.155171  5450 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:45.186017  5450 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:45.187376  5450 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:45.203765  5450 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721: Generated new TSK 0
I20260709 12:26:45.204402  5450 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:45.215873 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:45.222144  5460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:45.223407  5461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:45.224639  5463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:45.227545 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:45.228986 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:45.229265 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:45.229458 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600005229442 us; error 0 us; skew 500 ppm
I20260709 12:26:45.230070 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:45.232627 30223 webserver.cc:533] Webserver started at http://127.29.131.193:39229/ using document root <none> and password file <none>
I20260709 12:26:45.233211 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:45.233419 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:45.233713 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:45.234807 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-0-root/instance:
uuid: "2944a9ac9fd1442cbb47dbf9b180619d"
format_stamp: "Formatted at 2026-07-09 12:26:45 on dist-test-slave-n640"
I20260709 12:26:45.239441 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:26:45.242902  5468 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.243772 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:45.244068 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "2944a9ac9fd1442cbb47dbf9b180619d"
format_stamp: "Formatted at 2026-07-09 12:26:45 on dist-test-slave-n640"
I20260709 12:26:45.244376 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:45.267356 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:45.268594 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:45.270085 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:45.272418 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:45.272644 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.272876 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:45.273063 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.315555 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:37947
I20260709 12:26:45.315681  5530 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:37947 every 8 connection(s)
I20260709 12:26:45.320986 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:45.328907  5535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:45.330047  5536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:45.333177  5538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:45.333635 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:45.335127 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:45.335433 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:45.335637 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600005335619 us; error 0 us; skew 500 ppm
I20260709 12:26:45.336303  5531 heartbeater.cc:344] Connected to a master server at 127.29.131.254:46825
I20260709 12:26:45.336371 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:45.336849  5531 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:45.337826  5531 heartbeater.cc:507] Master 127.29.131.254:46825 requested a full tablet report, sending...
I20260709 12:26:45.339365 30223 webserver.cc:533] Webserver started at http://127.29.131.194:36971/ using document root <none> and password file <none>
I20260709 12:26:45.340039 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:45.340287 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:45.340312  5404 ts_manager.cc:194] Registered new tserver with Master: 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193:37947)
I20260709 12:26:45.340711 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:45.342420 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-1-root/instance:
uuid: "2dac59d1c0ee4793a42375221ee56794"
format_stamp: "Formatted at 2026-07-09 12:26:45 on dist-test-slave-n640"
I20260709 12:26:45.343086  5404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41848
I20260709 12:26:45.347919 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:26:45.351482  5543 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.352361 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:45.352670 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-1-root
uuid: "2dac59d1c0ee4793a42375221ee56794"
format_stamp: "Formatted at 2026-07-09 12:26:45 on dist-test-slave-n640"
I20260709 12:26:45.352955 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:45.365235 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:45.366444 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:45.367944 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:45.370131 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:45.370361 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.370599 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:45.370779 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.411960 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.194:44369
I20260709 12:26:45.412091  5605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.194:44369 every 8 connection(s)
I20260709 12:26:45.416950 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:45.424365  5609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:45.425760  5610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:45.429060  5606 heartbeater.cc:344] Connected to a master server at 127.29.131.254:46825
W20260709 12:26:45.429447  5612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:45.429606  5606 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:45.429746 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:45.430900  5606 heartbeater.cc:507] Master 127.29.131.254:46825 requested a full tablet report, sending...
I20260709 12:26:45.430997 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:45.431352 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:45.431563 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600005431547 us; error 0 us; skew 500 ppm
I20260709 12:26:45.432386 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:45.433270  5404 ts_manager.cc:194] Registered new tserver with Master: 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369)
I20260709 12:26:45.435128 30223 webserver.cc:533] Webserver started at http://127.29.131.195:36543/ using document root <none> and password file <none>
I20260709 12:26:45.435359  5404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41858
I20260709 12:26:45.435871 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:45.436152 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:45.436487 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:45.437829 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-2-root/instance:
uuid: "453454f410cc421293180c686492d1ec"
format_stamp: "Formatted at 2026-07-09 12:26:45 on dist-test-slave-n640"
I20260709 12:26:45.443009 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:26:45.447031  5617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.448251 30223 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:45.448618 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-2-root
uuid: "453454f410cc421293180c686492d1ec"
format_stamp: "Formatted at 2026-07-09 12:26:45 on dist-test-slave-n640"
I20260709 12:26:45.448954 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599722576063-30223-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:45.462626 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:45.464013 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:45.465498 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:45.467845 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:45.468078 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.468323 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:45.468498 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:45.509495 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.195:39577
I20260709 12:26:45.509595  5679 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.195:39577 every 8 connection(s)
I20260709 12:26:45.524441  5680 heartbeater.cc:344] Connected to a master server at 127.29.131.254:46825
I20260709 12:26:45.524870  5680 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:45.525626  5680 heartbeater.cc:507] Master 127.29.131.254:46825 requested a full tablet report, sending...
I20260709 12:26:45.527979  5404 ts_manager.cc:194] Registered new tserver with Master: 453454f410cc421293180c686492d1ec (127.29.131.195:39577)
I20260709 12:26:45.529042 30223 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016250996s
I20260709 12:26:45.529739  5404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41866
I20260709 12:26:45.555792  5404 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41876:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:45.557978  5404 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:45.608979  5496 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7e4a7d811046539689e534b0b21b9d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b81326822e1d412bba9af5b4b91bbf2b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:45.609361  5495 tablet_service.cc:1511] Processing CreateTablet for tablet f239e48c4f044c4daefa89df360d0462 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b81326822e1d412bba9af5b4b91bbf2b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:45.610721  5496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7e4a7d811046539689e534b0b21b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.611476  5495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f239e48c4f044c4daefa89df360d0462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.614534  5571 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7e4a7d811046539689e534b0b21b9d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b81326822e1d412bba9af5b4b91bbf2b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:45.615728  5571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7e4a7d811046539689e534b0b21b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.615355  5570 tablet_service.cc:1511] Processing CreateTablet for tablet f239e48c4f044c4daefa89df360d0462 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b81326822e1d412bba9af5b4b91bbf2b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:45.616935  5570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f239e48c4f044c4daefa89df360d0462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.617136  5645 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7e4a7d811046539689e534b0b21b9d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b81326822e1d412bba9af5b4b91bbf2b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:45.618458  5645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7e4a7d811046539689e534b0b21b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.622006  5644 tablet_service.cc:1511] Processing CreateTablet for tablet f239e48c4f044c4daefa89df360d0462 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b81326822e1d412bba9af5b4b91bbf2b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:45.623414  5644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f239e48c4f044c4daefa89df360d0462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.638712  5695 tablet_bootstrap.cc:492] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794: Bootstrap starting.
I20260709 12:26:45.641364  5696 tablet_bootstrap.cc:492] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d: Bootstrap starting.
I20260709 12:26:45.647032  5695 tablet_bootstrap.cc:654] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.648159  5696 tablet_bootstrap.cc:654] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.653329  5696 tablet_bootstrap.cc:492] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d: No bootstrap required, opened a new log
I20260709 12:26:45.653752  5696 ts_tablet_manager.cc:1403] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:26:45.656410  5696 raft_consensus.cc:359] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.657186  5696 raft_consensus.cc:385] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.657529  5696 raft_consensus.cc:740] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2944a9ac9fd1442cbb47dbf9b180619d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.658345  5696 consensus_queue.cc:260] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.667435  5696 ts_tablet_manager.cc:1434] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.006s
I20260709 12:26:45.668288  5531 heartbeater.cc:499] Master 127.29.131.254:46825 was elected leader, sending a full tablet report...
I20260709 12:26:45.670174  5696 tablet_bootstrap.cc:492] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d: Bootstrap starting.
I20260709 12:26:45.676532  5695 tablet_bootstrap.cc:492] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794: No bootstrap required, opened a new log
I20260709 12:26:45.677232  5695 ts_tablet_manager.cc:1403] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.016s
I20260709 12:26:45.677950  5700 tablet_bootstrap.cc:492] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec: Bootstrap starting.
I20260709 12:26:45.681157  5696 tablet_bootstrap.cc:654] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.680888  5695 raft_consensus.cc:359] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.681774  5695 raft_consensus.cc:385] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.682163  5695 raft_consensus.cc:740] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dac59d1c0ee4793a42375221ee56794, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.683097  5695 consensus_queue.cc:260] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.686040  5696 tablet_bootstrap.cc:492] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d: No bootstrap required, opened a new log
I20260709 12:26:45.686527  5696 ts_tablet_manager.cc:1403] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 12:26:45.686724  5700 tablet_bootstrap.cc:654] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.688762  5696 raft_consensus.cc:359] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.689380  5696 raft_consensus.cc:385] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.689760  5696 raft_consensus.cc:740] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2944a9ac9fd1442cbb47dbf9b180619d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.690342  5606 heartbeater.cc:499] Master 127.29.131.254:46825 was elected leader, sending a full tablet report...
I20260709 12:26:45.691138  5695 ts_tablet_manager.cc:1434] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:26:45.692390  5695 tablet_bootstrap.cc:492] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794: Bootstrap starting.
I20260709 12:26:45.692832  5696 consensus_queue.cc:260] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.695165  5696 ts_tablet_manager.cc:1434] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:45.696092  5700 tablet_bootstrap.cc:492] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec: No bootstrap required, opened a new log
I20260709 12:26:45.696676  5700 ts_tablet_manager.cc:1403] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:26:45.700174  5700 raft_consensus.cc:359] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.701035  5700 raft_consensus.cc:385] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.701395  5700 raft_consensus.cc:740] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 453454f410cc421293180c686492d1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.701779  5695 tablet_bootstrap.cc:654] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.702373  5700 consensus_queue.cc:260] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.709141  5699 raft_consensus.cc:493] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.709699  5700 ts_tablet_manager.cc:1434] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 12:26:45.710008  5680 heartbeater.cc:499] Master 127.29.131.254:46825 was elected leader, sending a full tablet report...
I20260709 12:26:45.709779  5699 raft_consensus.cc:515] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.711061  5700 tablet_bootstrap.cc:492] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec: Bootstrap starting.
I20260709 12:26:45.713395  5695 tablet_bootstrap.cc:492] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794: No bootstrap required, opened a new log
I20260709 12:26:45.714011  5695 ts_tablet_manager.cc:1403] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.001s
I20260709 12:26:45.717201  5695 raft_consensus.cc:359] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.719110  5695 raft_consensus.cc:385] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.719493  5695 raft_consensus.cc:740] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dac59d1c0ee4793a42375221ee56794, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.720306  5695 consensus_queue.cc:260] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.721966  5700 tablet_bootstrap.cc:654] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.722739  5699 leader_election.cc:290] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 453454f410cc421293180c686492d1ec (127.29.131.195:39577), 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369)
I20260709 12:26:45.725036  5695 ts_tablet_manager.cc:1434] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:26:45.726725  5702 raft_consensus.cc:493] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.727522  5702 raft_consensus.cc:515] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.735671  5581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7e4a7d811046539689e534b0b21b9d" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dac59d1c0ee4793a42375221ee56794" is_pre_election: true
I20260709 12:26:45.736443  5581 raft_consensus.cc:2468] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 0.
I20260709 12:26:45.738574  5470 leader_election.cc:304] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2944a9ac9fd1442cbb47dbf9b180619d, 2dac59d1c0ee4793a42375221ee56794; no voters: 
I20260709 12:26:45.742573  5699 raft_consensus.cc:2804] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.740128  5702 leader_election.cc:290] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193:37947), 453454f410cc421293180c686492d1ec (127.29.131.195:39577)
I20260709 12:26:45.743420  5699 raft_consensus.cc:493] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.744119  5699 raft_consensus.cc:3060] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.752874  5506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f239e48c4f044c4daefa89df360d0462" candidate_uuid: "2dac59d1c0ee4793a42375221ee56794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" is_pre_election: true
I20260709 12:26:45.754069  5506 raft_consensus.cc:2468] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dac59d1c0ee4793a42375221ee56794 in term 0.
I20260709 12:26:45.756474  5546 leader_election.cc:304] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2944a9ac9fd1442cbb47dbf9b180619d, 2dac59d1c0ee4793a42375221ee56794; no voters: 
I20260709 12:26:45.757917  5702 raft_consensus.cc:2804] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.758512  5702 raft_consensus.cc:493] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.759109  5702 raft_consensus.cc:3060] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.773196  5699 raft_consensus.cc:515] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.778232  5699 leader_election.cc:290] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 election: Requested vote from peers 453454f410cc421293180c686492d1ec (127.29.131.195:39577), 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369)
I20260709 12:26:45.779750  5700 tablet_bootstrap.cc:492] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec: No bootstrap required, opened a new log
I20260709 12:26:45.779525  5581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7e4a7d811046539689e534b0b21b9d" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dac59d1c0ee4793a42375221ee56794"
I20260709 12:26:45.780174  5655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f239e48c4f044c4daefa89df360d0462" candidate_uuid: "2dac59d1c0ee4793a42375221ee56794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453454f410cc421293180c686492d1ec" is_pre_election: true
I20260709 12:26:45.780395  5581 raft_consensus.cc:3060] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.780934  5655 raft_consensus.cc:2468] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dac59d1c0ee4793a42375221ee56794 in term 0.
I20260709 12:26:45.780875  5702 raft_consensus.cc:515] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.781896  5653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7e4a7d811046539689e534b0b21b9d" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453454f410cc421293180c686492d1ec"
I20260709 12:26:45.780789  5654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7e4a7d811046539689e534b0b21b9d" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453454f410cc421293180c686492d1ec" is_pre_election: true
I20260709 12:26:45.783354  5702 leader_election.cc:290] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [CANDIDATE]: Term 1 election: Requested vote from peers 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193:37947), 453454f410cc421293180c686492d1ec (127.29.131.195:39577)
I20260709 12:26:45.780407  5700 ts_tablet_manager.cc:1403] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec: Time spent bootstrapping tablet: real 0.070s	user 0.043s	sys 0.020s
I20260709 12:26:45.784068  5506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f239e48c4f044c4daefa89df360d0462" candidate_uuid: "2dac59d1c0ee4793a42375221ee56794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2944a9ac9fd1442cbb47dbf9b180619d"
W20260709 12:26:45.784231  5469 leader_election.cc:343] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 453454f410cc421293180c686492d1ec (127.29.131.195:39577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.784741  5506 raft_consensus.cc:3060] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:45.785033  5469 leader_election.cc:343] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 453454f410cc421293180c686492d1ec (127.29.131.195:39577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.785535  5654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f239e48c4f044c4daefa89df360d0462" candidate_uuid: "2dac59d1c0ee4793a42375221ee56794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453454f410cc421293180c686492d1ec"
I20260709 12:26:45.786146  5654 raft_consensus.cc:3060] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.787423  5700 raft_consensus.cc:359] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.788280  5700 raft_consensus.cc:385] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.788601  5700 raft_consensus.cc:740] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 453454f410cc421293180c686492d1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.789463  5700 consensus_queue.cc:260] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.792092  5581 raft_consensus.cc:2468] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 1.
I20260709 12:26:45.793524  5470 leader_election.cc:304] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2944a9ac9fd1442cbb47dbf9b180619d, 2dac59d1c0ee4793a42375221ee56794; no voters: 453454f410cc421293180c686492d1ec
I20260709 12:26:45.794159  5506 raft_consensus.cc:2468] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dac59d1c0ee4793a42375221ee56794 in term 1.
I20260709 12:26:45.794874  5699 raft_consensus.cc:2804] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.795534  5546 leader_election.cc:304] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2944a9ac9fd1442cbb47dbf9b180619d, 2dac59d1c0ee4793a42375221ee56794; no voters: 
I20260709 12:26:45.792379  5700 ts_tablet_manager.cc:1434] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:45.796573  5702 raft_consensus.cc:2804] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.796598  5654 raft_consensus.cc:2468] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dac59d1c0ee4793a42375221ee56794 in term 1.
I20260709 12:26:45.799005  5699 raft_consensus.cc:697] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Becoming Leader. State: Replica: 2944a9ac9fd1442cbb47dbf9b180619d, State: Running, Role: LEADER
I20260709 12:26:45.800139  5702 raft_consensus.cc:697] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 1 LEADER]: Becoming Leader. State: Replica: 2dac59d1c0ee4793a42375221ee56794, State: Running, Role: LEADER
I20260709 12:26:45.800733  5699 consensus_queue.cc:237] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.801249  5702 consensus_queue.cc:237] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.810071  5402 catalog_manager.cc:5697] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.812440  5403 catalog_manager.cc:5697] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "2dac59d1c0ee4793a42375221ee56794" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.886313  5403 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41886:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:45.888260  5403 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:45.897977  5704 raft_consensus.cc:493] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.898579  5704 raft_consensus.cc:515] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } } peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } }
I20260709 12:26:45.902546  5704 leader_election.cc:290] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193:37947), 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369)
I20260709 12:26:45.912945  5506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7e4a7d811046539689e534b0b21b9d" candidate_uuid: "453454f410cc421293180c686492d1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" is_pre_election: true
I20260709 12:26:45.915511  5581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7e4a7d811046539689e534b0b21b9d" candidate_uuid: "453454f410cc421293180c686492d1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dac59d1c0ee4793a42375221ee56794" is_pre_election: true
I20260709 12:26:45.916334  5581 raft_consensus.cc:2393] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 453454f410cc421293180c686492d1ec in current term 1: Already voted for candidate 2944a9ac9fd1442cbb47dbf9b180619d in this term.
I20260709 12:26:45.917495  5496 tablet_service.cc:1511] Processing CreateTablet for tablet da3adb8ecac1424283e41e28e08951b9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d0310249b66b48aab20da594b1ed45e5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:45.918819  5496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3adb8ecac1424283e41e28e08951b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.918962  5571 tablet_service.cc:1511] Processing CreateTablet for tablet da3adb8ecac1424283e41e28e08951b9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d0310249b66b48aab20da594b1ed45e5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:45.923439  5570 tablet_service.cc:1511] Processing CreateTablet for tablet a242f5ff833845629c615089ddbb2767 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d0310249b66b48aab20da594b1ed45e5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:45.923961  5571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3adb8ecac1424283e41e28e08951b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.924176  5645 tablet_service.cc:1511] Processing CreateTablet for tablet a242f5ff833845629c615089ddbb2767 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d0310249b66b48aab20da594b1ed45e5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:45.926772  5645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a242f5ff833845629c615089ddbb2767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.921547  5495 tablet_service.cc:1511] Processing CreateTablet for tablet a242f5ff833845629c615089ddbb2767 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d0310249b66b48aab20da594b1ed45e5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:45.929807  5495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a242f5ff833845629c615089ddbb2767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.931641  5570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a242f5ff833845629c615089ddbb2767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.924805  5619 leader_election.cc:304] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 453454f410cc421293180c686492d1ec; no voters: 2944a9ac9fd1442cbb47dbf9b180619d, 2dac59d1c0ee4793a42375221ee56794
I20260709 12:26:45.921094  5644 tablet_service.cc:1511] Processing CreateTablet for tablet da3adb8ecac1424283e41e28e08951b9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d0310249b66b48aab20da594b1ed45e5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:45.936097  5644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3adb8ecac1424283e41e28e08951b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.934638  5696 tablet_bootstrap.cc:492] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d: Bootstrap starting.
I20260709 12:26:45.942215  5695 tablet_bootstrap.cc:492] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794: Bootstrap starting.
I20260709 12:26:45.949434  5695 tablet_bootstrap.cc:654] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.951603  5704 raft_consensus.cc:3060] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.957329  5696 tablet_bootstrap.cc:654] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.959836  5704 raft_consensus.cc:2749] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.966727  5695 tablet_bootstrap.cc:492] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794: No bootstrap required, opened a new log
I20260709 12:26:45.967357  5695 ts_tablet_manager.cc:1403] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 12:26:45.970824  5700 tablet_bootstrap.cc:492] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec: Bootstrap starting.
I20260709 12:26:45.970503  5695 raft_consensus.cc:359] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.971221  5695 raft_consensus.cc:385] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.971550  5695 raft_consensus.cc:740] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dac59d1c0ee4793a42375221ee56794, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.973496  5695 consensus_queue.cc:260] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.976203  5695 ts_tablet_manager.cc:1434] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:45.977180  5695 tablet_bootstrap.cc:492] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794: Bootstrap starting.
I20260709 12:26:45.980569  5700 tablet_bootstrap.cc:654] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.982332  5696 tablet_bootstrap.cc:492] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d: No bootstrap required, opened a new log
I20260709 12:26:45.982952  5696 ts_tablet_manager.cc:1403] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.006s
I20260709 12:26:45.983551  5695 tablet_bootstrap.cc:654] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.987056  5696 raft_consensus.cc:359] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.990397  5696 raft_consensus.cc:385] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.990710  5696 raft_consensus.cc:740] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2944a9ac9fd1442cbb47dbf9b180619d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.991503  5696 consensus_queue.cc:260] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.992915  5700 tablet_bootstrap.cc:492] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec: No bootstrap required, opened a new log
I20260709 12:26:45.993448  5700 ts_tablet_manager.cc:1403] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 12:26:45.993991  5696 ts_tablet_manager.cc:1434] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:45.995024  5696 tablet_bootstrap.cc:492] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d: Bootstrap starting.
I20260709 12:26:45.997095  5700 raft_consensus.cc:359] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:45.998025  5700 raft_consensus.cc:385] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.998333  5700 raft_consensus.cc:740] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 453454f410cc421293180c686492d1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.999267  5700 consensus_queue.cc:260] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.000635  5695 tablet_bootstrap.cc:492] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794: No bootstrap required, opened a new log
I20260709 12:26:46.001143  5695 ts_tablet_manager.cc:1403] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 12:26:46.001621  5696 tablet_bootstrap.cc:654] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.005925  5695 raft_consensus.cc:359] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.006686  5700 ts_tablet_manager.cc:1434] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:46.006711  5695 raft_consensus.cc:385] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.007282  5695 raft_consensus.cc:740] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dac59d1c0ee4793a42375221ee56794, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.007966  5700 tablet_bootstrap.cc:492] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec: Bootstrap starting.
I20260709 12:26:46.008162  5695 consensus_queue.cc:260] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.010452  5695 ts_tablet_manager.cc:1434] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:46.017462  5700 tablet_bootstrap.cc:654] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.023619  5696 tablet_bootstrap.cc:492] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d: No bootstrap required, opened a new log
I20260709 12:26:46.023945  5700 tablet_bootstrap.cc:492] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec: No bootstrap required, opened a new log
I20260709 12:26:46.024133  5696 ts_tablet_manager.cc:1403] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d: Time spent bootstrapping tablet: real 0.029s	user 0.025s	sys 0.003s
I20260709 12:26:46.024468  5700 ts_tablet_manager.cc:1403] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:26:46.027355  5696 raft_consensus.cc:359] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.027530  5700 raft_consensus.cc:359] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.028141  5696 raft_consensus.cc:385] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.028231  5700 raft_consensus.cc:385] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.028535  5696 raft_consensus.cc:740] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2944a9ac9fd1442cbb47dbf9b180619d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.028595  5700 raft_consensus.cc:740] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 453454f410cc421293180c686492d1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.029469  5700 consensus_queue.cc:260] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.029469  5696 consensus_queue.cc:260] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.031853  5700 ts_tablet_manager.cc:1434] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:46.031853  5696 ts_tablet_manager.cc:1434] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:26:46.036266  5699 raft_consensus.cc:493] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.036847  5699 raft_consensus.cc:515] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.039249  5699 leader_election.cc:290] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369), 453454f410cc421293180c686492d1ec (127.29.131.195:39577)
I20260709 12:26:46.039937  5581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3adb8ecac1424283e41e28e08951b9" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dac59d1c0ee4793a42375221ee56794" is_pre_election: true
I20260709 12:26:46.040403  5654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3adb8ecac1424283e41e28e08951b9" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453454f410cc421293180c686492d1ec" is_pre_election: true
I20260709 12:26:46.040712  5581 raft_consensus.cc:2468] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 0.
I20260709 12:26:46.041150  5654 raft_consensus.cc:2468] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 0.
I20260709 12:26:46.042157  5470 leader_election.cc:304] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2944a9ac9fd1442cbb47dbf9b180619d, 2dac59d1c0ee4793a42375221ee56794; no voters: 
I20260709 12:26:46.043422  5699 raft_consensus.cc:2804] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.043810  5699 raft_consensus.cc:493] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.044150  5699 raft_consensus.cc:3060] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.049957  5699 raft_consensus.cc:515] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.051656  5699 leader_election.cc:290] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 election: Requested vote from peers 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369), 453454f410cc421293180c686492d1ec (127.29.131.195:39577)
I20260709 12:26:46.052439  5581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3adb8ecac1424283e41e28e08951b9" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dac59d1c0ee4793a42375221ee56794"
I20260709 12:26:46.052940  5581 raft_consensus.cc:3060] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.052755  5654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3adb8ecac1424283e41e28e08951b9" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453454f410cc421293180c686492d1ec"
I20260709 12:26:46.053583  5654 raft_consensus.cc:3060] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.058138  5581 raft_consensus.cc:2468] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 1.
I20260709 12:26:46.058497  5654 raft_consensus.cc:2468] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 1.
I20260709 12:26:46.059201  5470 leader_election.cc:304] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2944a9ac9fd1442cbb47dbf9b180619d, 2dac59d1c0ee4793a42375221ee56794; no voters: 
I20260709 12:26:46.060029  5699 raft_consensus.cc:2804] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.060580  5699 raft_consensus.cc:697] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Becoming Leader. State: Replica: 2944a9ac9fd1442cbb47dbf9b180619d, State: Running, Role: LEADER
I20260709 12:26:46.061319  5699 consensus_queue.cc:237] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.068078  5402 catalog_manager.cc:5697] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:46.143625  5452 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:46.206529  5699 consensus_queue.cc:1048] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.218847  5709 consensus_queue.cc:1048] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [LEADER]: Connected to new peer: Peer: permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.228585  5702 consensus_queue.cc:1048] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.240710  5702 consensus_queue.cc:1048] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.294490  5709 raft_consensus.cc:493] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.294987  5709 raft_consensus.cc:515] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.296767  5709 leader_election.cc:290] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369), 453454f410cc421293180c686492d1ec (127.29.131.195:39577)
I20260709 12:26:46.297819  5581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a242f5ff833845629c615089ddbb2767" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dac59d1c0ee4793a42375221ee56794" is_pre_election: true
I20260709 12:26:46.298009  5654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a242f5ff833845629c615089ddbb2767" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453454f410cc421293180c686492d1ec" is_pre_election: true
I20260709 12:26:46.298543  5581 raft_consensus.cc:2468] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 0.
I20260709 12:26:46.298678  5654 raft_consensus.cc:2468] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 0.
I20260709 12:26:46.299685  5470 leader_election.cc:304] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2944a9ac9fd1442cbb47dbf9b180619d, 2dac59d1c0ee4793a42375221ee56794; no voters: 
I20260709 12:26:46.300457  5709 raft_consensus.cc:2804] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.300868  5709 raft_consensus.cc:493] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.301175  5709 raft_consensus.cc:3060] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.306734  5709 raft_consensus.cc:515] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.308501  5709 leader_election.cc:290] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 election: Requested vote from peers 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369), 453454f410cc421293180c686492d1ec (127.29.131.195:39577)
I20260709 12:26:46.309407  5581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a242f5ff833845629c615089ddbb2767" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dac59d1c0ee4793a42375221ee56794"
I20260709 12:26:46.309530  5654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a242f5ff833845629c615089ddbb2767" candidate_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453454f410cc421293180c686492d1ec"
I20260709 12:26:46.310000  5581 raft_consensus.cc:3060] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.310184  5654 raft_consensus.cc:3060] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.315320  5654 raft_consensus.cc:2468] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 1.
I20260709 12:26:46.315429  5581 raft_consensus.cc:2468] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2944a9ac9fd1442cbb47dbf9b180619d in term 1.
I20260709 12:26:46.316386  5469 leader_election.cc:304] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2944a9ac9fd1442cbb47dbf9b180619d, 453454f410cc421293180c686492d1ec; no voters: 
I20260709 12:26:46.317198  5709 raft_consensus.cc:2804] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.317689  5709 raft_consensus.cc:697] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Becoming Leader. State: Replica: 2944a9ac9fd1442cbb47dbf9b180619d, State: Running, Role: LEADER
I20260709 12:26:46.318427  5709 consensus_queue.cc:237] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.326082  5402 catalog_manager.cc:5697] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.441619 30223 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:26:46.443271 30223 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:26:46.443614 30223 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:26:46.455490  5506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da3adb8ecac1424283e41e28e08951b9"
dest_uuid: "2944a9ac9fd1442cbb47dbf9b180619d"
mode: GRACEFUL
new_leader_uuid: "453454f410cc421293180c686492d1ec"
 from {username='slave'} at 127.0.0.1:60816
I20260709 12:26:46.456048  5506 raft_consensus.cc:606] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Received request to transfer leadership to TS 453454f410cc421293180c686492d1ec
I20260709 12:26:46.457259 30223 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:26:46.506940  5709 consensus_queue.cc:1048] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.519972  5709 consensus_queue.cc:1048] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [LEADER]: Connected to new peer: Peer: permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.529014  5739 raft_consensus.cc:993] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d: : Instructing follower 453454f410cc421293180c686492d1ec to start an election
I20260709 12:26:46.529551  5699 raft_consensus.cc:1081] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Signalling peer 453454f410cc421293180c686492d1ec to start an election
I20260709 12:26:46.531447  5654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da3adb8ecac1424283e41e28e08951b9"
dest_uuid: "453454f410cc421293180c686492d1ec"
 from {username='slave'} at 127.0.0.1:32876
I20260709 12:26:46.532006  5654 raft_consensus.cc:493] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.532389  5654 raft_consensus.cc:3060] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.537921  5654 raft_consensus.cc:515] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.539667  5654 leader_election.cc:290] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [CANDIDATE]: Term 2 election: Requested vote from peers 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193:37947), 2dac59d1c0ee4793a42375221ee56794 (127.29.131.194:44369)
I20260709 12:26:46.540375  5506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3adb8ecac1424283e41e28e08951b9" candidate_uuid: "453454f410cc421293180c686492d1ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2944a9ac9fd1442cbb47dbf9b180619d"
I20260709 12:26:46.540825  5581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3adb8ecac1424283e41e28e08951b9" candidate_uuid: "453454f410cc421293180c686492d1ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2dac59d1c0ee4793a42375221ee56794"
I20260709 12:26:46.541112  5506 raft_consensus.cc:3055] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:46.541493  5581 raft_consensus.cc:3060] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.541649  5506 raft_consensus.cc:740] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2944a9ac9fd1442cbb47dbf9b180619d, State: Running, Role: LEADER
I20260709 12:26:46.542586  5506 consensus_queue.cc:260] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.543711  5506 raft_consensus.cc:3060] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.548393  5581 raft_consensus.cc:2468] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 453454f410cc421293180c686492d1ec in term 2.
I20260709 12:26:46.549556  5619 leader_election.cc:304] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dac59d1c0ee4793a42375221ee56794, 453454f410cc421293180c686492d1ec; no voters: 
I20260709 12:26:46.550382  5704 raft_consensus.cc:2804] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:46.550705  5506 raft_consensus.cc:2468] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 453454f410cc421293180c686492d1ec in term 2.
I20260709 12:26:46.551775  5704 raft_consensus.cc:697] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 2 LEADER]: Becoming Leader. State: Replica: 453454f410cc421293180c686492d1ec, State: Running, Role: LEADER
I20260709 12:26:46.552637  5704 consensus_queue.cc:237] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } }
I20260709 12:26:46.559307  5403 catalog_manager.cc:5697] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec reported cstate change: term changed from 1 to 2, leader changed from 2944a9ac9fd1442cbb47dbf9b180619d (127.29.131.193) to 453454f410cc421293180c686492d1ec (127.29.131.195). New cstate: current_term: 2 leader_uuid: "453454f410cc421293180c686492d1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2944a9ac9fd1442cbb47dbf9b180619d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 37947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dac59d1c0ee4793a42375221ee56794" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "453454f410cc421293180c686492d1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 39577 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.603708 30223 tablet_server.cc:179] TabletServer@127.29.131.193:0 shutting down...
I20260709 12:26:46.627188 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:46.627926 30223 tablet_replica.cc:333] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d: stopping tablet replica
I20260709 12:26:46.628508 30223 raft_consensus.cc:2243] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.629138 30223 pending_rounds.cc:70] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d: Trying to abort 1 pending ops.
I20260709 12:26:46.629349 30223 pending_rounds.cc:77] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625625889898496 op_type: NO_OP noop_request { }
I20260709 12:26:46.629660 30223 raft_consensus.cc:2889] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:46.629941 30223 raft_consensus.cc:2272] T a242f5ff833845629c615089ddbb2767 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.632464 30223 tablet_replica.cc:333] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d: stopping tablet replica
I20260709 12:26:46.633064 30223 raft_consensus.cc:2243] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.633500 30223 raft_consensus.cc:2272] T da3adb8ecac1424283e41e28e08951b9 P 2944a9ac9fd1442cbb47dbf9b180619d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.636068 30223 tablet_replica.cc:333] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d: stopping tablet replica
I20260709 12:26:46.636641 30223 raft_consensus.cc:2243] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.637471 30223 raft_consensus.cc:2272] T 3a7e4a7d811046539689e534b0b21b9d P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.639832 30223 tablet_replica.cc:333] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d: stopping tablet replica
I20260709 12:26:46.640296 30223 raft_consensus.cc:2243] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.640780 30223 raft_consensus.cc:2272] T f239e48c4f044c4daefa89df360d0462 P 2944a9ac9fd1442cbb47dbf9b180619d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.654620 30223 tablet_server.cc:196] TabletServer@127.29.131.193:0 shutdown complete.
I20260709 12:26:46.666364 30223 tablet_server.cc:179] TabletServer@127.29.131.194:0 shutting down...
I20260709 12:26:46.686643 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:46.687348 30223 tablet_replica.cc:333] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794: stopping tablet replica
I20260709 12:26:46.687944 30223 raft_consensus.cc:2243] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.688366 30223 raft_consensus.cc:2272] T a242f5ff833845629c615089ddbb2767 P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.690212 30223 tablet_replica.cc:333] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794: stopping tablet replica
I20260709 12:26:46.690732 30223 raft_consensus.cc:2243] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.691148 30223 raft_consensus.cc:2272] T da3adb8ecac1424283e41e28e08951b9 P 2dac59d1c0ee4793a42375221ee56794 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.693514 30223 tablet_replica.cc:333] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794: stopping tablet replica
I20260709 12:26:46.694015 30223 raft_consensus.cc:2243] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.694804 30223 raft_consensus.cc:2272] T f239e48c4f044c4daefa89df360d0462 P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.696837 30223 tablet_replica.cc:333] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794: stopping tablet replica
I20260709 12:26:46.697307 30223 raft_consensus.cc:2243] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.697695 30223 raft_consensus.cc:2272] T 3a7e4a7d811046539689e534b0b21b9d P 2dac59d1c0ee4793a42375221ee56794 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.710057 30223 tablet_server.cc:196] TabletServer@127.29.131.194:0 shutdown complete.
I20260709 12:26:46.721603 30223 tablet_server.cc:179] TabletServer@127.29.131.195:0 shutting down...
I20260709 12:26:46.738633 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:46.739367 30223 tablet_replica.cc:333] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec: stopping tablet replica
I20260709 12:26:46.739995 30223 raft_consensus.cc:2243] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.740419 30223 raft_consensus.cc:2272] T a242f5ff833845629c615089ddbb2767 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.742338 30223 tablet_replica.cc:333] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec: stopping tablet replica
I20260709 12:26:46.742993 30223 raft_consensus.cc:2243] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.743633 30223 pending_rounds.cc:70] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec: Trying to abort 1 pending ops.
I20260709 12:26:46.743848 30223 pending_rounds.cc:77] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625626847272960 op_type: NO_OP noop_request { }
I20260709 12:26:46.744117 30223 raft_consensus.cc:2889] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:46.744393 30223 raft_consensus.cc:2272] T da3adb8ecac1424283e41e28e08951b9 P 453454f410cc421293180c686492d1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.746526 30223 tablet_replica.cc:333] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec: stopping tablet replica
I20260709 12:26:46.747023 30223 raft_consensus.cc:2243] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.747473 30223 raft_consensus.cc:2272] T 3a7e4a7d811046539689e534b0b21b9d P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.749610 30223 tablet_replica.cc:333] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec: stopping tablet replica
I20260709 12:26:46.750073 30223 raft_consensus.cc:2243] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.750478 30223 raft_consensus.cc:2272] T f239e48c4f044c4daefa89df360d0462 P 453454f410cc421293180c686492d1ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.772293 30223 tablet_server.cc:196] TabletServer@127.29.131.195:0 shutdown complete.
I20260709 12:26:46.784528 30223 master.cc:562] Master@127.29.131.254:46825 shutting down...
I20260709 12:26:46.801070 30223 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.801641 30223 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.801983 30223 tablet_replica.cc:333] T 00000000000000000000000000000000 P 418fa72eb3ec42359323b11ced0b6721: stopping tablet replica
I20260709 12:26:46.812546 30223 master.cc:584] Master@127.29.131.254:46825 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (1829 ms)
[----------] 6 tests from LeaderRebalancerTest (284096 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:26:46.843964 30223 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.131.254:36709
I20260709 12:26:46.845078 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:46.850394  5742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:46.850646  5743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:46.851805  5745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:46.853250 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:46.854043 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:46.854300 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:46.854478 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600006854462 us; error 0 us; skew 500 ppm
I20260709 12:26:46.854964 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:46.857358 30223 webserver.cc:533] Webserver started at http://127.29.131.254:38601/ using document root <none> and password file <none>
I20260709 12:26:46.857779 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:46.857930 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:46.858151 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:46.859143 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/master-0-root/instance:
uuid: "26623580d23f41a6bfc1a44fb92c388e"
format_stamp: "Formatted at 2026-07-09 12:26:46 on dist-test-slave-n640"
I20260709 12:26:46.863754 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:26:46.866973  5750 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:46.867718 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:46.868012 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/master-0-root
uuid: "26623580d23f41a6bfc1a44fb92c388e"
format_stamp: "Formatted at 2026-07-09 12:26:46 on dist-test-slave-n640"
I20260709 12:26:46.868305 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:46.888386 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:46.889427 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:46.925704 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.254:36709
I20260709 12:26:46.925772  5801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.254:36709 every 8 connection(s)
I20260709 12:26:46.929740  5802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:46.940297  5802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e: Bootstrap starting.
I20260709 12:26:46.944803  5802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.948817  5802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e: No bootstrap required, opened a new log
I20260709 12:26:46.950882  5802 raft_consensus.cc:359] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26623580d23f41a6bfc1a44fb92c388e" member_type: VOTER }
I20260709 12:26:46.951349  5802 raft_consensus.cc:385] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.951543  5802 raft_consensus.cc:740] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26623580d23f41a6bfc1a44fb92c388e, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.952037  5802 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26623580d23f41a6bfc1a44fb92c388e" member_type: VOTER }
I20260709 12:26:46.952446  5802 raft_consensus.cc:399] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:46.952647  5802 raft_consensus.cc:493] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:46.952854  5802 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.957589  5802 raft_consensus.cc:515] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26623580d23f41a6bfc1a44fb92c388e" member_type: VOTER }
I20260709 12:26:46.958047  5802 leader_election.cc:304] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26623580d23f41a6bfc1a44fb92c388e; no voters: 
I20260709 12:26:46.959093  5802 leader_election.cc:290] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:46.959481  5805 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.960879  5805 raft_consensus.cc:697] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 1 LEADER]: Becoming Leader. State: Replica: 26623580d23f41a6bfc1a44fb92c388e, State: Running, Role: LEADER
I20260709 12:26:46.961531  5805 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26623580d23f41a6bfc1a44fb92c388e" member_type: VOTER }
I20260709 12:26:46.962100  5802 sys_catalog.cc:565] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:46.964426  5807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26623580d23f41a6bfc1a44fb92c388e. Latest consensus state: current_term: 1 leader_uuid: "26623580d23f41a6bfc1a44fb92c388e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26623580d23f41a6bfc1a44fb92c388e" member_type: VOTER } }
I20260709 12:26:46.964427  5806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26623580d23f41a6bfc1a44fb92c388e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26623580d23f41a6bfc1a44fb92c388e" member_type: VOTER } }
I20260709 12:26:46.965211  5806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:46.969135  5807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:46.969676  5810 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:46.977627  5810 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:46.978628 30223 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:46.986512  5810 catalog_manager.cc:1383] Generated new cluster ID: cd791f8e80644132af3e9e49c194233c
I20260709 12:26:46.986750  5810 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:47.018664  5810 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:47.020009  5810 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:47.032930  5810 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e: Generated new TSK 0
I20260709 12:26:47.033519  5810 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:47.045452 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:47.051210  5823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:47.052407  5824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:47.053761  5826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:47.054237 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:47.055078 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:47.055330 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:47.055461 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600007055448 us; error 0 us; skew 500 ppm
I20260709 12:26:47.055915 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:47.058182 30223 webserver.cc:533] Webserver started at http://127.29.131.193:37033/ using document root <none> and password file <none>
I20260709 12:26:47.058625 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:47.058784 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:47.058990 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:47.060103 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-0-root/instance:
uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
format_stamp: "Formatted at 2026-07-09 12:26:47 on dist-test-slave-n640"
I20260709 12:26:47.064610 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:47.067811  5831 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.068567 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:47.068871 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
format_stamp: "Formatted at 2026-07-09 12:26:47 on dist-test-slave-n640"
I20260709 12:26:47.069151 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:47.081393 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:47.082602 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:47.084102 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:47.086360 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:47.086585 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.086823 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:47.087002 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.127493 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:43599
I20260709 12:26:47.127607  5893 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:43599 every 8 connection(s)
I20260709 12:26:47.132540 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:47.139267  5898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:47.141018  5899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:47.143256  5901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:47.143651 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:47.144621 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:47.144892 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:47.145097 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600007145079 us; error 0 us; skew 500 ppm
I20260709 12:26:47.145780 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:47.145987  5894 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36709
I20260709 12:26:47.146412  5894 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:47.147459  5894 heartbeater.cc:507] Master 127.29.131.254:36709 requested a full tablet report, sending...
I20260709 12:26:47.148509 30223 webserver.cc:533] Webserver started at http://127.29.131.194:34169/ using document root <none> and password file <none>
I20260709 12:26:47.149191 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:47.149408 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:47.149688 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:47.149901  5767 ts_manager.cc:194] Registered new tserver with Master: 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599)
I20260709 12:26:47.150797 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-1-root/instance:
uuid: "80d6943d1ad94734981b057b3b4a5607"
format_stamp: "Formatted at 2026-07-09 12:26:47 on dist-test-slave-n640"
I20260709 12:26:47.151721  5767 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58072
I20260709 12:26:47.156682 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:47.160318  5906 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.161087 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:47.161425 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-1-root
uuid: "80d6943d1ad94734981b057b3b4a5607"
format_stamp: "Formatted at 2026-07-09 12:26:47 on dist-test-slave-n640"
I20260709 12:26:47.161741 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:47.173273 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:47.174423 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:47.176043 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:47.178464 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:47.178742 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.179008 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:47.179211 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.220697 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.194:37519
I20260709 12:26:47.220821  5968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.194:37519 every 8 connection(s)
I20260709 12:26:47.226090 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:47.233084  5972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:47.234580  5973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:47.236711  5969 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36709
I20260709 12:26:47.237432  5969 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:47.238060  5975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:47.238602  5969 heartbeater.cc:507] Master 127.29.131.254:36709 requested a full tablet report, sending...
I20260709 12:26:47.239169 30223 server_base.cc:1061] running on GCE node
I20260709 12:26:47.240302 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:47.240525 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:47.240736 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600007240716 us; error 0 us; skew 500 ppm
I20260709 12:26:47.241108  5767 ts_manager.cc:194] Registered new tserver with Master: 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:47.241436 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:47.243074  5767 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58074
I20260709 12:26:47.244325 30223 webserver.cc:533] Webserver started at http://127.29.131.195:37615/ using document root <none> and password file <none>
I20260709 12:26:47.244935 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:47.245157 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:47.245422 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:47.246430 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-2-root/instance:
uuid: "038a4934597746cb85b58eca24e2b1ec"
format_stamp: "Formatted at 2026-07-09 12:26:47 on dist-test-slave-n640"
I20260709 12:26:47.250687 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:47.253832  5980 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.254540 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:47.254887 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-2-root
uuid: "038a4934597746cb85b58eca24e2b1ec"
format_stamp: "Formatted at 2026-07-09 12:26:47 on dist-test-slave-n640"
I20260709 12:26:47.255180 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599722576063-30223-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:47.284529 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:47.285687 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:47.287117 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:47.289448 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:47.289678 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.289919 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:47.290089 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:47.326835 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.195:40921
I20260709 12:26:47.326931  6042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.195:40921 every 8 connection(s)
I20260709 12:26:47.341125  6043 heartbeater.cc:344] Connected to a master server at 127.29.131.254:36709
I20260709 12:26:47.341545  6043 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:47.342259  6043 heartbeater.cc:507] Master 127.29.131.254:36709 requested a full tablet report, sending...
I20260709 12:26:47.344202  5767 ts_manager.cc:194] Registered new tserver with Master: 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:47.344734 30223 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014621409s
I20260709 12:26:47.345721  5767 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58078
I20260709 12:26:47.370023  5767 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58080:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:47.372730  5767 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:47.437737  5859 tablet_service.cc:1511] Processing CreateTablet for tablet c7c99e15ae874c61ab046933f682f1c8 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:47.439127  5859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c99e15ae874c61ab046933f682f1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.440068  5856 tablet_service.cc:1511] Processing CreateTablet for tablet deecd603222343a5b7b6a242eb08915c (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:47.441576  5856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deecd603222343a5b7b6a242eb08915c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.444414  5857 tablet_service.cc:1511] Processing CreateTablet for tablet 9622eb4caff840aa820ddafbbb577201 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:47.445874  5857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9622eb4caff840aa820ddafbbb577201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.447749  5858 tablet_service.cc:1511] Processing CreateTablet for tablet 361d45b0b83e4c6089c7f122b30e3601 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:47.449215  5858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361d45b0b83e4c6089c7f122b30e3601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.463184  6058 tablet_bootstrap.cc:492] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:47.469926  6058 tablet_bootstrap.cc:654] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.471971  5859 tablet_service.cc:1511] Processing CreateTablet for tablet f6ab5bf3c8a4420d8bc22d00738e797f (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:47.473429  5859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ab5bf3c8a4420d8bc22d00738e797f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.483484  5856 tablet_service.cc:1511] Processing CreateTablet for tablet ba6f8897ba614282b8394547263b8325 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:47.484913  5856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6f8897ba614282b8394547263b8325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.485517  6058 tablet_bootstrap.cc:492] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:47.485304  5858 tablet_service.cc:1511] Processing CreateTablet for tablet 809b1a993e9a4c8eb37fe9de41fa0bd0 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:47.486192  6058 ts_tablet_manager.cc:1403] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:26:47.486641  5858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809b1a993e9a4c8eb37fe9de41fa0bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.489341  6058 raft_consensus.cc:359] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.490223  6058 raft_consensus.cc:385] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.490576  6058 raft_consensus.cc:740] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.491508  6058 consensus_queue.cc:260] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.494022  5857 tablet_service.cc:1511] Processing CreateTablet for tablet 85059102981a446ca6d92eb639594fbd (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:47.495659  5857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85059102981a446ca6d92eb639594fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.501746  5894 heartbeater.cc:499] Master 127.29.131.254:36709 was elected leader, sending a full tablet report...
I20260709 12:26:47.502357  6058 ts_tablet_manager.cc:1434] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 12:26:47.491520  5859 tablet_service.cc:1511] Processing CreateTablet for tablet 41f3cbbe1ef54755b6cae882276fabb1 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:47.503589  6058 tablet_bootstrap.cc:492] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:47.508766  6008 tablet_service.cc:1511] Processing CreateTablet for tablet c7c99e15ae874c61ab046933f682f1c8 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:47.509879  6058 tablet_bootstrap.cc:654] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.510130  6008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c99e15ae874c61ab046933f682f1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.511940  6007 tablet_service.cc:1511] Processing CreateTablet for tablet 361d45b0b83e4c6089c7f122b30e3601 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:47.513600  6007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361d45b0b83e4c6089c7f122b30e3601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.513762  5934 tablet_service.cc:1511] Processing CreateTablet for tablet c7c99e15ae874c61ab046933f682f1c8 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:47.515264  5934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c99e15ae874c61ab046933f682f1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.516651  6006 tablet_service.cc:1511] Processing CreateTablet for tablet 9622eb4caff840aa820ddafbbb577201 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:47.517946  6006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9622eb4caff840aa820ddafbbb577201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.520658  6005 tablet_service.cc:1511] Processing CreateTablet for tablet deecd603222343a5b7b6a242eb08915c (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:47.522418  6005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deecd603222343a5b7b6a242eb08915c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.524618  6004 tablet_service.cc:1511] Processing CreateTablet for tablet f6ab5bf3c8a4420d8bc22d00738e797f (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:47.525323  5932 tablet_service.cc:1511] Processing CreateTablet for tablet 9622eb4caff840aa820ddafbbb577201 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:47.526410  6004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ab5bf3c8a4420d8bc22d00738e797f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.526753  5932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9622eb4caff840aa820ddafbbb577201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.526816  5859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f3cbbe1ef54755b6cae882276fabb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.528677  6003 tablet_service.cc:1511] Processing CreateTablet for tablet ba6f8897ba614282b8394547263b8325 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:47.530431  6003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6f8897ba614282b8394547263b8325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.525323  5933 tablet_service.cc:1511] Processing CreateTablet for tablet 361d45b0b83e4c6089c7f122b30e3601 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:47.532595  5933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361d45b0b83e4c6089c7f122b30e3601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.532646  6001 tablet_service.cc:1511] Processing CreateTablet for tablet 41f3cbbe1ef54755b6cae882276fabb1 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:47.534463  6001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f3cbbe1ef54755b6cae882276fabb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.540638  6002 tablet_service.cc:1511] Processing CreateTablet for tablet 809b1a993e9a4c8eb37fe9de41fa0bd0 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:47.542404  6002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809b1a993e9a4c8eb37fe9de41fa0bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.544903  5931 tablet_service.cc:1511] Processing CreateTablet for tablet deecd603222343a5b7b6a242eb08915c (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:47.546262  5931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deecd603222343a5b7b6a242eb08915c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.536672  6000 tablet_service.cc:1511] Processing CreateTablet for tablet 85059102981a446ca6d92eb639594fbd (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:47.548775  6000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85059102981a446ca6d92eb639594fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.552330  5929 tablet_service.cc:1511] Processing CreateTablet for tablet ba6f8897ba614282b8394547263b8325 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:47.553658  5929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6f8897ba614282b8394547263b8325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.556316  5928 tablet_service.cc:1511] Processing CreateTablet for tablet 809b1a993e9a4c8eb37fe9de41fa0bd0 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:47.557741  5928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809b1a993e9a4c8eb37fe9de41fa0bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.551044  5930 tablet_service.cc:1511] Processing CreateTablet for tablet f6ab5bf3c8a4420d8bc22d00738e797f (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:47.561113  5930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ab5bf3c8a4420d8bc22d00738e797f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.563045  5927 tablet_service.cc:1511] Processing CreateTablet for tablet 41f3cbbe1ef54755b6cae882276fabb1 (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:47.564823  5927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f3cbbe1ef54755b6cae882276fabb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.568351  5926 tablet_service.cc:1511] Processing CreateTablet for tablet 85059102981a446ca6d92eb639594fbd (DEFAULT_TABLE table=test-workload [id=098cb75d39b34293b404d621ae38ce44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:47.569840  5926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85059102981a446ca6d92eb639594fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.620179  6058 tablet_bootstrap.cc:492] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:47.620839  6058 ts_tablet_manager.cc:1403] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.117s	user 0.023s	sys 0.070s
I20260709 12:26:47.623792  6058 raft_consensus.cc:359] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.632009  6062 tablet_bootstrap.cc:492] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:47.638469  6062 tablet_bootstrap.cc:654] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.624516  6058 raft_consensus.cc:385] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.655649  6058 raft_consensus.cc:740] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.656445  6058 consensus_queue.cc:260] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.669747  6058 ts_tablet_manager.cc:1434] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.001s
I20260709 12:26:47.670902  6058 tablet_bootstrap.cc:492] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:47.676981  6063 tablet_bootstrap.cc:492] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:47.685245  6063 tablet_bootstrap.cc:654] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.688944  6062 tablet_bootstrap.cc:492] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:47.689581  6062 ts_tablet_manager.cc:1403] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 12:26:47.690121  6058 tablet_bootstrap.cc:654] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.691622  6063 tablet_bootstrap.cc:492] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:47.692123  6063 ts_tablet_manager.cc:1403] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:26:47.692983  6062 raft_consensus.cc:359] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.694176  6062 raft_consensus.cc:385] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.694585  6062 raft_consensus.cc:740] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.694793  6063 raft_consensus.cc:359] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.695519  6063 raft_consensus.cc:385] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.695851  6063 raft_consensus.cc:740] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.695783  6062 consensus_queue.cc:260] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.696856  6063 consensus_queue.cc:260] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.698026  6058 tablet_bootstrap.cc:492] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:47.698438  5969 heartbeater.cc:499] Master 127.29.131.254:36709 was elected leader, sending a full tablet report...
I20260709 12:26:47.698686  6058 ts_tablet_manager.cc:1403] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.004s
I20260709 12:26:47.698918  6062 ts_tablet_manager.cc:1434] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:47.699991  6062 tablet_bootstrap.cc:492] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:47.702711  6058 raft_consensus.cc:359] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.703706  6058 raft_consensus.cc:385] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.704272  6058 raft_consensus.cc:740] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.706102  6062 tablet_bootstrap.cc:654] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.705765  6058 consensus_queue.cc:260] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.707000  6060 raft_consensus.cc:493] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.707607  6060 raft_consensus.cc:515] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.711925  6043 heartbeater.cc:499] Master 127.29.131.254:36709 was elected leader, sending a full tablet report...
I20260709 12:26:47.712323  6063 ts_tablet_manager.cc:1434] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.014s
I20260709 12:26:47.713459  6063 tablet_bootstrap.cc:492] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:47.715983  6067 raft_consensus.cc:493] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.716569  6067 raft_consensus.cc:515] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.719924  6063 tablet_bootstrap.cc:654] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.722520  6067 leader_election.cc:290] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:47.727555  6060 leader_election.cc:290] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:47.733377  6058 ts_tablet_manager.cc:1434] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:26:47.735499  6062 tablet_bootstrap.cc:492] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:47.736449  6062 ts_tablet_manager.cc:1403] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260709 12:26:47.739662  6062 raft_consensus.cc:359] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.740383  6062 raft_consensus.cc:385] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.740693  6062 raft_consensus.cc:740] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.745079  6062 consensus_queue.cc:260] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.745930  6058 tablet_bootstrap.cc:492] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:47.748974  6062 ts_tablet_manager.cc:1434] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:47.750072  6062 tablet_bootstrap.cc:492] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:47.763036  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
W20260709 12:26:47.766215  5908 leader_election.cc:343] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.766034  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:47.767104  5869 raft_consensus.cc:2468] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:47.769461  6062 tablet_bootstrap.cc:654] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.773276  5908 leader_election.cc:304] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:47.774457  6067 raft_consensus.cc:2804] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.774833  6067 raft_consensus.cc:493] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.775171  6067 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.781015  6058 tablet_bootstrap.cc:654] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.783051  6067 raft_consensus.cc:515] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.786392  6067 leader_election.cc:290] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:47.788954  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:47.789844  5869 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.795817  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:47.798903  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
W20260709 12:26:47.801023  5833 leader_election.cc:343] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:47.802060  5908 leader_election.cc:343] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.808867  5869 raft_consensus.cc:2468] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:47.810359  5908 leader_election.cc:304] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:47.811582  6067 raft_consensus.cc:2804] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.811990  6062 tablet_bootstrap.cc:492] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:47.812549  6062 ts_tablet_manager.cc:1403] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.014s
I20260709 12:26:47.813984  6063 tablet_bootstrap.cc:492] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:47.814117  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:47.814849  6063 ts_tablet_manager.cc:1403] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.102s	user 0.040s	sys 0.055s
I20260709 12:26:47.815376  6058 tablet_bootstrap.cc:492] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
W20260709 12:26:47.815770  5833 leader_election.cc:343] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.816304  5833 leader_election.cc:304] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:47.817143  6060 raft_consensus.cc:2749] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.815889  6058 ts_tablet_manager.cc:1403] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.004s
I20260709 12:26:47.818137  6063 raft_consensus.cc:359] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.819151  6063 raft_consensus.cc:385] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.817397  6062 raft_consensus.cc:359] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.819700  6063 raft_consensus.cc:740] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.819655  6058 raft_consensus.cc:359] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.820246  6062 raft_consensus.cc:385] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.820638  6058 raft_consensus.cc:385] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.820817  6062 raft_consensus.cc:740] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.820991  6058 raft_consensus.cc:740] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.821182  6063 consensus_queue.cc:260] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.821919  6062 consensus_queue.cc:260] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.821919  6058 consensus_queue.cc:260] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.825137  6067 raft_consensus.cc:697] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:47.826076  6067 consensus_queue.cc:237] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.831391  6063 ts_tablet_manager.cc:1434] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:26:47.837193  6063 tablet_bootstrap.cc:492] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:47.838795  5765 catalog_manager.cc:5697] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.842491  6058 ts_tablet_manager.cc:1434] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:26:47.843777  6063 tablet_bootstrap.cc:654] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.852087  6062 ts_tablet_manager.cc:1434] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.039s	user 0.017s	sys 0.016s
I20260709 12:26:47.852227  6058 tablet_bootstrap.cc:492] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:47.853344  6062 tablet_bootstrap.cc:492] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:47.855311  6063 tablet_bootstrap.cc:492] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:47.855896  6063 ts_tablet_manager.cc:1403] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:26:47.858892  6063 raft_consensus.cc:359] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.859648  6063 raft_consensus.cc:385] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.859680  6058 tablet_bootstrap.cc:654] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.859733  6062 tablet_bootstrap.cc:654] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.860159  6063 raft_consensus.cc:740] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.861171  6063 consensus_queue.cc:260] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.865629  6063 ts_tablet_manager.cc:1434] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:47.865909  6058 tablet_bootstrap.cc:492] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:47.866475  6062 tablet_bootstrap.cc:492] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:47.866675  6063 tablet_bootstrap.cc:492] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:47.866516  6058 ts_tablet_manager.cc:1403] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:26:47.867179  6062 ts_tablet_manager.cc:1403] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.008s
I20260709 12:26:47.870163  6058 raft_consensus.cc:359] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.871065  6058 raft_consensus.cc:385] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.870751  6062 raft_consensus.cc:359] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.871618  6062 raft_consensus.cc:385] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.871474  6058 raft_consensus.cc:740] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.872143  6062 raft_consensus.cc:740] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.872951  6062 consensus_queue.cc:260] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.873044  6058 consensus_queue.cc:260] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.873809  6063 tablet_bootstrap.cc:654] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.875687  6058 ts_tablet_manager.cc:1434] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:47.876876  6058 tablet_bootstrap.cc:492] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:47.882717  6062 ts_tablet_manager.cc:1434] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:47.883489  6058 tablet_bootstrap.cc:654] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.884243  6062 tablet_bootstrap.cc:492] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:47.893679  6062 tablet_bootstrap.cc:654] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.906960  6062 tablet_bootstrap.cc:492] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:47.907701  6062 ts_tablet_manager.cc:1403] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.014s
I20260709 12:26:47.910688  6058 tablet_bootstrap.cc:492] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:47.911264  6058 ts_tablet_manager.cc:1403] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.016s
I20260709 12:26:47.911819  6063 tablet_bootstrap.cc:492] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:47.911512  6062 raft_consensus.cc:359] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.912364  6063 ts_tablet_manager.cc:1403] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.023s
I20260709 12:26:47.912344  6062 raft_consensus.cc:385] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.912916  6062 raft_consensus.cc:740] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.913754  6062 consensus_queue.cc:260] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.914070  6058 raft_consensus.cc:359] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.914770  6058 raft_consensus.cc:385] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.915047  6058 raft_consensus.cc:740] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.915584  6063 raft_consensus.cc:359] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.915794  6058 consensus_queue.cc:260] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.916396  6063 raft_consensus.cc:385] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.916464  6062 ts_tablet_manager.cc:1434] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:26:47.916772  6063 raft_consensus.cc:740] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.917594  6062 tablet_bootstrap.cc:492] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:47.917666  6063 consensus_queue.cc:260] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.921073  6058 ts_tablet_manager.cc:1434] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:47.922109  6058 tablet_bootstrap.cc:492] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:47.922820  6063 ts_tablet_manager.cc:1434] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:47.923935  6063 tablet_bootstrap.cc:492] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:47.925036  6062 tablet_bootstrap.cc:654] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.928539  6058 tablet_bootstrap.cc:654] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.929802  6060 raft_consensus.cc:493] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.930418  6060 raft_consensus.cc:515] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.931105  6063 tablet_bootstrap.cc:654] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.932927  6060 leader_election.cc:290] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:47.935326  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d45b0b83e4c6089c7f122b30e3601" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:47.935963  6077 raft_consensus.cc:493] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.936564  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d45b0b83e4c6089c7f122b30e3601" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:47.936625  6077 raft_consensus.cc:515] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
W20260709 12:26:47.938264  5833 leader_election.cc:343] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.937356  5944 raft_consensus.cc:2468] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:47.942198  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622eb4caff840aa820ddafbbb577201" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:47.942917  6018 raft_consensus.cc:2468] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:47.942910  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622eb4caff840aa820ddafbbb577201" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:47.943619  6063 tablet_bootstrap.cc:492] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:47.943765  5869 raft_consensus.cc:2468] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:47.944144  6063 ts_tablet_manager.cc:1403] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 12:26:47.944224  6058 tablet_bootstrap.cc:492] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:47.944597  6077 leader_election.cc:290] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:47.946297  5833 leader_election.cc:304] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:47.946614  6058 ts_tablet_manager.cc:1403] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 12:26:47.944309  5908 leader_election.cc:304] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:47.947635  6063 raft_consensus.cc:359] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.948132  6077 raft_consensus.cc:2804] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.948400  6063 raft_consensus.cc:385] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.948730  6077 raft_consensus.cc:493] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.948767  6063 raft_consensus.cc:740] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.949188  6077 raft_consensus.cc:3060] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.949661  6058 raft_consensus.cc:359] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.949832  6063 consensus_queue.cc:260] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.950450  6058 raft_consensus.cc:385] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.950809  6058 raft_consensus.cc:740] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.951673  6058 consensus_queue.cc:260] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.952520  6063 ts_tablet_manager.cc:1434] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:47.953614  6063 tablet_bootstrap.cc:492] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:47.958701  6062 tablet_bootstrap.cc:492] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:47.959342  6062 ts_tablet_manager.cc:1403] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.012s
I20260709 12:26:47.960373  6063 tablet_bootstrap.cc:654] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.958730  6060 raft_consensus.cc:2804] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.963795  6060 raft_consensus.cc:493] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.964226  6060 raft_consensus.cc:3060] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.962566  6062 raft_consensus.cc:359] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.970562  6062 raft_consensus.cc:385] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.970902  6062 raft_consensus.cc:740] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.972082  6063 tablet_bootstrap.cc:492] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:47.972687  6063 ts_tablet_manager.cc:1403] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
W20260709 12:26:47.974476  5815 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:47.975790  6063 raft_consensus.cc:359] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.976536  6063 raft_consensus.cc:385] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.976850  6063 raft_consensus.cc:740] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.978318  6058 ts_tablet_manager.cc:1434] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.022s
I20260709 12:26:47.977967  6063 consensus_queue.cc:260] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.978735  6062 consensus_queue.cc:260] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.980427  6077 raft_consensus.cc:515] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.980796  6063 ts_tablet_manager.cc:1434] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:26:47.980808  6058 tablet_bootstrap.cc:492] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:47.981976  6063 tablet_bootstrap.cc:492] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:47.983637  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622eb4caff840aa820ddafbbb577201" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:47.984305  5869 raft_consensus.cc:3060] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.984849  6062 ts_tablet_manager.cc:1434] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:26:47.986038  6062 tablet_bootstrap.cc:492] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:47.988051  6058 tablet_bootstrap.cc:654] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.989286  6063 tablet_bootstrap.cc:654] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.975473  6060 raft_consensus.cc:515] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.992101  6068 raft_consensus.cc:493] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.992609  6068 raft_consensus.cc:515] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.994902  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622eb4caff840aa820ddafbbb577201" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:47.995203  6068 leader_election.cc:290] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:47.995566  6018 raft_consensus.cc:3060] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.996811  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d45b0b83e4c6089c7f122b30e3601" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:47.997434  5944 raft_consensus.cc:3060] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.998219  6067 raft_consensus.cc:493] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.999316  6058 tablet_bootstrap.cc:492] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:47.998895  6067 raft_consensus.cc:515] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:47.999850  6058 ts_tablet_manager.cc:1403] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:26:48.001718  6067 leader_election.cc:290] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.002950  6058 raft_consensus.cc:359] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.003688  6058 raft_consensus.cc:385] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.003957  6058 raft_consensus.cc:740] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.004315  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059102981a446ca6d92eb639594fbd" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:48.004851  6058 consensus_queue.cc:260] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.006654  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059102981a446ca6d92eb639594fbd" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:48.007066  6058 ts_tablet_manager.cc:1434] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:48.007541  6017 raft_consensus.cc:2468] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:48.008082  6058 tablet_bootstrap.cc:492] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:48.013055  5908 leader_election.cc:304] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
W20260709 12:26:48.014176  5908 leader_election.cc:343] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.014551  6058 tablet_bootstrap.cc:654] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.015358  6076 raft_consensus.cc:493] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.015887  6076 raft_consensus.cc:515] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.017248  6063 tablet_bootstrap.cc:492] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:48.017791  6063 ts_tablet_manager.cc:1403] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 12:26:48.018242  6076 leader_election.cc:290] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.018823  6076 raft_consensus.cc:2804] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.020882  6063 raft_consensus.cc:359] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.021633  6063 raft_consensus.cc:385] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.021925  6063 raft_consensus.cc:740] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.026407  6058 tablet_bootstrap.cc:492] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:48.026971  6058 ts_tablet_manager.cc:1403] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:26:48.028831  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ab5bf3c8a4420d8bc22d00738e797f" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:48.029651  6058 raft_consensus.cc:359] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.028831  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ab5bf3c8a4420d8bc22d00738e797f" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:48.030373  6058 raft_consensus.cc:385] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.030716  5868 raft_consensus.cc:2468] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:48.030725  6058 raft_consensus.cc:740] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.019155  6076 raft_consensus.cc:493] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.031625  6058 consensus_queue.cc:260] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.031898  5908 leader_election.cc:304] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.032822  6067 raft_consensus.cc:2804] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.033732  6067 raft_consensus.cc:493] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.034261  6067 raft_consensus.cc:3060] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.034758  6063 consensus_queue.cc:260] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
W20260709 12:26:48.032882  5908 leader_election.cc:343] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.038703  6063 ts_tablet_manager.cc:1434] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.021s	user 0.000s	sys 0.008s
I20260709 12:26:48.038810  6068 raft_consensus.cc:493] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.039580  6068 raft_consensus.cc:515] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.042295  6068 leader_election.cc:290] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:48.032166  6076 raft_consensus.cc:3060] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.047518  5944 raft_consensus.cc:2468] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:48.048800  5833 leader_election.cc:304] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.050098  6058 ts_tablet_manager.cc:1434] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.023s	user 0.014s	sys 0.008s
I20260709 12:26:48.051123  6088 raft_consensus.cc:2804] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.051614  6088 raft_consensus.cc:697] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:48.052016  5869 raft_consensus.cc:2468] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:48.052513  6088 consensus_queue.cc:237] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.053472  6063 tablet_bootstrap.cc:492] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:48.053603  5908 leader_election.cc:304] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.061843  6062 tablet_bootstrap.cc:654] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.062685  6095 raft_consensus.cc:2804] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.050261  6077 leader_election.cc:290] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.067951  6060 leader_election.cc:290] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.069224  6018 raft_consensus.cc:2468] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:48.071470  6077 raft_consensus.cc:493] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.071898  6063 tablet_bootstrap.cc:654] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.071920  6077 raft_consensus.cc:515] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.074230  6077 leader_election.cc:290] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.077003  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:48.080121  5869 raft_consensus.cc:2468] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:48.081601  5908 leader_election.cc:304] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.081995  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d45b0b83e4c6089c7f122b30e3601" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.082500  6077 raft_consensus.cc:2804] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.082682  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:48.082623  6017 raft_consensus.cc:3060] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.083779  6018 raft_consensus.cc:2468] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:48.092011  6067 raft_consensus.cc:515] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.094673  6067 leader_election.cc:290] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.083168  6077 raft_consensus.cc:493] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.095685  6077 raft_consensus.cc:3060] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.095423  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ab5bf3c8a4420d8bc22d00738e797f" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.097081  5869 raft_consensus.cc:3060] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.083446  6076 raft_consensus.cc:515] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.101195  6068 raft_consensus.cc:493] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.101920  6068 raft_consensus.cc:515] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.104385  6068 leader_election.cc:290] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:48.106541  6076 leader_election.cc:290] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.108791  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059102981a446ca6d92eb639594fbd" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.109643  5868 raft_consensus.cc:3060] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.113723  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ab5bf3c8a4420d8bc22d00738e797f" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.119194  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059102981a446ca6d92eb639594fbd" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.119939  6016 raft_consensus.cc:3060] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.129022  6063 tablet_bootstrap.cc:492] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:48.129801  6063 ts_tablet_manager.cc:1403] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.017s
W20260709 12:26:48.129837  5908 leader_election.cc:343] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.133708  6063 raft_consensus.cc:359] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.134666  6063 raft_consensus.cc:385] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.135046  6063 raft_consensus.cc:740] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.136001  6063 consensus_queue.cc:260] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.138778  6063 ts_tablet_manager.cc:1434] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:48.139704  5869 raft_consensus.cc:2468] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:48.140096  6063 tablet_bootstrap.cc:492] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:48.141426  5908 leader_election.cc:304] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:48.142412  6062 tablet_bootstrap.cc:492] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:48.142620  6099 raft_consensus.cc:2804] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.143087  6062 ts_tablet_manager.cc:1403] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.157s	user 0.013s	sys 0.005s
I20260709 12:26:48.143191  6099 raft_consensus.cc:697] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.144388  6099 consensus_queue.cc:237] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.146867  6063 tablet_bootstrap.cc:654] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.148917  6016 raft_consensus.cc:2468] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:48.114573  6095 raft_consensus.cc:697] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.153416  6095 consensus_queue.cc:237] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.149650  6017 raft_consensus.cc:2468] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:48.156333  6063 tablet_bootstrap.cc:492] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:48.156903  6063 ts_tablet_manager.cc:1403] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.003s
I20260709 12:26:48.160198  6063 raft_consensus.cc:359] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.160454  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:48.160933  6063 raft_consensus.cc:385] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.161298  6063 raft_consensus.cc:740] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.161453  5869 raft_consensus.cc:2468] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 0.
I20260709 12:26:48.162081  5908 leader_election.cc:304] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.162125  6063 consensus_queue.cc:260] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.162912  5982 leader_election.cc:304] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:48.163476  5867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:48.164088  6068 raft_consensus.cc:2804] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.146808  6062 raft_consensus.cc:359] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.164405  5867 raft_consensus.cc:2393] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 038a4934597746cb85b58eca24e2b1ec in current term 1: Already voted for candidate 80d6943d1ad94734981b057b3b4a5607 in this term.
I20260709 12:26:48.164467  6068 raft_consensus.cc:493] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.164997  6068 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.165725  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6f8897ba614282b8394547263b8325" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:48.166432  5866 raft_consensus.cc:2468] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 0.
I20260709 12:26:48.166548  6077 raft_consensus.cc:515] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.161199  5765 catalog_manager.cc:5697] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.168781  6077 leader_election.cc:290] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.169919  6076 raft_consensus.cc:2804] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.170441  6076 raft_consensus.cc:697] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.170874  5868 raft_consensus.cc:2468] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:48.171069  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.171339  6076 consensus_queue.cc:237] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.172041  5866 raft_consensus.cc:3060] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.172379  5982 leader_election.cc:304] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:48.169528  6062 raft_consensus.cc:385] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.173859  6062 raft_consensus.cc:740] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.174664  6062 consensus_queue.cc:260] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.176457  6063 ts_tablet_manager.cc:1434] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:26:48.178825  6062 ts_tablet_manager.cc:1434] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:26:48.180289  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.180992  6017 raft_consensus.cc:3060] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.172866  6068 raft_consensus.cc:515] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.184587  5866 raft_consensus.cc:2468] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:48.186806  6062 tablet_bootstrap.cc:492] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:48.190325  6105 raft_consensus.cc:2804] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.192718  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:48.193687  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:48.199817  5944 raft_consensus.cc:2468] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 0.
I20260709 12:26:48.195572  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6f8897ba614282b8394547263b8325" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:48.201634  6068 leader_election.cc:290] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:48.200166  6105 raft_consensus.cc:493] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.203426  5908 leader_election.cc:304] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.204608  6105 raft_consensus.cc:3060] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.203560  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.204916  6077 raft_consensus.cc:2804] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.205369  5868 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.205528  6077 raft_consensus.cc:697] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.206537  6077 consensus_queue.cc:237] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.212617  6017 raft_consensus.cc:2468] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:48.214269  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:48.214979  5942 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.215783  5868 raft_consensus.cc:2468] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 1.
I20260709 12:26:48.215199  5766 catalog_manager.cc:5697] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.216640  6062 tablet_bootstrap.cc:654] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.222102  5942 raft_consensus.cc:2468] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 1.
I20260709 12:26:48.224187  5982 leader_election.cc:304] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec; no voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607
W20260709 12:26:48.225389  5982 leader_election.cc:343] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.226235  6062 tablet_bootstrap.cc:492] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:48.226563  6068 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.226764  6062 ts_tablet_manager.cc:1403] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.004s
I20260709 12:26:48.226976  6088 raft_consensus.cc:493] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.227514  6088 raft_consensus.cc:515] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.229671  6088 leader_election.cc:290] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.226310  5982 leader_election.cc:304] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.231590  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809b1a993e9a4c8eb37fe9de41fa0bd0" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:48.232458  6017 raft_consensus.cc:2468] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:48.232517  6062 raft_consensus.cc:359] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.232731  6105 raft_consensus.cc:515] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.233292  6062 raft_consensus.cc:385] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.233580  6062 raft_consensus.cc:740] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.234247  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809b1a993e9a4c8eb37fe9de41fa0bd0" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:48.234484  6062 consensus_queue.cc:260] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.234853  6105 leader_election.cc:290] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:48.235512  5942 raft_consensus.cc:2468] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:48.235543  6105 raft_consensus.cc:2804] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.235579  5833 leader_election.cc:304] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:48.236284  6105 raft_consensus.cc:697] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Becoming Leader. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:48.235033  6068 raft_consensus.cc:2749] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.236907  6062 ts_tablet_manager.cc:1434] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:48.237243  6088 raft_consensus.cc:2804] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.237128  6105 consensus_queue.cc:237] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.237951  6062 tablet_bootstrap.cc:492] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:48.238013  6088 raft_consensus.cc:493] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.238824  6088 raft_consensus.cc:3060] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.242172  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6f8897ba614282b8394547263b8325" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.242839  5868 raft_consensus.cc:3060] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.245438  6062 tablet_bootstrap.cc:654] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.251094  5766 catalog_manager.cc:5697] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.251757  5868 raft_consensus.cc:2468] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 1.
I20260709 12:26:48.253819  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6f8897ba614282b8394547263b8325" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:48.255105  6088 raft_consensus.cc:515] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.256834  5982 leader_election.cc:304] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:48.257655  6062 tablet_bootstrap.cc:492] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:48.258231  6062 ts_tablet_manager.cc:1403] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
W20260709 12:26:48.257793  5982 leader_election.cc:343] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.257772  5766 catalog_manager.cc:5697] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.260000  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809b1a993e9a4c8eb37fe9de41fa0bd0" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:48.260401  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809b1a993e9a4c8eb37fe9de41fa0bd0" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.260639  5942 raft_consensus.cc:3060] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.259878  5766 catalog_manager.cc:5697] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.260970  6017 raft_consensus.cc:3060] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.261337  6062 raft_consensus.cc:359] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.262004  6062 raft_consensus.cc:385] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.262256  6062 raft_consensus.cc:740] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.263043  6062 consensus_queue.cc:260] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.265436  6062 ts_tablet_manager.cc:1434] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:48.266651  6105 raft_consensus.cc:2804] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.267426  6105 raft_consensus.cc:697] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Becoming Leader. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:48.268115  5942 raft_consensus.cc:2468] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:48.268224  6105 consensus_queue.cc:237] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.269582  5833 leader_election.cc:304] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.270625  6094 raft_consensus.cc:2804] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.271117  6094 raft_consensus.cc:697] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:48.271306  5765 catalog_manager.cc:5697] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 038a4934597746cb85b58eca24e2b1ec (127.29.131.195). New cstate: current_term: 1 leader_uuid: "038a4934597746cb85b58eca24e2b1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.271996  6094 consensus_queue.cc:237] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.275076  6017 raft_consensus.cc:2468] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:48.277920  6088 leader_election.cc:290] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.291900  5766 catalog_manager.cc:5697] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.294579  5765 catalog_manager.cc:5697] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 038a4934597746cb85b58eca24e2b1ec (127.29.131.195). New cstate: current_term: 1 leader_uuid: "038a4934597746cb85b58eca24e2b1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.358861  6105 raft_consensus.cc:493] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.359414  6105 raft_consensus.cc:515] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.361290  6105 leader_election.cc:290] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:48.362042  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ab5bf3c8a4420d8bc22d00738e797f" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:48.362381  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ab5bf3c8a4420d8bc22d00738e797f" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:48.362797  5868 raft_consensus.cc:2393] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 038a4934597746cb85b58eca24e2b1ec in current term 1: Already voted for candidate 80d6943d1ad94734981b057b3b4a5607 in this term.
I20260709 12:26:48.364121  5982 leader_election.cc:304] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec; no voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:48.364833  6105 raft_consensus.cc:3060] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.370647  6105 raft_consensus.cc:2749] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.395208  6077 consensus_queue.cc:1048] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.401341  5942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
mode: GRACEFUL
new_leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:26:48.401937  5942 raft_consensus.cc:606] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Received request to transfer leadership to TS 3d3f3ea7af0d40cc8866aa9b7a32207d
I20260709 12:26:48.404495  6095 raft_consensus.cc:993] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607: : Instructing follower 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:48.405421  6076 raft_consensus.cc:1081] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Signalling peer 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:48.408406  5866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:58624
I20260709 12:26:48.411016  5866 raft_consensus.cc:493] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.411494  5866 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.416334  5942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9622eb4caff840aa820ddafbbb577201"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
mode: GRACEFUL
new_leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:26:48.417034  5942 raft_consensus.cc:606] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Received request to transfer leadership to TS 3d3f3ea7af0d40cc8866aa9b7a32207d
I20260709 12:26:48.419029  6076 consensus_queue.cc:1048] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.421463  5866 raft_consensus.cc:515] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.426242  5866 leader_election.cc:290] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.428225  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:48.428860  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.428920  5942 raft_consensus.cc:3055] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:48.431169  5943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
mode: GRACEFUL
new_leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:26:48.432061  5943 raft_consensus.cc:606] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Received request to transfer leadership to TS 3d3f3ea7af0d40cc8866aa9b7a32207d
I20260709 12:26:48.433362  5942 raft_consensus.cc:740] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.434731  5942 consensus_queue.cc:260] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.436172  5942 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.445148  5942 raft_consensus.cc:2468] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 2.
I20260709 12:26:48.446382  5833 leader_election.cc:304] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:48.447348  6094 raft_consensus.cc:2804] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:48.447925  6094 raft_consensus.cc:697] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:48.448740  6094 consensus_queue.cc:237] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.458453  5766 catalog_manager.cc:5697] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 1 to 2, leader changed from 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194) to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 2 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.461817  6094 consensus_queue.cc:1048] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.463730  6017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba6f8897ba614282b8394547263b8325"
dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
mode: GRACEFUL
new_leader_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:52470
I20260709 12:26:48.464462  6017 raft_consensus.cc:606] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Received request to transfer leadership to TS 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:48.477530  6060 consensus_queue.cc:1048] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.485929  5866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "809b1a993e9a4c8eb37fe9de41fa0bd0"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
mode: GRACEFUL
new_leader_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:58644
I20260709 12:26:48.486867  5866 raft_consensus.cc:606] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Received request to transfer leadership to TS 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:48.496491  6017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1"
dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
mode: GRACEFUL
new_leader_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:52470
I20260709 12:26:48.497201  6017 raft_consensus.cc:606] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Received request to transfer leadership to TS 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:48.502662  5942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85059102981a446ca6d92eb639594fbd"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
mode: GRACEFUL
new_leader_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:26:48.503176  5942 raft_consensus.cc:606] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Received request to transfer leadership to TS 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:48.600270  6095 consensus_queue.cc:1048] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.613005  6077 consensus_queue.cc:1048] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.625500  6095 raft_consensus.cc:493] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.625584  6077 consensus_queue.cc:1048] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.625903  6099 consensus_queue.cc:1048] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.626308  6095 raft_consensus.cc:515] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.628423  6076 raft_consensus.cc:993] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607: : Instructing follower 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:48.628935  6077 raft_consensus.cc:1081] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Signalling peer 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:48.629397  6095 leader_election.cc:290] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.631784  6018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6f8897ba614282b8394547263b8325" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:48.632934  6015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85059102981a446ca6d92eb639594fbd"
dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:52450
I20260709 12:26:48.633613  6015 raft_consensus.cc:493] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.634035  6015 raft_consensus.cc:3060] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.640385  6015 raft_consensus.cc:515] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.641333  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6f8897ba614282b8394547263b8325" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:48.642230  5866 raft_consensus.cc:2393] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80d6943d1ad94734981b057b3b4a5607 in current term 1: Already voted for candidate 038a4934597746cb85b58eca24e2b1ec in this term.
I20260709 12:26:48.642760  6015 leader_election.cc:290] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:48.644423  6076 consensus_queue.cc:1048] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.647693  5908 leader_election.cc:304] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80d6943d1ad94734981b057b3b4a5607; no voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d
I20260709 12:26:48.647971  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059102981a446ca6d92eb639594fbd" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:48.647720  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059102981a446ca6d92eb639594fbd" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.649870  5866 raft_consensus.cc:3060] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.648798  5942 raft_consensus.cc:3055] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:48.650162  6076 raft_consensus.cc:3060] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.650820  5942 raft_consensus.cc:740] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.651798  5942 consensus_queue.cc:260] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.653141  5942 raft_consensus.cc:3060] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.658840  5866 raft_consensus.cc:2468] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 2.
I20260709 12:26:48.660357  5982 leader_election.cc:304] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:48.661434  6105 raft_consensus.cc:2804] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:48.661980  6105 raft_consensus.cc:697] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 2 LEADER]: Becoming Leader. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:48.662879  6105 consensus_queue.cc:237] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.664567  5942 raft_consensus.cc:2468] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 2.
I20260709 12:26:48.664814  6099 consensus_queue.cc:1048] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.667946  6068 consensus_queue.cc:1048] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.684399  6076 raft_consensus.cc:2749] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.684535  6088 consensus_queue.cc:1048] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.687915  6068 raft_consensus.cc:993] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec: : Instructing follower 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:48.688709  6108 raft_consensus.cc:1081] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Signalling peer 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:48.693406  5942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:38454
I20260709 12:26:48.698616  5942 raft_consensus.cc:493] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.699033  5942 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.710870  5942 raft_consensus.cc:515] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.710681  5765 catalog_manager.cc:5697] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec reported cstate change: term changed from 1 to 2, leader changed from 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194) to 038a4934597746cb85b58eca24e2b1ec (127.29.131.195). New cstate: current_term: 2 leader_uuid: "038a4934597746cb85b58eca24e2b1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.714275  6076 raft_consensus.cc:993] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607: : Instructing follower 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:48.714841  6076 raft_consensus.cc:1081] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Signalling peer 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:48.720403  6129 consensus_queue.cc:1048] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.723377  5942 leader_election.cc:290] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.727474  5866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9622eb4caff840aa820ddafbbb577201"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:58624
I20260709 12:26:48.727509  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.728421  5866 raft_consensus.cc:493] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.728538  6016 raft_consensus.cc:3055] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:48.728906  5866 raft_consensus.cc:3060] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.730191  6016 raft_consensus.cc:740] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:48.730463  5867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.731815  6016 consensus_queue.cc:260] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.732533  6095 consensus_queue.cc:1048] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.733104  6016 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.746788  5866 raft_consensus.cc:515] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.748963  6121 consensus_queue.cc:1048] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.750216  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622eb4caff840aa820ddafbbb577201" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:48.750926  5943 raft_consensus.cc:3055] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:48.751283  5943 raft_consensus.cc:740] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.751705  6016 raft_consensus.cc:2468] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:48.752235  5943 consensus_queue.cc:260] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.753557  5943 raft_consensus.cc:3060] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.757689  5866 leader_election.cc:290] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.759430  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622eb4caff840aa820ddafbbb577201" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.759929  5908 leader_election.cc:304] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 3d3f3ea7af0d40cc8866aa9b7a32207d
I20260709 12:26:48.762918  6121 raft_consensus.cc:993] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: : Instructing follower 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:48.760176  6016 raft_consensus.cc:3060] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.763509  6099 raft_consensus.cc:2804] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:48.763883  6094 raft_consensus.cc:1081] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Signalling peer 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:48.764278  6099 raft_consensus.cc:697] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.765312  6099 consensus_queue.cc:237] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.766335  5944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "809b1a993e9a4c8eb37fe9de41fa0bd0"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:38438
I20260709 12:26:48.767102  5944 raft_consensus.cc:493] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.767755  5944 raft_consensus.cc:3060] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.772603  6129 consensus_queue.cc:1048] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.774333  6016 raft_consensus.cc:2468] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 2.
I20260709 12:26:48.775676  5833 leader_election.cc:304] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:48.760344  6095 consensus_queue.cc:1048] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:26:48.776679  6121 raft_consensus.cc:2804] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:48.776331  5944 raft_consensus.cc:515] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.777333  6121 raft_consensus.cc:697] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:48.762353  5943 raft_consensus.cc:2468] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 2.
I20260709 12:26:48.778864  6121 consensus_queue.cc:237] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.782217  5944 leader_election.cc:290] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.783527  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809b1a993e9a4c8eb37fe9de41fa0bd0" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.783864  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809b1a993e9a4c8eb37fe9de41fa0bd0" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.784624  5868 raft_consensus.cc:3055] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:48.784641  6016 raft_consensus.cc:3060] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.785228  5868 raft_consensus.cc:740] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:48.786795  5868 consensus_queue.cc:260] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.788272  5868 raft_consensus.cc:3060] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.792969  6016 raft_consensus.cc:2468] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:48.798158  5766 catalog_manager.cc:5697] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 1 to 2, leader changed from 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194) to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 2 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.799666  6068 raft_consensus.cc:993] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec: : Instructing follower 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:48.800374  6068 raft_consensus.cc:1081] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Signalling peer 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:48.801649  5767 catalog_manager.cc:5697] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 1 to 2, leader changed from 038a4934597746cb85b58eca24e2b1ec (127.29.131.195) to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.803188  5868 raft_consensus.cc:2468] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:48.807827  6129 consensus_queue.cc:1048] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:48.805788  5908 leader_election.cc:304] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.813740  6099 raft_consensus.cc:2804] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:48.814164  6099 raft_consensus.cc:697] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.814818  6099 consensus_queue.cc:237] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.822242  6076 raft_consensus.cc:993] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607: : Instructing follower 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:48.822862  6099 raft_consensus.cc:1081] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Signalling peer 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:48.822224  5944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba6f8897ba614282b8394547263b8325"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:38454
I20260709 12:26:48.823484  5944 raft_consensus.cc:493] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.823909  5944 raft_consensus.cc:3060] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.824649  5866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:58624
I20260709 12:26:48.825399  5866 raft_consensus.cc:493] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.825870  5866 raft_consensus.cc:3060] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.832065  5944 raft_consensus.cc:515] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.834350  5944 leader_election.cc:290] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.834121  5866 raft_consensus.cc:515] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.837119  5867 raft_consensus.cc:1240] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Rejecting Update request from peer 80d6943d1ad94734981b057b3b4a5607 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:48.837368  5767 catalog_manager.cc:5697] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 1 to 2, leader changed from 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193) to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.838662  5942 raft_consensus.cc:1275] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:48.839308  5867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6f8897ba614282b8394547263b8325" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:48.839289  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6f8897ba614282b8394547263b8325" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.840443  6121 consensus_queue.cc:1048] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:48.840839  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:48.841029  6017 raft_consensus.cc:3055] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:48.841527  6017 raft_consensus.cc:740] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:48.842713  6017 consensus_queue.cc:260] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.843501  6095 consensus_queue.cc:1059] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.843955  5866 leader_election.cc:290] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:48.844033  6017 raft_consensus.cc:3060] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.841601  5944 raft_consensus.cc:3055] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:48.845222  5944 raft_consensus.cc:740] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.846194  5944 consensus_queue.cc:260] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.847677  5944 raft_consensus.cc:3060] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.849548  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deecd603222343a5b7b6a242eb08915c" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:48.850191  6016 raft_consensus.cc:3060] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.856043  5944 raft_consensus.cc:2468] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 2.
W20260709 12:26:48.856827  6099 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:26:48.860124  6015 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.860440  5833 leader_election.cc:304] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:48.863035  6088 raft_consensus.cc:2804] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:48.863665  6088 raft_consensus.cc:697] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:48.864679  6016 raft_consensus.cc:2468] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 2.
I20260709 12:26:48.864567  6088 consensus_queue.cc:237] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.868753  6015 raft_consensus.cc:1275] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:48.860066  6017 raft_consensus.cc:2468] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:48.871271  6088 consensus_queue.cc:1048] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:48.871304  5908 leader_election.cc:304] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 3d3f3ea7af0d40cc8866aa9b7a32207d
I20260709 12:26:48.872699  6099 raft_consensus.cc:2804] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:48.873311  6099 raft_consensus.cc:697] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:48.874248  6099 consensus_queue.cc:237] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:48.877139  5767 catalog_manager.cc:5697] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 1 to 2, leader changed from 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194) to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 2 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.892221  5766 catalog_manager.cc:5697] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 1 to 2, leader changed from 038a4934597746cb85b58eca24e2b1ec (127.29.131.195) to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.105690  5866 raft_consensus.cc:1275] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.106993  6129 consensus_queue.cc:1048] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.115042  5942 raft_consensus.cc:1275] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.117137  6105 consensus_queue.cc:1048] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.225306  6017 raft_consensus.cc:1275] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.226568  6099 consensus_queue.cc:1048] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.234251  5866 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:49.241415  5866 raft_consensus.cc:1275] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.242710  6095 consensus_queue.cc:1048] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.256428  6017 raft_consensus.cc:1275] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.257625  6088 consensus_queue.cc:1048] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.265188  5942 raft_consensus.cc:1275] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.267546  6094 consensus_queue.cc:1048] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.295435  6017 raft_consensus.cc:1275] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.296729  6095 consensus_queue.cc:1048] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.304807  5866 raft_consensus.cc:1275] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.306418  6095 consensus_queue.cc:1048] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.313560  6017 raft_consensus.cc:1275] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.315351  6094 consensus_queue.cc:1048] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.323655  5942 raft_consensus.cc:1275] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.325371  6121 consensus_queue.cc:1048] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.379254  5866 raft_consensus.cc:3060] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:49.384500  5866 raft_consensus.cc:1275] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.385743  6099 consensus_queue.cc:1048] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:49.393952  6017 raft_consensus.cc:1275] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.395668  6077 consensus_queue.cc:1048] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:51.537276  5766 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58094:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:51.540418  5766 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:51.606621  5929 tablet_service.cc:1511] Processing CreateTablet for tablet 98fc67292e20428f886df39f8339afa0 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:51.607997  6002 tablet_service.cc:1511] Processing CreateTablet for tablet 98fc67292e20428f886df39f8339afa0 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:51.609401  5929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98fc67292e20428f886df39f8339afa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.610082  6002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98fc67292e20428f886df39f8339afa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.615414  5857 tablet_service.cc:1511] Processing CreateTablet for tablet 98fc67292e20428f886df39f8339afa0 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:51.617317  5857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98fc67292e20428f886df39f8339afa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.623603  5928 tablet_service.cc:1511] Processing CreateTablet for tablet a1a42f2187564e60981bcb932a28fdd5 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:51.625206  5928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a42f2187564e60981bcb932a28fdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.626502  6004 tablet_service.cc:1511] Processing CreateTablet for tablet a1a42f2187564e60981bcb932a28fdd5 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:51.628057  6004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a42f2187564e60981bcb932a28fdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.632352  5859 tablet_service.cc:1511] Processing CreateTablet for tablet a1a42f2187564e60981bcb932a28fdd5 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:51.634397  5859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a42f2187564e60981bcb932a28fdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.638245  5927 tablet_service.cc:1511] Processing CreateTablet for tablet 36c78c0da2be469e8319bd876fc03cc2 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:51.639815  5927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c78c0da2be469e8319bd876fc03cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.644039  5858 tablet_service.cc:1511] Processing CreateTablet for tablet 36c78c0da2be469e8319bd876fc03cc2 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:51.646198  6007 tablet_service.cc:1511] Processing CreateTablet for tablet 36c78c0da2be469e8319bd876fc03cc2 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:51.648144  6007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c78c0da2be469e8319bd876fc03cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.646205  5858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c78c0da2be469e8319bd876fc03cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.667500  5856 tablet_service.cc:1511] Processing CreateTablet for tablet ae5c966758484bf985613d924d9fc78e (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:51.667738  5930 tablet_service.cc:1511] Processing CreateTablet for tablet ae5c966758484bf985613d924d9fc78e (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:51.669260  6001 tablet_service.cc:1511] Processing CreateTablet for tablet ae5c966758484bf985613d924d9fc78e (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:51.671428  6001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5c966758484bf985613d924d9fc78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.669348  5930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5c966758484bf985613d924d9fc78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.681113  5855 tablet_service.cc:1511] Processing CreateTablet for tablet 28f5bdf3b5c14e03a96de8b9116270f2 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:51.681124  5926 tablet_service.cc:1511] Processing CreateTablet for tablet 28f5bdf3b5c14e03a96de8b9116270f2 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:51.682986  5926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f5bdf3b5c14e03a96de8b9116270f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.689029  6005 tablet_service.cc:1511] Processing CreateTablet for tablet 28f5bdf3b5c14e03a96de8b9116270f2 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:51.690516  6005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f5bdf3b5c14e03a96de8b9116270f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.693176  5854 tablet_service.cc:1511] Processing CreateTablet for tablet 6192d47e8ea7451e8397a3299b5a2d77 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:51.689061  6006 tablet_service.cc:1511] Processing CreateTablet for tablet 6192d47e8ea7451e8397a3299b5a2d77 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:51.696136  6006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6192d47e8ea7451e8397a3299b5a2d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.701062  5932 tablet_service.cc:1511] Processing CreateTablet for tablet 6192d47e8ea7451e8397a3299b5a2d77 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:51.669343  5856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5c966758484bf985613d924d9fc78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.702469  5932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6192d47e8ea7451e8397a3299b5a2d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.703214  6003 tablet_service.cc:1511] Processing CreateTablet for tablet dc232ae88e61401ba423431673d5f7d9 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:51.705075  6003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc232ae88e61401ba423431673d5f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.705766  5853 tablet_service.cc:1511] Processing CreateTablet for tablet dc232ae88e61401ba423431673d5f7d9 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:51.707151  5853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc232ae88e61401ba423431673d5f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.709546  5934 tablet_service.cc:1511] Processing CreateTablet for tablet dc232ae88e61401ba423431673d5f7d9 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:51.710947  5934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc232ae88e61401ba423431673d5f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.711563  5854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6192d47e8ea7451e8397a3299b5a2d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.715561  5855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f5bdf3b5c14e03a96de8b9116270f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.721997  5852 tablet_service.cc:1511] Processing CreateTablet for tablet 728c2857c8f54c62a66b84277dd80765 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:51.722752  5931 tablet_service.cc:1511] Processing CreateTablet for tablet 728c2857c8f54c62a66b84277dd80765 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:51.723639  5852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728c2857c8f54c62a66b84277dd80765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.724117  5931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728c2857c8f54c62a66b84277dd80765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.727442  6000 tablet_service.cc:1511] Processing CreateTablet for tablet 728c2857c8f54c62a66b84277dd80765 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:51.729188  6000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728c2857c8f54c62a66b84277dd80765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.747584  6008 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9c2f7f47184b10b89f98742a2902d5 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:51.749146  6008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9c2f7f47184b10b89f98742a2902d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.747670  5851 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9c2f7f47184b10b89f98742a2902d5 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:51.752774  5851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9c2f7f47184b10b89f98742a2902d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.765787  5928 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9c2f7f47184b10b89f98742a2902d5 (DEFAULT_TABLE table=soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:51.767251  5928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9c2f7f47184b10b89f98742a2902d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.787149  6150 tablet_bootstrap.cc:492] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:51.822397  6150 tablet_bootstrap.cc:654] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.832433  6152 tablet_bootstrap.cc:492] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:51.833340  6151 tablet_bootstrap.cc:492] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:51.843287  6151 tablet_bootstrap.cc:654] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.865307  6150 tablet_bootstrap.cc:492] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:51.865911  6150 ts_tablet_manager.cc:1403] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.004s
I20260709 12:26:51.876251  6152 tablet_bootstrap.cc:654] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.869496  6150 raft_consensus.cc:359] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.891639  6151 tablet_bootstrap.cc:492] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:51.892002  6150 raft_consensus.cc:385] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.892275  6151 ts_tablet_manager.cc:1403] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.022s
I20260709 12:26:51.892589  6150 raft_consensus.cc:740] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.893581  6150 consensus_queue.cc:260] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.895605  6151 raft_consensus.cc:359] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.896390  6151 raft_consensus.cc:385] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.896713  6151 raft_consensus.cc:740] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.897461  6151 consensus_queue.cc:260] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.899777  6150 ts_tablet_manager.cc:1434] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 12:26:51.900184  6151 ts_tablet_manager.cc:1434] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:51.901217  6150 tablet_bootstrap.cc:492] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:51.904830  6152 tablet_bootstrap.cc:492] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:51.902695  6151 tablet_bootstrap.cc:492] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:51.905383  6152 ts_tablet_manager.cc:1403] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.000s
I20260709 12:26:51.913594  6151 tablet_bootstrap.cc:654] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.917595  6152 raft_consensus.cc:359] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.918401  6150 tablet_bootstrap.cc:654] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.918426  6152 raft_consensus.cc:385] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.922515  6152 raft_consensus.cc:740] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.923261  6152 consensus_queue.cc:260] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.931133  6152 ts_tablet_manager.cc:1434] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:26:51.932201  6152 tablet_bootstrap.cc:492] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:51.942269  6152 tablet_bootstrap.cc:654] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.943619  6150 tablet_bootstrap.cc:492] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:51.943632  6151 tablet_bootstrap.cc:492] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:51.944388  6150 ts_tablet_manager.cc:1403] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.008s
I20260709 12:26:51.944468  6151 ts_tablet_manager.cc:1403] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.027s
I20260709 12:26:51.947135  6152 tablet_bootstrap.cc:492] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:51.947678  6152 ts_tablet_manager.cc:1403] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:26:51.947815  6151 raft_consensus.cc:359] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.948050  6150 raft_consensus.cc:359] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.948652  6151 raft_consensus.cc:385] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.948753  6150 raft_consensus.cc:385] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.949054  6151 raft_consensus.cc:740] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.949106  6150 raft_consensus.cc:740] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.950011  6151 consensus_queue.cc:260] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.950251  6152 raft_consensus.cc:359] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.950145  6150 consensus_queue.cc:260] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.950981  6152 raft_consensus.cc:385] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.951608  6152 raft_consensus.cc:740] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.952750  6150 ts_tablet_manager.cc:1434] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:51.953193  6152 consensus_queue.cc:260] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.953950  6150 tablet_bootstrap.cc:492] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:51.954972  6152 ts_tablet_manager.cc:1434] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:51.955996  6152 tablet_bootstrap.cc:492] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:51.952746  6151 ts_tablet_manager.cc:1434] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:51.957873  6151 tablet_bootstrap.cc:492] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:51.963361  6152 tablet_bootstrap.cc:654] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.966884  6105 raft_consensus.cc:493] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.967540  6150 tablet_bootstrap.cc:654] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.967490  6105 raft_consensus.cc:515] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.969825  6105 leader_election.cc:290] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:51.973341  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:51.973675  6151 tablet_bootstrap.cc:654] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.973978  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:51.974447  6152 tablet_bootstrap.cc:492] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:51.975037  6152 ts_tablet_manager.cc:1403] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 12:26:51.975739  6105 raft_consensus.cc:493] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:51.975989  5982 leader_election.cc:343] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.976269  6105 raft_consensus.cc:515] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
W20260709 12:26:51.976740  5982 leader_election.cc:343] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.977155  5982 leader_election.cc:304] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec; no voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:51.978444  6105 leader_election.cc:290] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:51.978981  6105 raft_consensus.cc:2749] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:51.978719  6152 raft_consensus.cc:359] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.979825  6152 raft_consensus.cc:385] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.980199  6152 raft_consensus.cc:740] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.981096  6152 consensus_queue.cc:260] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:51.984190  6152 ts_tablet_manager.cc:1434] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:51.985486  6152 tablet_bootstrap.cc:492] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:51.994206  6152 tablet_bootstrap.cc:654] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.995213  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:52.001464  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
W20260709 12:26:52.003023  5982 leader_election.cc:343] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:52.003801  5982 leader_election.cc:343] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.006883  5982 leader_election.cc:304] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec; no voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:52.007761  6105 raft_consensus.cc:2749] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.011653  6150 tablet_bootstrap.cc:492] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:52.011991  6151 tablet_bootstrap.cc:492] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:52.012250  6150 ts_tablet_manager.cc:1403] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.021s
W20260709 12:26:52.012137  5815 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:52.012640  6151 ts_tablet_manager.cc:1403] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.020s
I20260709 12:26:52.014096  6152 tablet_bootstrap.cc:492] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:52.014601  6152 ts_tablet_manager.cc:1403] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.020s
I20260709 12:26:52.015338  6150 raft_consensus.cc:359] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.016091  6150 raft_consensus.cc:385] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.016435  6150 raft_consensus.cc:740] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.015856  6151 raft_consensus.cc:359] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.016886  6151 raft_consensus.cc:385] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.017342  6151 raft_consensus.cc:740] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.017210  6150 consensus_queue.cc:260] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.017590  6152 raft_consensus.cc:359] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.018385  6152 raft_consensus.cc:385] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.018879  6152 raft_consensus.cc:740] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.018363  6151 consensus_queue.cc:260] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.019781  6150 ts_tablet_manager.cc:1434] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:52.019738  6152 consensus_queue.cc:260] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.020974  6150 tablet_bootstrap.cc:492] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:52.022109  6152 ts_tablet_manager.cc:1434] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:26:52.023063  6152 tablet_bootstrap.cc:492] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:52.028513  6077 raft_consensus.cc:493] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.031248  6077 raft_consensus.cc:515] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.034554  6150 tablet_bootstrap.cc:654] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.035284  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98fc67292e20428f886df39f8339afa0" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:52.042722  6152 tablet_bootstrap.cc:654] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.042800  5866 raft_consensus.cc:2468] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:52.044845  5908 leader_election.cc:304] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.045986  6155 raft_consensus.cc:2804] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.046396  6155 raft_consensus.cc:493] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.041981  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98fc67292e20428f886df39f8339afa0" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.047135  6155 raft_consensus.cc:3060] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.048012  6152 tablet_bootstrap.cc:492] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:52.048519  6152 ts_tablet_manager.cc:1403] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
W20260709 12:26:52.048913  5908 leader_election.cc:343] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.046247  6077 leader_election.cc:290] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.039430  6151 ts_tablet_manager.cc:1434] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 12:26:52.051403  6151 tablet_bootstrap.cc:492] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:52.051740  6152 raft_consensus.cc:359] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.052189  6150 tablet_bootstrap.cc:492] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:52.052520  6152 raft_consensus.cc:385] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.052821  6150 ts_tablet_manager.cc:1403] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.009s
I20260709 12:26:52.052860  6152 raft_consensus.cc:740] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.053815  6152 consensus_queue.cc:260] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.056229  6152 ts_tablet_manager.cc:1434] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:52.056363  6150 raft_consensus.cc:359] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.057168  6150 raft_consensus.cc:385] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.057446  6152 tablet_bootstrap.cc:492] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:52.057461  6150 raft_consensus.cc:740] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.058614  6150 consensus_queue.cc:260] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.061079  6150 ts_tablet_manager.cc:1434] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:52.062328  6150 tablet_bootstrap.cc:492] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:52.065433  6152 tablet_bootstrap.cc:654] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.069450  6150 tablet_bootstrap.cc:654] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.082089  6151 tablet_bootstrap.cc:654] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.085331  6155 raft_consensus.cc:515] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.088253  6155 leader_election.cc:290] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.093039  6152 tablet_bootstrap.cc:492] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:52.093544  6152 ts_tablet_manager.cc:1403] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.036s	user 0.028s	sys 0.004s
I20260709 12:26:52.095341  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98fc67292e20428f886df39f8339afa0" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:52.096010  5868 raft_consensus.cc:3060] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.096120  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98fc67292e20428f886df39f8339afa0" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.096793  6152 raft_consensus.cc:359] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.097561  6152 raft_consensus.cc:385] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.097849  6152 raft_consensus.cc:740] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
W20260709 12:26:52.098489  5908 leader_election.cc:343] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.098614  6152 consensus_queue.cc:260] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.101269  6152 ts_tablet_manager.cc:1434] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:52.102303  6152 tablet_bootstrap.cc:492] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:52.095355  6150 tablet_bootstrap.cc:492] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:52.106310  6150 ts_tablet_manager.cc:1403] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.008s
I20260709 12:26:52.109148  6152 tablet_bootstrap.cc:654] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.105525  5868 raft_consensus.cc:2468] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:52.111089  6151 tablet_bootstrap.cc:492] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:52.110695  6150 raft_consensus.cc:359] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.111619  6151 ts_tablet_manager.cc:1403] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.013s
I20260709 12:26:52.111755  6150 raft_consensus.cc:385] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.112275  6150 raft_consensus.cc:740] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.113232  6150 consensus_queue.cc:260] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.116462  6150 ts_tablet_manager.cc:1434] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:52.121069  6150 tablet_bootstrap.cc:492] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:52.122756  6151 raft_consensus.cc:359] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.119256  5908 leader_election.cc:304] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:52.123309  6151 raft_consensus.cc:385] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.123572  6151 raft_consensus.cc:740] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.124119  6168 raft_consensus.cc:2804] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.124356  6151 consensus_queue.cc:260] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.124756  6168 raft_consensus.cc:697] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:52.125699  6152 tablet_bootstrap.cc:492] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:52.126240  6152 ts_tablet_manager.cc:1403] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.012s
I20260709 12:26:52.125857  6168 consensus_queue.cc:237] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.129189  6151 ts_tablet_manager.cc:1434] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:26:52.129452  6152 raft_consensus.cc:359] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.130251  6151 tablet_bootstrap.cc:492] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:52.130254  6152 raft_consensus.cc:385] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.130954  6152 raft_consensus.cc:740] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.131918  6152 consensus_queue.cc:260] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.134930  6150 tablet_bootstrap.cc:654] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.139492  6151 tablet_bootstrap.cc:654] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.144551  6152 ts_tablet_manager.cc:1434] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 12:26:52.146015  6152 tablet_bootstrap.cc:492] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:52.150539  6151 tablet_bootstrap.cc:492] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:52.151129  6151 ts_tablet_manager.cc:1403] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.014s
I20260709 12:26:52.152693  6150 tablet_bootstrap.cc:492] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:52.153364  6150 ts_tablet_manager.cc:1403] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.007s
I20260709 12:26:52.154114  6152 tablet_bootstrap.cc:654] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.153404  5765 catalog_manager.cc:5697] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.154301  6151 raft_consensus.cc:359] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.155046  6151 raft_consensus.cc:385] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.155383  6151 raft_consensus.cc:740] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.156275  6151 consensus_queue.cc:260] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.157732  6150 raft_consensus.cc:359] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.160387  6150 raft_consensus.cc:385] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.160877  6150 raft_consensus.cc:740] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.159047  6151 ts_tablet_manager.cc:1434] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:26:52.163663  6151 tablet_bootstrap.cc:492] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:52.162056  6150 consensus_queue.cc:260] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.167145  6150 ts_tablet_manager.cc:1434] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.008s
I20260709 12:26:52.168730  6150 tablet_bootstrap.cc:492] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:52.170277  6151 tablet_bootstrap.cc:654] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.178629  6150 tablet_bootstrap.cc:654] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.187399  6157 raft_consensus.cc:493] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.188004  6157 raft_consensus.cc:515] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.190531  6157 leader_election.cc:290] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.194952  6151 tablet_bootstrap.cc:492] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:52.195739  6151 ts_tablet_manager.cc:1403] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.004s
I20260709 12:26:52.199489  6151 raft_consensus.cc:359] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.200218  6151 raft_consensus.cc:385] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.200515  6151 raft_consensus.cc:740] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.205523  6157 raft_consensus.cc:493] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.206238  6157 raft_consensus.cc:515] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.208536  6152 tablet_bootstrap.cc:492] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:52.209481  6152 ts_tablet_manager.cc:1403] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.023s
I20260709 12:26:52.209237  6151 consensus_queue.cc:260] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.212222  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5c966758484bf985613d924d9fc78e" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:52.212911  5942 raft_consensus.cc:2468] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.212958  6152 raft_consensus.cc:359] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.213879  6152 raft_consensus.cc:385] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.214238  6152 raft_consensus.cc:740] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.215029  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5c966758484bf985613d924d9fc78e" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.215797  6017 raft_consensus.cc:2468] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.216380  6157 leader_election.cc:290] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.216040  6152 consensus_queue.cc:260] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.218713  6152 ts_tablet_manager.cc:1434] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:52.218714  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a42f2187564e60981bcb932a28fdd5" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:52.219589  5942 raft_consensus.cc:2468] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.220279  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a42f2187564e60981bcb932a28fdd5" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.220911  6017 raft_consensus.cc:2468] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.221602  6152 tablet_bootstrap.cc:492] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Bootstrap starting.
I20260709 12:26:52.223755  5833 leader_election.cc:304] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:52.224592  6150 tablet_bootstrap.cc:492] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:52.225796  6150 ts_tablet_manager.cc:1403] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.028s
I20260709 12:26:52.226692  6151 ts_tablet_manager.cc:1434] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.005s
I20260709 12:26:52.227763  6151 tablet_bootstrap.cc:492] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:52.229158  6152 tablet_bootstrap.cc:654] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.229648  6150 raft_consensus.cc:359] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.234445  6150 raft_consensus.cc:385] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.234755  6151 tablet_bootstrap.cc:654] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.224741  5833 leader_election.cc:304] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:52.225039  6157 raft_consensus.cc:2804] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.235801  6121 raft_consensus.cc:2804] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.236289  6121 raft_consensus.cc:493] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.234948  6150 raft_consensus.cc:740] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.236680  6121 raft_consensus.cc:3060] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.237560  6150 consensus_queue.cc:260] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.241056  6152 tablet_bootstrap.cc:492] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d: No bootstrap required, opened a new log
I20260709 12:26:52.241024  6150 ts_tablet_manager.cc:1434] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.007s
I20260709 12:26:52.241732  6152 ts_tablet_manager.cc:1403] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:26:52.242496  6150 tablet_bootstrap.cc:492] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:52.235694  6157 raft_consensus.cc:493] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.247941  6157 raft_consensus.cc:3060] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.252470  6152 raft_consensus.cc:359] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.253290  6152 raft_consensus.cc:385] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.253587  6152 raft_consensus.cc:740] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.254534  6152 consensus_queue.cc:260] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.257174  6152 ts_tablet_manager.cc:1434] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 12:26:52.260176  6150 tablet_bootstrap.cc:654] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.265234  6151 tablet_bootstrap.cc:492] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:52.265854  6151 ts_tablet_manager.cc:1403] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.023s
I20260709 12:26:52.269060  6151 raft_consensus.cc:359] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.269868  6151 raft_consensus.cc:385] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.270200  6151 raft_consensus.cc:740] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.270294  6150 tablet_bootstrap.cc:492] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:52.271098  6150 ts_tablet_manager.cc:1403] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.019s
I20260709 12:26:52.271245  6151 consensus_queue.cc:260] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.274139  6151 ts_tablet_manager.cc:1434] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:52.275286  6151 tablet_bootstrap.cc:492] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:52.275771  6150 raft_consensus.cc:359] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.276635  6150 raft_consensus.cc:385] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.276975  6150 raft_consensus.cc:740] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.277850  6150 consensus_queue.cc:260] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.281620  6150 ts_tablet_manager.cc:1434] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:52.282411  6151 tablet_bootstrap.cc:654] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.277455  6121 raft_consensus.cc:515] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.283128  6150 tablet_bootstrap.cc:492] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607: Bootstrap starting.
I20260709 12:26:52.285472  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a42f2187564e60981bcb932a28fdd5" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:52.286091  5942 raft_consensus.cc:3060] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.291960  6150 tablet_bootstrap.cc:654] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.294099  5942 raft_consensus.cc:2468] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.295435  5833 leader_election.cc:304] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.296411  6180 raft_consensus.cc:2804] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.299849  6157 raft_consensus.cc:515] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.304095  6150 tablet_bootstrap.cc:492] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607: No bootstrap required, opened a new log
I20260709 12:26:52.305857  6150 ts_tablet_manager.cc:1403] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.009s
I20260709 12:26:52.306955  6121 leader_election.cc:290] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.307441  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a42f2187564e60981bcb932a28fdd5" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.308879  6017 raft_consensus.cc:3060] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.310370  6157 leader_election.cc:290] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.310917  6015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5c966758484bf985613d924d9fc78e" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.311930  6015 raft_consensus.cc:3060] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.313355  6180 raft_consensus.cc:697] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.314491  6151 tablet_bootstrap.cc:492] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:52.315033  6151 ts_tablet_manager.cc:1403] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.010s
I20260709 12:26:52.314911  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5c966758484bf985613d924d9fc78e" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:52.315753  5942 raft_consensus.cc:3060] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.316944  6017 raft_consensus.cc:2468] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.317950  6151 raft_consensus.cc:359] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.318655  6151 raft_consensus.cc:385] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.318910  6151 raft_consensus.cc:740] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.319394  6015 raft_consensus.cc:2468] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.319651  6151 consensus_queue.cc:260] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.320673  5833 leader_election.cc:304] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:52.322170  6151 ts_tablet_manager.cc:1434] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:52.322726  6121 raft_consensus.cc:2804] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.323175  6151 tablet_bootstrap.cc:492] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec: Bootstrap starting.
I20260709 12:26:52.320762  6157 raft_consensus.cc:493] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.310077  6150 raft_consensus.cc:359] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.319554  6188 raft_consensus.cc:493] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.323745  6150 raft_consensus.cc:385] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.324965  6150 raft_consensus.cc:740] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.314450  6180 consensus_queue.cc:237] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.322968  5942 raft_consensus.cc:2468] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.327499  6157 raft_consensus.cc:515] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.327986  6150 consensus_queue.cc:260] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.329674  6157 leader_election.cc:290] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.330268  6150 ts_tablet_manager.cc:1434] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:26:52.336292  6151 tablet_bootstrap.cc:654] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.336566  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:52.337337  5942 raft_consensus.cc:2468] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.337967  6157 raft_consensus.cc:493] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.339617  6121 raft_consensus.cc:697] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.341475  6157 raft_consensus.cc:515] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.344815  6121 consensus_queue.cc:237] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.338900  6188 raft_consensus.cc:515] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.346508  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6192d47e8ea7451e8397a3299b5a2d77" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:52.347221  5944 raft_consensus.cc:2468] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.346834  6015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6192d47e8ea7451e8397a3299b5a2d77" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.349363  6015 raft_consensus.cc:2468] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.343905  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.351318  5833 leader_election.cc:304] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:52.350584  6188 leader_election.cc:290] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.352139  6188 raft_consensus.cc:2804] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.352695  6188 raft_consensus.cc:493] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.353685  6015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f5bdf3b5c14e03a96de8b9116270f2" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.353350  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f5bdf3b5c14e03a96de8b9116270f2" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:52.354367  6015 raft_consensus.cc:2468] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.354540  5766 catalog_manager.cc:5697] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.355747  5833 leader_election.cc:304] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:52.356885  6180 raft_consensus.cc:2804] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.357636  6180 raft_consensus.cc:493] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.357389  5833 leader_election.cc:304] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.357704  6189 raft_consensus.cc:493] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.358078  6180 raft_consensus.cc:3060] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.364269  6189 raft_consensus.cc:515] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.358518  6157 leader_election.cc:290] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.373018  6189 leader_election.cc:290] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.373566  6189 raft_consensus.cc:2804] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.373871  6189 raft_consensus.cc:493] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.374173  6189 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.351504  6017 raft_consensus.cc:2468] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.354501  5942 raft_consensus.cc:2468] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.376119  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:52.353878  6188 raft_consensus.cc:3060] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.377075  5944 raft_consensus.cc:2468] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.379751  5764 catalog_manager.cc:5697] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.380517  5833 leader_election.cc:304] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.381673  6121 raft_consensus.cc:2804] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.382164  6121 raft_consensus.cc:493] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.382586  6121 raft_consensus.cc:3060] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.383566  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.384205  6017 raft_consensus.cc:2468] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.391182  6180 raft_consensus.cc:515] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.393520  6180 leader_election.cc:290] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.392982  6121 raft_consensus.cc:515] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.396564  6188 raft_consensus.cc:515] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.397660  6151 tablet_bootstrap.cc:492] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec: No bootstrap required, opened a new log
I20260709 12:26:52.398344  6151 ts_tablet_manager.cc:1403] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.028s
I20260709 12:26:52.398602  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f5bdf3b5c14e03a96de8b9116270f2" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:52.398988  6188 leader_election.cc:290] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.399246  5942 raft_consensus.cc:3060] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.401260  6151 raft_consensus.cc:359] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.401973  6151 raft_consensus.cc:385] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.397596  6189 raft_consensus.cc:515] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.402235  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6192d47e8ea7451e8397a3299b5a2d77" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:52.402343  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f5bdf3b5c14e03a96de8b9116270f2" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.402974  5944 raft_consensus.cc:3060] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.403038  6017 raft_consensus.cc:3060] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.404381  6189 leader_election.cc:290] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.405411  5942 raft_consensus.cc:2468] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.407119  5833 leader_election.cc:304] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.407347  5942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:52.408659  5942 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.409111  6189 raft_consensus.cc:2804] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.410204  6017 raft_consensus.cc:2468] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.410653  6189 raft_consensus.cc:697] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.410290  5944 raft_consensus.cc:2468] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.402243  6151 raft_consensus.cc:740] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.412768  6015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6192d47e8ea7451e8397a3299b5a2d77" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.411863  6189 consensus_queue.cc:237] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.413362  6015 raft_consensus.cc:3060] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.413806  5833 leader_election.cc:304] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.414094  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.408068  6121 leader_election.cc:290] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.414649  6151 consensus_queue.cc:260] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.417136  6121 raft_consensus.cc:2804] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.417613  6121 raft_consensus.cc:697] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.418407  6151 ts_tablet_manager.cc:1434] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:52.418352  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.419095  6016 raft_consensus.cc:3060] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.420372  6121 consensus_queue.cc:237] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.415818  5942 raft_consensus.cc:2468] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.423565  6188 raft_consensus.cc:493] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.424036  6188 raft_consensus.cc:515] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.424425  5833 leader_election.cc:304] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.425235  6180 raft_consensus.cc:2804] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.425652  6180 raft_consensus.cc:697] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.426011  6188 leader_election.cc:290] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.425683  5764 catalog_manager.cc:5697] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.426551  6180 consensus_queue.cc:237] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.429731  6015 raft_consensus.cc:2468] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.431459  6168 raft_consensus.cc:493] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.432049  6168 raft_consensus.cc:515] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.433966  6016 raft_consensus.cc:2468] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.434202  6168 leader_election.cc:290] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.435374  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728c2857c8f54c62a66b84277dd80765" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:52.436053  5833 leader_election.cc:304] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:52.436157  5943 raft_consensus.cc:2468] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.436642  6017 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.437525  5833 leader_election.cc:304] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.438796  6188 raft_consensus.cc:2804] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.438591  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c78c0da2be469e8319bd876fc03cc2" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:52.439303  6188 raft_consensus.cc:493] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.439476  5868 raft_consensus.cc:2468] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:52.439747  6188 raft_consensus.cc:3060] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.438596  6157 raft_consensus.cc:2804] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.413296  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:52.441694  5908 leader_election.cc:304] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.442591  6168 raft_consensus.cc:2804] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.443413  6168 raft_consensus.cc:493] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.443735  6168 raft_consensus.cc:3060] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.447158  5944 raft_consensus.cc:3060] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.447649  6015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c78c0da2be469e8319bd876fc03cc2" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.448539  6015 raft_consensus.cc:2468] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 0.
I20260709 12:26:52.451614  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728c2857c8f54c62a66b84277dd80765" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec" is_pre_election: true
I20260709 12:26:52.452656  6016 raft_consensus.cc:2468] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 0.
I20260709 12:26:52.454437  6017 raft_consensus.cc:2468] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.466071  5944 raft_consensus.cc:2468] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.467576  5765 catalog_manager.cc:5697] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.469333  5765 catalog_manager.cc:5697] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.475548  6188 raft_consensus.cc:515] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.476748  6157 raft_consensus.cc:697] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.477742  6188 leader_election.cc:290] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.451835  6168 raft_consensus.cc:515] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.479004  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728c2857c8f54c62a66b84277dd80765" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:52.479667  5944 raft_consensus.cc:3060] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.480649  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c78c0da2be469e8319bd876fc03cc2" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:52.481421  5868 raft_consensus.cc:3060] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.477748  6157 consensus_queue.cc:237] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.482878  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c78c0da2be469e8319bd876fc03cc2" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.483521  6016 raft_consensus.cc:3060] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.480746  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728c2857c8f54c62a66b84277dd80765" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.488013  6017 raft_consensus.cc:3060] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.488242  5944 raft_consensus.cc:2468] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.491499  6168 leader_election.cc:290] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.493258  6017 raft_consensus.cc:2468] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 1.
I20260709 12:26:52.493527  6016 raft_consensus.cc:2468] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:52.494637  5833 leader_election.cc:304] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.494836  5908 leader_election.cc:304] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.495738  6168 raft_consensus.cc:2804] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.496167  5868 raft_consensus.cc:2468] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 1.
I20260709 12:26:52.496217  6168 raft_consensus.cc:697] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:52.496274  6157 raft_consensus.cc:2804] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.497679  6168 consensus_queue.cc:237] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.498240  6157 raft_consensus.cc:697] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.499219  6157 consensus_queue.cc:237] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.501133  5765 catalog_manager.cc:5697] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.507951  5764 catalog_manager.cc:5697] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 1 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.516294  5765 catalog_manager.cc:5697] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 1 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.542484  6105 raft_consensus.cc:493] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.543073  6105 raft_consensus.cc:515] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.544781  6105 leader_election.cc:290] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:52.545728  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98fc67292e20428f886df39f8339afa0" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" is_pre_election: true
I20260709 12:26:52.546149  5944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98fc67292e20428f886df39f8339afa0" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80d6943d1ad94734981b057b3b4a5607" is_pre_election: true
I20260709 12:26:52.546432  5868 raft_consensus.cc:2393] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 038a4934597746cb85b58eca24e2b1ec in current term 1: Already voted for candidate 80d6943d1ad94734981b057b3b4a5607 in this term.
I20260709 12:26:52.547854  5982 leader_election.cc:304] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec; no voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:52.548465  6105 raft_consensus.cc:3060] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.553880  6105 raft_consensus.cc:2749] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.637151  6168 consensus_queue.cc:1048] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:52.651695  6203 consensus_queue.cc:1048] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.668059  5944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98fc67292e20428f886df39f8339afa0"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
mode: GRACEFUL
new_leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:26:52.668793  5944 raft_consensus.cc:606] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Received request to transfer leadership to TS 3d3f3ea7af0d40cc8866aa9b7a32207d
I20260709 12:26:52.677295  5944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36c78c0da2be469e8319bd876fc03cc2"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
mode: GRACEFUL
new_leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:26:52.677915  5944 raft_consensus.cc:606] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Received request to transfer leadership to TS 3d3f3ea7af0d40cc8866aa9b7a32207d
I20260709 12:26:52.685405  5868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28f5bdf3b5c14e03a96de8b9116270f2"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
mode: GRACEFUL
new_leader_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:58644
I20260709 12:26:52.686002  5868 raft_consensus.cc:606] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Received request to transfer leadership to TS 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:52.690449  5868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6192d47e8ea7451e8397a3299b5a2d77"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
mode: GRACEFUL
new_leader_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:58644
I20260709 12:26:52.690918  5868 raft_consensus.cc:606] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Received request to transfer leadership to TS 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:52.695202  5868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
mode: GRACEFUL
new_leader_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:58644
I20260709 12:26:52.695716  5868 raft_consensus.cc:606] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Received request to transfer leadership to TS 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:52.700315  5868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "728c2857c8f54c62a66b84277dd80765"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
mode: GRACEFUL
new_leader_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:58644
I20260709 12:26:52.700762  5868 raft_consensus.cc:606] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Received request to transfer leadership to TS 80d6943d1ad94734981b057b3b4a5607
I20260709 12:26:52.704916  5868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
mode: GRACEFUL
new_leader_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:58644
I20260709 12:26:52.705355  5868 raft_consensus.cc:606] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Received request to transfer leadership to TS 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:52.785518  6157 consensus_queue.cc:1048] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.796182  6197 consensus_queue.cc:1048] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.810417  6197 consensus_queue.cc:1048] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.822790  6157 consensus_queue.cc:1048] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.871857  6157 consensus_queue.cc:1048] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.882309  6188 consensus_queue.cc:1048] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.888592  6188 consensus_queue.cc:1048] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.892146  6188 consensus_queue.cc:1048] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.897432  6203 consensus_queue.cc:1048] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.897887  6180 raft_consensus.cc:993] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: : Instructing follower 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:52.898465  6180 raft_consensus.cc:1081] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Signalling peer 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:52.899842  6157 raft_consensus.cc:993] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d: : Instructing follower 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:52.902175  5942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28f5bdf3b5c14e03a96de8b9116270f2"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:38438
I20260709 12:26:52.902779  5942 raft_consensus.cc:493] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.903136  5942 raft_consensus.cc:3060] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.904192  6157 raft_consensus.cc:1081] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Signalling peer 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:52.907682  5943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6192d47e8ea7451e8397a3299b5a2d77"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:38438
I20260709 12:26:52.908209  5943 raft_consensus.cc:493] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.908535  5943 raft_consensus.cc:3060] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.915639  5942 raft_consensus.cc:515] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.916534  6197 consensus_queue.cc:1048] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.920501  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f5bdf3b5c14e03a96de8b9116270f2" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:52.921103  5866 raft_consensus.cc:3055] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:52.921407  5866 raft_consensus.cc:740] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.922175  5866 consensus_queue.cc:260] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.923367  5866 raft_consensus.cc:3060] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.926270  5942 leader_election.cc:290] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.927006  5943 raft_consensus.cc:515] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.929352  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f5bdf3b5c14e03a96de8b9116270f2" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.929931  6016 raft_consensus.cc:3060] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.930317  6203 raft_consensus.cc:993] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607: : Instructing follower 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:52.930789  6203 raft_consensus.cc:1081] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Signalling peer 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:52.933549  5867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36c78c0da2be469e8319bd876fc03cc2"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:58624
I20260709 12:26:52.934087  5867 raft_consensus.cc:493] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.934437  5867 raft_consensus.cc:3060] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.935600  6155 consensus_queue.cc:1048] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.938134  5866 raft_consensus.cc:2468] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:52.940536  5908 leader_election.cc:304] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.941318  6155 raft_consensus.cc:2804] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.941788  6155 raft_consensus.cc:697] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:52.942595  6155 consensus_queue.cc:237] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.944089  5943 leader_election.cc:290] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.945853  6016 raft_consensus.cc:2468] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:52.946223  6015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6192d47e8ea7451e8397a3299b5a2d77" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.946858  6015 raft_consensus.cc:3060] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.947027  5866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6192d47e8ea7451e8397a3299b5a2d77" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:52.947767  5866 raft_consensus.cc:3055] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:52.948120  5866 raft_consensus.cc:740] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.949182  5866 consensus_queue.cc:260] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.949373  5867 raft_consensus.cc:515] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.950621  5866 raft_consensus.cc:3060] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.953626  5868 raft_consensus.cc:1240] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Rejecting Update request from peer 80d6943d1ad94734981b057b3b4a5607 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:52.957450  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c78c0da2be469e8319bd876fc03cc2" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:52.958109  5943 raft_consensus.cc:3055] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:52.958441  5943 raft_consensus.cc:740] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:52.958634  6015 raft_consensus.cc:2468] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:52.959334  5943 consensus_queue.cc:260] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.959807  5866 raft_consensus.cc:2468] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:52.960312  6155 consensus_queue.cc:1059] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.961524  5867 leader_election.cc:290] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.961900  5908 leader_election.cc:304] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:52.962620  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c78c0da2be469e8319bd876fc03cc2" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.962788  6168 raft_consensus.cc:2804] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.963481  6168 raft_consensus.cc:697] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:52.962879  5764 catalog_manager.cc:5697] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 1 to 2, leader changed from 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193) to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.964332  6168 consensus_queue.cc:237] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.973733  6157 raft_consensus.cc:993] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: : Instructing follower 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:52.974270  6188 raft_consensus.cc:1081] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Signalling peer 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:52.975492  5943 raft_consensus.cc:3060] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.975930  5942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "728c2857c8f54c62a66b84277dd80765"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:38438
I20260709 12:26:52.977430  5942 raft_consensus.cc:493] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.977803  5942 raft_consensus.cc:3060] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.983155  5943 raft_consensus.cc:2468] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 2.
I20260709 12:26:52.987104  5942 raft_consensus.cc:515] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.989193  5833 leader_election.cc:304] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:52.990010  6188 raft_consensus.cc:2804] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.990501  6188 raft_consensus.cc:697] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.990938  5942 leader_election.cc:290] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:52.991648  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728c2857c8f54c62a66b84277dd80765" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:52.991338  6188 consensus_queue.cc:237] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.992319  5868 raft_consensus.cc:3055] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:52.992694  5868 raft_consensus.cc:740] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:52.993392  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728c2857c8f54c62a66b84277dd80765" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:52.993340  6157 consensus_queue.cc:1048] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:52.993455  5868 consensus_queue.cc:260] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:52.994306  6017 raft_consensus.cc:3060] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.994660  5868 raft_consensus.cc:3060] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.003537  6017 raft_consensus.cc:2468] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:53.004782  5908 leader_election.cc:304] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:53.005671  6168 raft_consensus.cc:2804] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.006141  6168 raft_consensus.cc:697] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:53.006551  5765 catalog_manager.cc:5697] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 1 to 2, leader changed from 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194) to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 2 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.006923  6168 consensus_queue.cc:237] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.007707  5868 raft_consensus.cc:2468] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:53.010946  5766 catalog_manager.cc:5697] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 1 to 2, leader changed from 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193) to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.012851  6188 raft_consensus.cc:993] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d: : Instructing follower 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:53.013334  6188 raft_consensus.cc:1081] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Signalling peer 80d6943d1ad94734981b057b3b4a5607 to start an election
I20260709 12:26:53.025810  6121 consensus_queue.cc:1048] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.030205  5943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
 from {username='slave'} at 127.0.0.1:38438
I20260709 12:26:53.031582  5943 raft_consensus.cc:493] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:53.033257  5943 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.041383  6197 consensus_queue.cc:1048] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:53.051766  6180 raft_consensus.cc:993] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: : Instructing follower 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:53.052245  6180 raft_consensus.cc:1081] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Signalling peer 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:53.052791  5943 raft_consensus.cc:515] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.054411  6016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5"
dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:26:53.056084  5943 leader_election.cc:290] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:53.057741  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:53.063107  5868 raft_consensus.cc:3055] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:53.056576  6016 raft_consensus.cc:493] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:53.063678  5868 raft_consensus.cc:740] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:53.063886  6016 raft_consensus.cc:3060] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.064661  5868 consensus_queue.cc:260] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.061291  5766 catalog_manager.cc:5697] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 1 to 2, leader changed from 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193) to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.057781  6017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "80d6943d1ad94734981b057b3b4a5607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:53.066689  6017 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.060104  6157 consensus_queue.cc:1048] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:26:53.065869  5868 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.082399  5868 raft_consensus.cc:2468] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:53.083506  5908 leader_election.cc:304] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f3ea7af0d40cc8866aa9b7a32207d, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:53.083590  6016 raft_consensus.cc:515] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.084297  6203 raft_consensus.cc:2804] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.084828  6203 raft_consensus.cc:697] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Leader. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:53.085649  6203 consensus_queue.cc:237] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.085866  6017 raft_consensus.cc:2468] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d6943d1ad94734981b057b3b4a5607 in term 2.
I20260709 12:26:53.094018  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:53.094636  5943 raft_consensus.cc:3060] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.093432  6016 leader_election.cc:290] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:53.098819  5868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9c2f7f47184b10b89f98742a2902d5" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:53.099852  5868 raft_consensus.cc:3055] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:53.100206  5943 raft_consensus.cc:2468] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 2.
I20260709 12:26:53.100239  5868 raft_consensus.cc:740] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:53.101286  5868 consensus_queue.cc:260] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.101559  5982 leader_election.cc:304] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:53.102437  6105 raft_consensus.cc:2804] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.102617  5868 raft_consensus.cc:3060] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.103804  6105 raft_consensus.cc:697] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 2 LEADER]: Becoming Leader. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:53.104693  6105 consensus_queue.cc:237] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.106005  5764 catalog_manager.cc:5697] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 reported cstate change: term changed from 1 to 2, leader changed from 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193) to 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194). New cstate: current_term: 2 leader_uuid: "80d6943d1ad94734981b057b3b4a5607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.109416  5868 raft_consensus.cc:2468] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 2.
I20260709 12:26:53.116384  5766 catalog_manager.cc:5697] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec reported cstate change: term changed from 1 to 2, leader changed from 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193) to 038a4934597746cb85b58eca24e2b1ec (127.29.131.195). New cstate: current_term: 2 leader_uuid: "038a4934597746cb85b58eca24e2b1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:53.146340  6168 raft_consensus.cc:993] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607: : Instructing follower 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:53.146883  6203 raft_consensus.cc:1081] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Signalling peer 3d3f3ea7af0d40cc8866aa9b7a32207d to start an election
I20260709 12:26:53.148427  5868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98fc67292e20428f886df39f8339afa0"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
 from {username='slave'} at 127.0.0.1:58624
I20260709 12:26:53.148916  5868 raft_consensus.cc:493] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:53.149200  5868 raft_consensus.cc:3060] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.154662  5868 raft_consensus.cc:515] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.156361  5868 leader_election.cc:290] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Requested vote from peers 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519), 038a4934597746cb85b58eca24e2b1ec (127.29.131.195:40921)
I20260709 12:26:53.157235  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98fc67292e20428f886df39f8339afa0" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:53.157668  6016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98fc67292e20428f886df39f8339afa0" candidate_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
I20260709 12:26:53.157943  5943 raft_consensus.cc:3055] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:53.158300  5943 raft_consensus.cc:740] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:53.158344  6016 raft_consensus.cc:3060] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.159301  5943 consensus_queue.cc:260] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.160597  5943 raft_consensus.cc:3060] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.164942  6016 raft_consensus.cc:2468] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 2.
I20260709 12:26:53.165808  5943 raft_consensus.cc:2468] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f3ea7af0d40cc8866aa9b7a32207d in term 2.
I20260709 12:26:53.166273  5833 leader_election.cc:304] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:53.167132  6157 raft_consensus.cc:2804] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.167796  6157 raft_consensus.cc:697] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Becoming Leader. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:53.168560  6157 consensus_queue.cc:237] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:53.175343  5766 catalog_manager.cc:5697] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d reported cstate change: term changed from 1 to 2, leader changed from 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194) to 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193). New cstate: current_term: 2 leader_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.333468  5866 raft_consensus.cc:1275] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.334739  6168 consensus_queue.cc:1048] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.342813  6016 raft_consensus.cc:1275] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.345046  6203 consensus_queue.cc:1048] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:53.374186  5943 raft_consensus.cc:1275] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.375545  6157 consensus_queue.cc:1048] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.383015  6017 raft_consensus.cc:3060] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.389990  6017 raft_consensus.cc:1275] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.391374  6157 consensus_queue.cc:1048] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.446867  6017 raft_consensus.cc:1275] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.448000  6168 consensus_queue.cc:1048] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.455055  5866 raft_consensus.cc:1275] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.456552  6155 consensus_queue.cc:1048] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.523489  6017 raft_consensus.cc:1275] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.524734  6168 consensus_queue.cc:1048] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.532435  5866 raft_consensus.cc:1275] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.533926  5866 raft_consensus.cc:1275] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.534055  6168 consensus_queue.cc:1048] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.535472  6105 consensus_queue.cc:1048] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.544909  5943 raft_consensus.cc:1275] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.547775  6105 consensus_queue.cc:1048] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.573371  5867 raft_consensus.cc:1275] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.574719  6168 consensus_queue.cc:1048] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.585533  6017 raft_consensus.cc:1275] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 80d6943d1ad94734981b057b3b4a5607: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.587092  6168 consensus_queue.cc:1048] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.590533  5943 raft_consensus.cc:1275] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.592867  6188 consensus_queue.cc:1048] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.605109  6017 raft_consensus.cc:1275] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Refusing update from remote peer 3d3f3ea7af0d40cc8866aa9b7a32207d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.606585  6157 consensus_queue.cc:1048] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [LEADER]: Connected to new peer: Peer: permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:55.708871  5766 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58094:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:26:55.727473  5766 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58094:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:26:55.756559 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:55.954854  6278 tablet.cc:1724] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:55.963018  6261 log.cc:927] Time spent T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:26:55.970770  6265 log.cc:927] Time spent T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:26:55.975407  6252 log.cc:927] Time spent T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
I20260709 12:26:56.009560  6278 tablet.cc:1724] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:56.015133  6268 log.cc:927] Time spent T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:26:56.017795  6251 log.cc:927] Time spent T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Append to log took a long time: real 0.185s	user 0.006s	sys 0.000s
I20260709 12:26:56.019177  5865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1a42f2187564e60981bcb932a28fdd5"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
mode: GRACEFUL
new_leader_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:34306
I20260709 12:26:56.029575  6280 tablet.cc:1724] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:56.034544  6044 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:98fc67292e20428f886df39f8339afa0)
W20260709 12:26:56.040947  6044 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:98fc67292e20428f886df39f8339afa0)
W20260709 12:26:56.041798  6044 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:98fc67292e20428f886df39f8339afa0)
I20260709 12:26:56.043314  6280 tablet.cc:1724] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:56.065876  6266 log.cc:927] Time spent T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:26:56.072587  6276 tablet.cc:1724] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.073043  6281 tablet.cc:1724] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.012949  6277 tablet.cc:1724] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:56.115700  5833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:40921, user_credentials={real_user=slave}} blocked reactor thread for 50122.4us
I20260709 12:26:56.101843  6282 tablet.cc:1724] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.161267  5865 raft_consensus.cc:606] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Received request to transfer leadership to TS 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:56.190287  6289 tablet.cc:1724] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.191474  6293 tablet.cc:1724] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.202105  6280 tablet.cc:1724] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.203195  6290 tablet.cc:1724] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.231894  6295 tablet.cc:1724] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.247582  6281 tablet.cc:1724] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.259990  6276 tablet.cc:1724] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.265300  6278 tablet.cc:1724] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.262995  6295 tablet.cc:1724] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.274909  6280 tablet.cc:1724] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.229964  6296 tablet.cc:1724] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.278194  6282 tablet.cc:1724] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.230038  6294 tablet.cc:1724] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.288380  6281 tablet.cc:1724] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.289850  6277 tablet.cc:1724] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.291424  6290 tablet.cc:1724] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.312067  5943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
mode: GRACEFUL
new_leader_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:46364
I20260709 12:26:56.312848  5943 raft_consensus.cc:606] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Received request to transfer leadership to TS 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:56.314477 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:26:56.315114 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:56.319439  6293 tablet.cc:1724] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.327315  6281 tablet.cc:1724] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.331981  6277 tablet.cc:1724] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:56.344987  5943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1"
dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
mode: GRACEFUL
new_leader_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:46364
I20260709 12:26:56.345710  5943 raft_consensus.cc:606] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Received request to transfer leadership to TS 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:56.351006  5869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8"
dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
mode: GRACEFUL
new_leader_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:34306
I20260709 12:26:56.351634  5869 raft_consensus.cc:606] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Received request to transfer leadership to TS 038a4934597746cb85b58eca24e2b1ec
I20260709 12:26:56.353111 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:56.353742 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:56.367936  5764 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e: soft_deleted_table [id=dce6a6ef5987409c9cae2bd9e10ec487] alter complete (version 1)
I20260709 12:26:56.526705  6227 raft_consensus.cc:993] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: : Instructing follower 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:56.527382  6287 raft_consensus.cc:1081] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Signalling peer 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:56.528772  6017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1a42f2187564e60981bcb932a28fdd5"
dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:26:56.529167  6017 raft_consensus.cc:493] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:56.529420  6017 raft_consensus.cc:3060] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.534322  6017 raft_consensus.cc:515] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.535969  6017 leader_election.cc:290] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 2 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:56.536676  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a42f2187564e60981bcb932a28fdd5" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:56.537114  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a42f2187564e60981bcb932a28fdd5" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:56.537271  5869 raft_consensus.cc:3055] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:56.537657  5869 raft_consensus.cc:740] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:56.537683  5943 raft_consensus.cc:3060] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.538405  5869 consensus_queue.cc:260] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.539417  5869 raft_consensus.cc:3060] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.543049  5943 raft_consensus.cc:2468] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 2.
I20260709 12:26:56.544198  5982 leader_election.cc:304] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:56.544493  5869 raft_consensus.cc:2468] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 2.
I20260709 12:26:56.545022  6225 raft_consensus.cc:2804] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:56.545517  6225 raft_consensus.cc:697] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 2 LEADER]: Becoming Leader. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:56.546240  6225 consensus_queue.cc:237] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.552940  5766 catalog_manager.cc:5697] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec reported cstate change: term changed from 1 to 2, leader changed from 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193) to 038a4934597746cb85b58eca24e2b1ec (127.29.131.195). New cstate: current_term: 2 leader_uuid: "038a4934597746cb85b58eca24e2b1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:56.609582  6287 raft_consensus.cc:993] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d: : Instructing follower 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:56.610116  6227 raft_consensus.cc:1081] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Signalling peer 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:56.611817  6017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8"
dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:26:56.612260  6017 raft_consensus.cc:493] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:56.612494  6017 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.617044  6017 raft_consensus.cc:515] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.618476  6017 leader_election.cc:290] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 3 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:56.619367  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:56.619645  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c99e15ae874c61ab046933f682f1c8" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:56.620069  5869 raft_consensus.cc:3055] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:56.620354  5943 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.620465  5869 raft_consensus.cc:740] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d3f3ea7af0d40cc8866aa9b7a32207d, State: Running, Role: LEADER
I20260709 12:26:56.621361  5869 consensus_queue.cc:260] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.622321  5869 raft_consensus.cc:3060] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.625674  5943 raft_consensus.cc:2468] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 3.
I20260709 12:26:56.626711  5982 leader_election.cc:304] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 80d6943d1ad94734981b057b3b4a5607; no voters: 
I20260709 12:26:56.627547  5869 raft_consensus.cc:2468] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 3.
I20260709 12:26:56.627609  6225 raft_consensus.cc:2804] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:56.628327  6225 raft_consensus.cc:697] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 3 LEADER]: Becoming Leader. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:56.629439  6225 consensus_queue.cc:237] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.636564  5766 catalog_manager.cc:5697] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec reported cstate change: term changed from 2 to 3, leader changed from 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193) to 038a4934597746cb85b58eca24e2b1ec (127.29.131.195). New cstate: current_term: 3 leader_uuid: "038a4934597746cb85b58eca24e2b1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:56.664503  6292 raft_consensus.cc:993] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607: : Instructing follower 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:56.665132  6226 raft_consensus.cc:1081] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Signalling peer 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:56.666723  6017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9"
dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:52450
I20260709 12:26:56.667274  6017 raft_consensus.cc:493] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:56.667618  6017 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.672571  6017 raft_consensus.cc:515] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.674324  6017 leader_election.cc:290] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 3 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:56.675011  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:56.675441  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc232ae88e61401ba423431673d5f7d9" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:56.675729  5869 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.676038  5943 raft_consensus.cc:3055] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:56.676366  5943 raft_consensus.cc:740] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:56.677117  5943 consensus_queue.cc:260] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.678310  5943 raft_consensus.cc:3060] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.682580  5869 raft_consensus.cc:2468] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 3.
I20260709 12:26:56.684203  5982 leader_election.cc:304] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:56.684954  6225 raft_consensus.cc:2804] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:56.685047  5943 raft_consensus.cc:2468] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 3.
I20260709 12:26:56.685458  6225 raft_consensus.cc:697] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 3 LEADER]: Becoming Leader. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:56.686301  6225 consensus_queue.cc:237] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.692543  5766 catalog_manager.cc:5697] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec reported cstate change: term changed from 2 to 3, leader changed from 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194) to 038a4934597746cb85b58eca24e2b1ec (127.29.131.195). New cstate: current_term: 3 leader_uuid: "038a4934597746cb85b58eca24e2b1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:56.771205  6226 raft_consensus.cc:993] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607: : Instructing follower 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:56.771723  6292 raft_consensus.cc:1081] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Signalling peer 038a4934597746cb85b58eca24e2b1ec to start an election
I20260709 12:26:56.773061  6015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1"
dest_uuid: "038a4934597746cb85b58eca24e2b1ec"
 from {username='slave'} at 127.0.0.1:52450
I20260709 12:26:56.773495  6015 raft_consensus.cc:493] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:56.773751  6015 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.778568  6015 raft_consensus.cc:515] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.780195  6015 leader_election.cc:290] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 3 election: Requested vote from peers 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599), 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519)
I20260709 12:26:56.780754  5869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d"
I20260709 12:26:56.781468  5869 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.781410  5943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f3cbbe1ef54755b6cae882276fabb1" candidate_uuid: "038a4934597746cb85b58eca24e2b1ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80d6943d1ad94734981b057b3b4a5607"
I20260709 12:26:56.782203  5943 raft_consensus.cc:3055] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:56.782505  5943 raft_consensus.cc:740] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80d6943d1ad94734981b057b3b4a5607, State: Running, Role: LEADER
I20260709 12:26:56.783260  5943 consensus_queue.cc:260] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.784554  5943 raft_consensus.cc:3060] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.788766  5869 raft_consensus.cc:2468] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 3.
I20260709 12:26:56.790023  5982 leader_election.cc:304] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 038a4934597746cb85b58eca24e2b1ec, 3d3f3ea7af0d40cc8866aa9b7a32207d; no voters: 
I20260709 12:26:56.790822  6225 raft_consensus.cc:2804] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:56.791292  6225 raft_consensus.cc:697] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 3 LEADER]: Becoming Leader. State: Replica: 038a4934597746cb85b58eca24e2b1ec, State: Running, Role: LEADER
I20260709 12:26:56.791319  5943 raft_consensus.cc:2468] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 038a4934597746cb85b58eca24e2b1ec in term 3.
I20260709 12:26:56.792243  6225 consensus_queue.cc:237] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } }
I20260709 12:26:56.799640  5766 catalog_manager.cc:5697] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec reported cstate change: term changed from 2 to 3, leader changed from 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194) to 038a4934597746cb85b58eca24e2b1ec (127.29.131.195). New cstate: current_term: 3 leader_uuid: "038a4934597746cb85b58eca24e2b1ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038a4934597746cb85b58eca24e2b1ec" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 40921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.085542  5869 raft_consensus.cc:1275] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:57.087033  6225 consensus_queue.cc:1048] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.096554  5943 raft_consensus.cc:1275] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:57.098209  6271 consensus_queue.cc:1048] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.103816  5869 raft_consensus.cc:1275] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:57.105403  6271 consensus_queue.cc:1048] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:57.119822  5943 raft_consensus.cc:1275] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:57.122291  5866 raft_consensus.cc:1275] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:57.122354  6271 consensus_queue.cc:1048] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:57.125133  6306 consensus_queue.cc:1048] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.136826  5943 raft_consensus.cc:1275] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:57.140584  6306 consensus_queue.cc:1048] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.265988  5943 raft_consensus.cc:1275] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:57.267387  6306 consensus_queue.cc:1048] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "80d6943d1ad94734981b057b3b4a5607" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.279296  5869 raft_consensus.cc:1275] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Refusing update from remote peer 038a4934597746cb85b58eca24e2b1ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:57.280665  6306 consensus_queue.cc:1048] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f3ea7af0d40cc8866aa9b7a32207d" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.354862 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:57.361073 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:57.361483 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:57.366415 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:57.366784 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:58.367826 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:58.373446 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:58.373920 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:58.378543 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:58.378928 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:59.380007 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:59.386055 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:59.386445 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:59.391129 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:59.391566 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:00.392521 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:00.398173 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:00.398679 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:00.404105 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:00.404531 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:01.405978 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:01.413597 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:01.414465 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:01.424746 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:01.425468 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:02.426889 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:02.432559 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:02.433039 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:02.437915 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:02.438364 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:03.439335 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:03.444860 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:03.445295 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:03.450003 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:03.450376 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:04.451521 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:04.457582 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:04.458033 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:04.462776 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:04.463200 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:05.464386 30223 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:05.471140 30223 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:05.471653 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:05.476310 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:05.476679 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:06.533324 30223 tablet_server.cc:179] TabletServer@127.29.131.193:0 shutting down...
W20260709 12:27:06.550082  5982 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:27:06.555570  5982 consensus_peers.cc:597] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec -> Peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Couldn't send request to peer 3d3f3ea7af0d40cc8866aa9b7a32207d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:06.578421  5908 consensus_peers.cc:597] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 -> Peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Couldn't send request to peer 3d3f3ea7af0d40cc8866aa9b7a32207d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.579696 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:06.580588 30223 tablet_replica.cc:333] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.581583 30223 raft_consensus.cc:2243] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.582324 30223 raft_consensus.cc:2272] T dc232ae88e61401ba423431673d5f7d9 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.585006 30223 tablet_replica.cc:333] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.585711 30223 raft_consensus.cc:2243] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.586272 30223 raft_consensus.cc:2272] T 728c2857c8f54c62a66b84277dd80765 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.589521 30223 tablet_replica.cc:333] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.590188 30223 raft_consensus.cc:2243] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.591053 30223 raft_consensus.cc:2272] T 28f5bdf3b5c14e03a96de8b9116270f2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.593591 30223 tablet_replica.cc:333] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.594439 30223 raft_consensus.cc:2243] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.595106 30223 raft_consensus.cc:2272] T 9d9c2f7f47184b10b89f98742a2902d5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.597981 30223 tablet_replica.cc:333] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.598806 30223 raft_consensus.cc:2243] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.599442 30223 raft_consensus.cc:2272] T 6192d47e8ea7451e8397a3299b5a2d77 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.602933 30223 tablet_replica.cc:333] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.603750 30223 raft_consensus.cc:2243] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.605034 30223 raft_consensus.cc:2272] T 98fc67292e20428f886df39f8339afa0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.608037 30223 tablet_replica.cc:333] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.608922 30223 raft_consensus.cc:2243] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.609519 30223 raft_consensus.cc:2272] T a1a42f2187564e60981bcb932a28fdd5 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.612783 30223 tablet_replica.cc:333] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.613665 30223 raft_consensus.cc:2243] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.614380 30223 raft_consensus.cc:2272] T 85059102981a446ca6d92eb639594fbd P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.617223 30223 tablet_replica.cc:333] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.617806 30223 raft_consensus.cc:2243] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.618290 30223 raft_consensus.cc:2272] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.620800 30223 tablet_replica.cc:333] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.621390 30223 raft_consensus.cc:2243] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.622996 30223 raft_consensus.cc:2272] T ae5c966758484bf985613d924d9fc78e P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.625257 30223 tablet_replica.cc:333] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.625838 30223 raft_consensus.cc:2243] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.626714 30223 raft_consensus.cc:2272] T 361d45b0b83e4c6089c7f122b30e3601 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.629580 30223 tablet_replica.cc:333] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.630209 30223 raft_consensus.cc:2243] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.630805 30223 raft_consensus.cc:2272] T ba6f8897ba614282b8394547263b8325 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.633258 30223 tablet_replica.cc:333] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.633837 30223 raft_consensus.cc:2243] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.634795 30223 raft_consensus.cc:2272] T deecd603222343a5b7b6a242eb08915c P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.637367 30223 tablet_replica.cc:333] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.637940 30223 raft_consensus.cc:2243] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.638466 30223 raft_consensus.cc:2272] T 41f3cbbe1ef54755b6cae882276fabb1 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.641366 30223 tablet_replica.cc:333] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.641965 30223 raft_consensus.cc:2243] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.642468 30223 raft_consensus.cc:2272] T f6ab5bf3c8a4420d8bc22d00738e797f P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.645306 30223 tablet_replica.cc:333] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.646040 30223 raft_consensus.cc:2243] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.647059 30223 raft_consensus.cc:2272] T 36c78c0da2be469e8319bd876fc03cc2 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.649715 30223 tablet_replica.cc:333] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.650290 30223 raft_consensus.cc:2243] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.651204 30223 raft_consensus.cc:2272] T 9622eb4caff840aa820ddafbbb577201 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.653632 30223 tablet_replica.cc:333] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d: stopping tablet replica
I20260709 12:27:06.654114 30223 raft_consensus.cc:2243] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.654611 30223 raft_consensus.cc:2272] T c7c99e15ae874c61ab046933f682f1c8 P 3d3f3ea7af0d40cc8866aa9b7a32207d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.706127 30223 tablet_server.cc:196] TabletServer@127.29.131.193:0 shutdown complete.
W20260709 12:27:06.744850  5908 consensus_peers.cc:597] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 -> Peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Couldn't send request to peer 3d3f3ea7af0d40cc8866aa9b7a32207d. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.758670 30223 tablet_server.cc:179] TabletServer@127.29.131.194:0 shutting down...
W20260709 12:27:06.758850  5982 consensus_peers.cc:597] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec -> Peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Couldn't send request to peer 3d3f3ea7af0d40cc8866aa9b7a32207d. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:06.778175  5982 consensus_peers.cc:597] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec -> Peer 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519): Couldn't send request to peer 80d6943d1ad94734981b057b3b4a5607. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:06.785533  5908 consensus_peers.cc:597] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 -> Peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Couldn't send request to peer 3d3f3ea7af0d40cc8866aa9b7a32207d. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.792740 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:06.793540 30223 tablet_replica.cc:333] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.794358 30223 raft_consensus.cc:2243] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.794942 30223 raft_consensus.cc:2272] T 9d9c2f7f47184b10b89f98742a2902d5 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.797323 30223 tablet_replica.cc:333] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.797937 30223 raft_consensus.cc:2243] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.798779 30223 raft_consensus.cc:2272] T 6192d47e8ea7451e8397a3299b5a2d77 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.800982 30223 tablet_replica.cc:333] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.801611 30223 raft_consensus.cc:2243] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.802423 30223 raft_consensus.cc:2272] T 728c2857c8f54c62a66b84277dd80765 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.804658 30223 tablet_replica.cc:333] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.805220 30223 raft_consensus.cc:2243] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.806071 30223 raft_consensus.cc:2272] T 28f5bdf3b5c14e03a96de8b9116270f2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.808391 30223 tablet_replica.cc:333] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.809029 30223 raft_consensus.cc:2243] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.809494 30223 raft_consensus.cc:2272] T dc232ae88e61401ba423431673d5f7d9 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.811695 30223 tablet_replica.cc:333] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.812268 30223 raft_consensus.cc:2243] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.812736 30223 raft_consensus.cc:2272] T a1a42f2187564e60981bcb932a28fdd5 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.814883 30223 tablet_replica.cc:333] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.815478 30223 raft_consensus.cc:2243] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.815968 30223 raft_consensus.cc:2272] T 98fc67292e20428f886df39f8339afa0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.818169 30223 tablet_replica.cc:333] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.818719 30223 raft_consensus.cc:2243] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.819284 30223 raft_consensus.cc:2272] T 85059102981a446ca6d92eb639594fbd P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.821611 30223 tablet_replica.cc:333] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.822172 30223 raft_consensus.cc:2243] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.823213 30223 raft_consensus.cc:2272] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:06.824877  5982 consensus_peers.cc:597] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec -> Peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Couldn't send request to peer 3d3f3ea7af0d40cc8866aa9b7a32207d. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.826079 30223 tablet_replica.cc:333] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.826956 30223 raft_consensus.cc:2243] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.828050 30223 raft_consensus.cc:2272] T ba6f8897ba614282b8394547263b8325 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.830953 30223 tablet_replica.cc:333] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.831566 30223 raft_consensus.cc:2243] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.832049 30223 raft_consensus.cc:2272] T 41f3cbbe1ef54755b6cae882276fabb1 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.834247 30223 tablet_replica.cc:333] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.834764 30223 raft_consensus.cc:2243] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.835217 30223 raft_consensus.cc:2272] T deecd603222343a5b7b6a242eb08915c P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.837389 30223 tablet_replica.cc:333] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.837914 30223 raft_consensus.cc:2243] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.838474 30223 raft_consensus.cc:2272] T ae5c966758484bf985613d924d9fc78e P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.840664 30223 tablet_replica.cc:333] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.841171 30223 raft_consensus.cc:2243] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.841641 30223 raft_consensus.cc:2272] T 361d45b0b83e4c6089c7f122b30e3601 P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.843858 30223 tablet_replica.cc:333] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.844383 30223 raft_consensus.cc:2243] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.845316 30223 raft_consensus.cc:2272] T f6ab5bf3c8a4420d8bc22d00738e797f P 80d6943d1ad94734981b057b3b4a5607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.847978 30223 tablet_replica.cc:333] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.848608 30223 raft_consensus.cc:2243] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.849238 30223 raft_consensus.cc:2272] T 36c78c0da2be469e8319bd876fc03cc2 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:06.850589  5982 consensus_peers.cc:597] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec -> Peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Couldn't send request to peer 3d3f3ea7af0d40cc8866aa9b7a32207d. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.852113 30223 tablet_replica.cc:333] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.852933 30223 raft_consensus.cc:2243] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.853457 30223 raft_consensus.cc:2272] T 9622eb4caff840aa820ddafbbb577201 P 80d6943d1ad94734981b057b3b4a5607 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:06.855944  5982 consensus_peers.cc:597] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec -> Peer 3d3f3ea7af0d40cc8866aa9b7a32207d (127.29.131.193:43599): Couldn't send request to peer 3d3f3ea7af0d40cc8866aa9b7a32207d. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:43599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.856527 30223 tablet_replica.cc:333] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607: stopping tablet replica
I20260709 12:27:06.857151 30223 raft_consensus.cc:2243] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.857685 30223 raft_consensus.cc:2272] T c7c99e15ae874c61ab046933f682f1c8 P 80d6943d1ad94734981b057b3b4a5607 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:06.885671  5908 connection.cc:466] server connection from 127.0.0.1:38454 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38454 (request call id 173) could send its response
W20260709 12:27:06.886600  5982 consensus_peers.cc:597] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec -> Peer 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519): Couldn't send request to peer 80d6943d1ad94734981b057b3b4a5607. Status: Network error: recv got EOF from 127.29.131.194:37519 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.901814 30223 tablet_server.cc:196] TabletServer@127.29.131.194:0 shutdown complete.
W20260709 12:27:06.906384  5982 consensus_peers.cc:597] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec -> Peer 80d6943d1ad94734981b057b3b4a5607 (127.29.131.194:37519): Couldn't send request to peer 80d6943d1ad94734981b057b3b4a5607. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:37519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.941363 30223 tablet_server.cc:179] TabletServer@127.29.131.195:0 shutting down...
I20260709 12:27:06.970041 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:06.970757 30223 tablet_replica.cc:333] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.971676 30223 raft_consensus.cc:2243] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.972222 30223 raft_consensus.cc:2272] T 98fc67292e20428f886df39f8339afa0 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.974622 30223 tablet_replica.cc:333] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.975291 30223 raft_consensus.cc:2243] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.975832 30223 raft_consensus.cc:2272] T 728c2857c8f54c62a66b84277dd80765 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.977921 30223 tablet_replica.cc:333] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.978447 30223 raft_consensus.cc:2243] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.978943 30223 raft_consensus.cc:2272] T 6192d47e8ea7451e8397a3299b5a2d77 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.981132 30223 tablet_replica.cc:333] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.981698 30223 raft_consensus.cc:2243] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.982569 30223 raft_consensus.cc:2272] T a1a42f2187564e60981bcb932a28fdd5 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.984746 30223 tablet_replica.cc:333] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.985337 30223 raft_consensus.cc:2243] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.985843 30223 raft_consensus.cc:2272] T 28f5bdf3b5c14e03a96de8b9116270f2 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.987928 30223 tablet_replica.cc:333] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.988476 30223 raft_consensus.cc:2243] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.989384 30223 raft_consensus.cc:2272] T dc232ae88e61401ba423431673d5f7d9 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.991510 30223 tablet_replica.cc:333] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.992070 30223 raft_consensus.cc:2243] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:06.992928 30223 raft_consensus.cc:2272] T 85059102981a446ca6d92eb639594fbd P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.995075 30223 tablet_replica.cc:333] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.995658 30223 raft_consensus.cc:2243] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.996140 30223 raft_consensus.cc:2272] T 809b1a993e9a4c8eb37fe9de41fa0bd0 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:06.998206 30223 tablet_replica.cc:333] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:06.998725 30223 raft_consensus.cc:2243] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:06.999199 30223 raft_consensus.cc:2272] T f6ab5bf3c8a4420d8bc22d00738e797f P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.001174 30223 tablet_replica.cc:333] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.001686 30223 raft_consensus.cc:2243] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.002128 30223 raft_consensus.cc:2272] T deecd603222343a5b7b6a242eb08915c P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.004271 30223 tablet_replica.cc:333] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.004824 30223 raft_consensus.cc:2243] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.005654 30223 raft_consensus.cc:2272] T 41f3cbbe1ef54755b6cae882276fabb1 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.007701 30223 tablet_replica.cc:333] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.008373 30223 raft_consensus.cc:2243] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.008833 30223 raft_consensus.cc:2272] T ae5c966758484bf985613d924d9fc78e P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.010962 30223 tablet_replica.cc:333] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.011502 30223 raft_consensus.cc:2243] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.011936 30223 raft_consensus.cc:2272] T 361d45b0b83e4c6089c7f122b30e3601 P 038a4934597746cb85b58eca24e2b1ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.013868 30223 tablet_replica.cc:333] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.014400 30223 raft_consensus.cc:2243] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.015192 30223 raft_consensus.cc:2272] T 9d9c2f7f47184b10b89f98742a2902d5 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.017072 30223 tablet_replica.cc:333] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.017562 30223 raft_consensus.cc:2243] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.017974 30223 raft_consensus.cc:2272] T ba6f8897ba614282b8394547263b8325 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.019979 30223 tablet_replica.cc:333] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.020401 30223 raft_consensus.cc:2243] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.021127 30223 raft_consensus.cc:2272] T c7c99e15ae874c61ab046933f682f1c8 P 038a4934597746cb85b58eca24e2b1ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.023124 30223 tablet_replica.cc:333] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.023550 30223 raft_consensus.cc:2243] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.023953 30223 raft_consensus.cc:2272] T 36c78c0da2be469e8319bd876fc03cc2 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.025861 30223 tablet_replica.cc:333] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec: stopping tablet replica
I20260709 12:27:07.026271 30223 raft_consensus.cc:2243] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.026672 30223 raft_consensus.cc:2272] T 9622eb4caff840aa820ddafbbb577201 P 038a4934597746cb85b58eca24e2b1ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.067364 30223 tablet_server.cc:196] TabletServer@127.29.131.195:0 shutdown complete.
I20260709 12:27:07.104506 30223 master.cc:562] Master@127.29.131.254:36709 shutting down...
I20260709 12:27:07.131541 30223 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:07.132112 30223 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.132405 30223 tablet_replica.cc:333] T 00000000000000000000000000000000 P 26623580d23f41a6bfc1a44fb92c388e: stopping tablet replica
I20260709 12:27:07.153525 30223 master.cc:584] Master@127.29.131.254:36709 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20366 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:27:07.210481 30223 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.131.254:37723
I20260709 12:27:07.211720 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:07.217859  6340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:07.218063  6341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:07.218712  6343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:07.219044 30223 server_base.cc:1061] running on GCE node
I20260709 12:27:07.220046 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:07.220237 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:07.220352 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600027220341 us; error 0 us; skew 500 ppm
I20260709 12:27:07.220800 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:07.223086 30223 webserver.cc:533] Webserver started at http://127.29.131.254:34795/ using document root <none> and password file <none>
I20260709 12:27:07.223613 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:07.223770 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:07.223984 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:07.225142 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/master-0-root/instance:
uuid: "2fc6fc1c22094b3986b443b8f6a6980c"
format_stamp: "Formatted at 2026-07-09 12:27:07 on dist-test-slave-n640"
I20260709 12:27:07.229763 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:27:07.233125  6348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.233968 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:07.234220 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/master-0-root
uuid: "2fc6fc1c22094b3986b443b8f6a6980c"
format_stamp: "Formatted at 2026-07-09 12:27:07 on dist-test-slave-n640"
I20260709 12:27:07.234468 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:07.258706 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:07.259939 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:07.298421 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.254:37723
I20260709 12:27:07.298534  6399 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.254:37723 every 8 connection(s)
I20260709 12:27:07.302376  6400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.313784  6400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c: Bootstrap starting.
I20260709 12:27:07.319070  6400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.323904  6400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c: No bootstrap required, opened a new log
I20260709 12:27:07.326296  6400 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc6fc1c22094b3986b443b8f6a6980c" member_type: VOTER }
I20260709 12:27:07.326784  6400 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.327068  6400 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc6fc1c22094b3986b443b8f6a6980c, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.327761  6400 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc6fc1c22094b3986b443b8f6a6980c" member_type: VOTER }
I20260709 12:27:07.328264  6400 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:07.328496  6400 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:07.328820  6400 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.334756  6400 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc6fc1c22094b3986b443b8f6a6980c" member_type: VOTER }
I20260709 12:27:07.335493  6400 leader_election.cc:304] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fc6fc1c22094b3986b443b8f6a6980c; no voters: 
I20260709 12:27:07.336944  6400 leader_election.cc:290] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:07.337393  6403 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:07.338809  6403 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 1 LEADER]: Becoming Leader. State: Replica: 2fc6fc1c22094b3986b443b8f6a6980c, State: Running, Role: LEADER
I20260709 12:27:07.339589  6403 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc6fc1c22094b3986b443b8f6a6980c" member_type: VOTER }
I20260709 12:27:07.340077  6400 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:07.344954  6404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fc6fc1c22094b3986b443b8f6a6980c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc6fc1c22094b3986b443b8f6a6980c" member_type: VOTER } }
I20260709 12:27:07.345770  6404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:07.347792  6405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fc6fc1c22094b3986b443b8f6a6980c. Latest consensus state: current_term: 1 leader_uuid: "2fc6fc1c22094b3986b443b8f6a6980c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc6fc1c22094b3986b443b8f6a6980c" member_type: VOTER } }
I20260709 12:27:07.348595  6405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:07.355041  6412 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:07.360414  6412 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:07.361441 30223 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:07.369791  6412 catalog_manager.cc:1383] Generated new cluster ID: a5d6bc9532de4f8a8ae87c41aa5cea53
I20260709 12:27:07.370096  6412 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:07.392673  6412 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:07.394023  6412 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:07.407100  6412 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c: Generated new TSK 0
I20260709 12:27:07.407758  6412 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:07.428071 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:07.434370  6421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:07.435792  6422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:07.437381 30223 server_base.cc:1061] running on GCE node
W20260709 12:27:07.437317  6424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:07.438638 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:07.438828 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:07.438949 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600027438938 us; error 0 us; skew 500 ppm
I20260709 12:27:07.439491 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:07.441891 30223 webserver.cc:533] Webserver started at http://127.29.131.193:39091/ using document root <none> and password file <none>
I20260709 12:27:07.442413 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:07.442571 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:07.442775 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:07.443931 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-0-root/instance:
uuid: "76b6c969c7684e3e9d66965782eba827"
format_stamp: "Formatted at 2026-07-09 12:27:07 on dist-test-slave-n640"
I20260709 12:27:07.448298 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:27:07.451582  6429 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.452467 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:07.452773 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-0-root
uuid: "76b6c969c7684e3e9d66965782eba827"
format_stamp: "Formatted at 2026-07-09 12:27:07 on dist-test-slave-n640"
I20260709 12:27:07.453096 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:07.477681 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:07.479157 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:07.480720 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:07.482949 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:07.483189 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.483521 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:07.483714 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.525580 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.193:38117
I20260709 12:27:07.525691  6491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.193:38117 every 8 connection(s)
I20260709 12:27:07.530706 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:07.538658  6496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:07.540555  6497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:07.543907  6499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:07.544147 30223 server_base.cc:1061] running on GCE node
I20260709 12:27:07.545403 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:07.545671 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:07.545907 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600027545862 us; error 0 us; skew 500 ppm
I20260709 12:27:07.546590 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:07.548197  6492 heartbeater.cc:344] Connected to a master server at 127.29.131.254:37723
I20260709 12:27:07.548553  6492 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:07.549336 30223 webserver.cc:533] Webserver started at http://127.29.131.194:33205/ using document root <none> and password file <none>
I20260709 12:27:07.549417  6492 heartbeater.cc:507] Master 127.29.131.254:37723 requested a full tablet report, sending...
I20260709 12:27:07.549949 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:07.550199 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:07.550464 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:07.551831 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-1-root/instance:
uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
format_stamp: "Formatted at 2026-07-09 12:27:07 on dist-test-slave-n640"
I20260709 12:27:07.551887  6365 ts_manager.cc:194] Registered new tserver with Master: 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117)
I20260709 12:27:07.553894  6365 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39626
I20260709 12:27:07.557166 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:07.560822  6504 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.561547 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:07.561846 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-1-root
uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
format_stamp: "Formatted at 2026-07-09 12:27:07 on dist-test-slave-n640"
I20260709 12:27:07.562136 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:07.578517 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:07.579761 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:07.581198 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:07.583528 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:07.583745 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.583978 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:07.584149 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.624264 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.194:33885
I20260709 12:27:07.624346  6566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.194:33885 every 8 connection(s)
I20260709 12:27:07.629302 30223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:07.637111  6570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:07.638988  6571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:07.642622  6567 heartbeater.cc:344] Connected to a master server at 127.29.131.254:37723
I20260709 12:27:07.642930 30223 server_base.cc:1061] running on GCE node
I20260709 12:27:07.643139  6567 heartbeater.cc:461] Registering TS with master...
W20260709 12:27:07.643016  6573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:07.644224  6567 heartbeater.cc:507] Master 127.29.131.254:37723 requested a full tablet report, sending...
I20260709 12:27:07.644363 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:07.644711 30223 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:07.644891 30223 hybrid_clock.cc:648] HybridClock initialized: now 1783600027644873 us; error 0 us; skew 500 ppm
I20260709 12:27:07.645632 30223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:07.646427  6365 ts_manager.cc:194] Registered new tserver with Master: 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:07.648270 30223 webserver.cc:533] Webserver started at http://127.29.131.195:37589/ using document root <none> and password file <none>
I20260709 12:27:07.648293  6365 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39630
I20260709 12:27:07.648888 30223 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:07.649138 30223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:07.649477 30223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:07.650784 30223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-2-root/instance:
uuid: "510083e48ed24112abbc856dd2fd7b8c"
format_stamp: "Formatted at 2026-07-09 12:27:07 on dist-test-slave-n640"
I20260709 12:27:07.655675 30223 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:07.658946  6578 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.659829 30223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:07.660261 30223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-2-root
uuid: "510083e48ed24112abbc856dd2fd7b8c"
format_stamp: "Formatted at 2026-07-09 12:27:07 on dist-test-slave-n640"
I20260709 12:27:07.660583 30223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJm9rPQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599722576063-30223-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:07.671836 30223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:07.673018 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:07.674456 30223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:07.676698 30223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:07.676927 30223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.677175 30223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:07.677356 30223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:07.717693 30223 rpc_server.cc:307] RPC server started. Bound to: 127.29.131.195:35135
I20260709 12:27:07.717846  6640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.131.195:35135 every 8 connection(s)
I20260709 12:27:07.732560  6641 heartbeater.cc:344] Connected to a master server at 127.29.131.254:37723
I20260709 12:27:07.733048  6641 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:07.733896  6641 heartbeater.cc:507] Master 127.29.131.254:37723 requested a full tablet report, sending...
I20260709 12:27:07.735935  6365 ts_manager.cc:194] Registered new tserver with Master: 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:07.736800 30223 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015926095s
I20260709 12:27:07.737495  6365 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39640
I20260709 12:27:07.762120  6365 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39650:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:07.765215  6365 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:07.832381  6606 tablet_service.cc:1511] Processing CreateTablet for tablet 73a169e2c10443e48edd3a33ce51cf78 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:07.833899  6606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a169e2c10443e48edd3a33ce51cf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.836520  6605 tablet_service.cc:1511] Processing CreateTablet for tablet aeef2dad4b144c7480d88beec114f37e (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:07.837925  6605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeef2dad4b144c7480d88beec114f37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.840157  6604 tablet_service.cc:1511] Processing CreateTablet for tablet faec8446c0bc4b6e9864452fa653bf7f (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:07.841697  6604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faec8446c0bc4b6e9864452fa653bf7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.841959  6603 tablet_service.cc:1511] Processing CreateTablet for tablet ee427235b57c475c952cc5a95299e9ff (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:07.843359  6603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee427235b57c475c952cc5a95299e9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.852355  6532 tablet_service.cc:1511] Processing CreateTablet for tablet 73a169e2c10443e48edd3a33ce51cf78 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:07.852675  6528 tablet_service.cc:1511] Processing CreateTablet for tablet 6c95cc7f731047ea9cb6080ab8e16a10 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:07.853847  6532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a169e2c10443e48edd3a33ce51cf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.854249  6529 tablet_service.cc:1511] Processing CreateTablet for tablet ee427235b57c475c952cc5a95299e9ff (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:07.855614  6529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee427235b57c475c952cc5a95299e9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.856482  6531 tablet_service.cc:1511] Processing CreateTablet for tablet aeef2dad4b144c7480d88beec114f37e (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:07.857858  6531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeef2dad4b144c7480d88beec114f37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.859714  6528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c95cc7f731047ea9cb6080ab8e16a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.860530  6530 tablet_service.cc:1511] Processing CreateTablet for tablet faec8446c0bc4b6e9864452fa653bf7f (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:07.862592  6530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faec8446c0bc4b6e9864452fa653bf7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.882810  6602 tablet_service.cc:1511] Processing CreateTablet for tablet 6c95cc7f731047ea9cb6080ab8e16a10 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:07.884317  6602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c95cc7f731047ea9cb6080ab8e16a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.886114  6655 tablet_bootstrap.cc:492] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:07.888458  6527 tablet_service.cc:1511] Processing CreateTablet for tablet c8c548eee8a148668dbea3ccd5c48770 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:07.889882  6527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c548eee8a148668dbea3ccd5c48770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.890743  6525 tablet_service.cc:1511] Processing CreateTablet for tablet d1edcb23098848989634fe257f90f2da (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:07.892117  6525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1edcb23098848989634fe257f90f2da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.892410  6457 tablet_service.cc:1511] Processing CreateTablet for tablet 73a169e2c10443e48edd3a33ce51cf78 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:07.893122  6655 tablet_bootstrap.cc:654] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.893744  6457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a169e2c10443e48edd3a33ce51cf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.896487  6456 tablet_service.cc:1511] Processing CreateTablet for tablet aeef2dad4b144c7480d88beec114f37e (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:07.897871  6456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeef2dad4b144c7480d88beec114f37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.900568  6455 tablet_service.cc:1511] Processing CreateTablet for tablet faec8446c0bc4b6e9864452fa653bf7f (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:07.902060  6455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faec8446c0bc4b6e9864452fa653bf7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.901774  6524 tablet_service.cc:1511] Processing CreateTablet for tablet 60b3686687434dbeac488ccfec19892e (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:07.903179  6524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b3686687434dbeac488ccfec19892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.904726  6655 tablet_bootstrap.cc:492] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:07.904415  6454 tablet_service.cc:1511] Processing CreateTablet for tablet ee427235b57c475c952cc5a95299e9ff (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:07.905236  6655 ts_tablet_manager.cc:1403] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:27:07.905769  6454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee427235b57c475c952cc5a95299e9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.908182  6655 raft_consensus.cc:359] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:07.908392  6526 tablet_service.cc:1511] Processing CreateTablet for tablet 72780ab2095944258925f9d2d3225fe0 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:07.908967  6655 raft_consensus.cc:385] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.909345  6655 raft_consensus.cc:740] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.909776  6526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72780ab2095944258925f9d2d3225fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.910120  6655 consensus_queue.cc:260] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:07.915828  6606 tablet_service.cc:1511] Processing CreateTablet for tablet 72780ab2095944258925f9d2d3225fe0 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:07.916250  6601 tablet_service.cc:1511] Processing CreateTablet for tablet d1edcb23098848989634fe257f90f2da (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:07.917249  6606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72780ab2095944258925f9d2d3225fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.919679  6601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1edcb23098848989634fe257f90f2da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.921478  6452 tablet_service.cc:1511] Processing CreateTablet for tablet c8c548eee8a148668dbea3ccd5c48770 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:07.922163  6449 tablet_service.cc:1511] Processing CreateTablet for tablet 60b3686687434dbeac488ccfec19892e (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:07.922928  6452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c548eee8a148668dbea3ccd5c48770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.924422  6450 tablet_service.cc:1511] Processing CreateTablet for tablet d1edcb23098848989634fe257f90f2da (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:07.926751  6451 tablet_service.cc:1511] Processing CreateTablet for tablet 72780ab2095944258925f9d2d3225fe0 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:07.929128  6453 tablet_service.cc:1511] Processing CreateTablet for tablet 6c95cc7f731047ea9cb6080ab8e16a10 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:07.936259  6605 tablet_service.cc:1511] Processing CreateTablet for tablet c8c548eee8a148668dbea3ccd5c48770 (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:07.937736  6605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c548eee8a148668dbea3ccd5c48770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.945165  6600 tablet_service.cc:1511] Processing CreateTablet for tablet 60b3686687434dbeac488ccfec19892e (DEFAULT_TABLE table=test-workload [id=57580042dbd34ce48b6a65de12623b44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:07.946612  6600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b3686687434dbeac488ccfec19892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.994647  6449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b3686687434dbeac488ccfec19892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.996794  6450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1edcb23098848989634fe257f90f2da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.997258  6655 ts_tablet_manager.cc:1434] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.092s	user 0.022s	sys 0.044s
I20260709 12:27:07.997442  6453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c95cc7f731047ea9cb6080ab8e16a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:07.998853  6451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72780ab2095944258925f9d2d3225fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:08.008039  6657 tablet_bootstrap.cc:492] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:08.008955  6641 heartbeater.cc:499] Master 127.29.131.254:37723 was elected leader, sending a full tablet report...
I20260709 12:27:08.016613  6655 tablet_bootstrap.cc:492] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:08.034425  6655 tablet_bootstrap.cc:654] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.038885  6659 tablet_bootstrap.cc:492] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.050743  6657 tablet_bootstrap.cc:654] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.078279  6659 tablet_bootstrap.cc:654] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.081667  6657 tablet_bootstrap.cc:492] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.082221  6657 ts_tablet_manager.cc:1403] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.004s
I20260709 12:27:08.083140  6655 tablet_bootstrap.cc:492] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:08.083709  6655 ts_tablet_manager.cc:1403] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.000s
I20260709 12:27:08.085235  6657 raft_consensus.cc:359] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:08.086047  6657 raft_consensus.cc:385] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.086342  6657 raft_consensus.cc:740] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.086630  6659 tablet_bootstrap.cc:492] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.086406  6655 raft_consensus.cc:359] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.087152  6659 ts_tablet_manager.cc:1403] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.008s
I20260709 12:27:08.087195  6655 raft_consensus.cc:385] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.087888  6655 raft_consensus.cc:740] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.087184  6657 consensus_queue.cc:260] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:08.088613  6655 consensus_queue.cc:260] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.090010  6567 heartbeater.cc:499] Master 127.29.131.254:37723 was elected leader, sending a full tablet report...
I20260709 12:27:08.090585  6657 ts_tablet_manager.cc:1434] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:08.090703  6659 raft_consensus.cc:359] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.091490  6659 raft_consensus.cc:385] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.091781  6657 tablet_bootstrap.cc:492] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:08.091774  6659 raft_consensus.cc:740] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.092844  6659 consensus_queue.cc:260] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.097762  6655 ts_tablet_manager.cc:1434] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:08.100045  6657 tablet_bootstrap.cc:654] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.102514  6655 tablet_bootstrap.cc:492] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:08.110296  6655 tablet_bootstrap.cc:654] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.114288  6492 heartbeater.cc:499] Master 127.29.131.254:37723 was elected leader, sending a full tablet report...
I20260709 12:27:08.115332  6659 ts_tablet_manager.cc:1434] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.018s
I20260709 12:27:08.116757  6659 tablet_bootstrap.cc:492] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.125519  6659 tablet_bootstrap.cc:654] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:08.128970  6568 tablet.cc:2406] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:08.129272  6657 tablet_bootstrap.cc:492] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.130003  6657 ts_tablet_manager.cc:1403] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.012s
I20260709 12:27:08.130631  6655 tablet_bootstrap.cc:492] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:08.131368  6655 ts_tablet_manager.cc:1403] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 12:27:08.133265  6657 raft_consensus.cc:359] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.134110  6657 raft_consensus.cc:385] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.134457  6657 raft_consensus.cc:740] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.135147  6655 raft_consensus.cc:359] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.135313  6657 consensus_queue.cc:260] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.137943  6659 tablet_bootstrap.cc:492] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.138053  6657 ts_tablet_manager.cc:1434] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:08.138584  6659 ts_tablet_manager.cc:1403] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 12:27:08.139362  6657 tablet_bootstrap.cc:492] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:08.136098  6655 raft_consensus.cc:385] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.141937  6655 raft_consensus.cc:740] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.142683  6655 consensus_queue.cc:260] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.145013  6655 ts_tablet_manager.cc:1434] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:27:08.146066  6655 tablet_bootstrap.cc:492] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:08.146541  6657 tablet_bootstrap.cc:654] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.141431  6659 raft_consensus.cc:359] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.147787  6659 raft_consensus.cc:385] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.148181  6659 raft_consensus.cc:740] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.149183  6659 consensus_queue.cc:260] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.151845  6659 ts_tablet_manager.cc:1434] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 12:27:08.152472  6655 tablet_bootstrap.cc:654] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.158622  6659 tablet_bootstrap.cc:492] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.168535  6659 tablet_bootstrap.cc:654] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.182121  6659 tablet_bootstrap.cc:492] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.182659  6659 ts_tablet_manager.cc:1403] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.013s
I20260709 12:27:08.183454  6657 tablet_bootstrap.cc:492] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.183666  6655 tablet_bootstrap.cc:492] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:08.183986  6657 ts_tablet_manager.cc:1403] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.031s
I20260709 12:27:08.184209  6655 ts_tablet_manager.cc:1403] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.020s
I20260709 12:27:08.185678  6659 raft_consensus.cc:359] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.186486  6659 raft_consensus.cc:385] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.186357  6657 raft_consensus.cc:359] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.186898  6659 raft_consensus.cc:740] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.187104  6657 raft_consensus.cc:385] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.187500  6657 raft_consensus.cc:740] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.187292  6655 raft_consensus.cc:359] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.188138  6655 raft_consensus.cc:385] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.187742  6659 consensus_queue.cc:260] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.188446  6655 raft_consensus.cc:740] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.188403  6657 consensus_queue.cc:260] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.189554  6655 consensus_queue.cc:260] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.190821  6657 ts_tablet_manager.cc:1434] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:08.191849  6657 tablet_bootstrap.cc:492] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:08.192884  6659 ts_tablet_manager.cc:1434] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:27:08.193954  6659 tablet_bootstrap.cc:492] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.194253  6658 raft_consensus.cc:493] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.194759  6658 raft_consensus.cc:515] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:08.198601  6657 tablet_bootstrap.cc:654] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.200747  6659 tablet_bootstrap.cc:654] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.203783  6658 leader_election.cc:290] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117)
I20260709 12:27:08.209717  6655 ts_tablet_manager.cc:1434] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 12:27:08.211246  6655 tablet_bootstrap.cc:492] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:08.213320  6664 raft_consensus.cc:493] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.214043  6664 raft_consensus.cc:515] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.224990  6664 leader_election.cc:290] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.233870  6655 tablet_bootstrap.cc:654] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.234531  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a169e2c10443e48edd3a33ce51cf78" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:08.235481  6542 raft_consensus.cc:2468] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:08.243516  6582 leader_election.cc:304] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:08.244779  6658 raft_consensus.cc:2804] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.245246  6658 raft_consensus.cc:493] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.245668  6658 raft_consensus.cc:3060] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.275341  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:08.277947  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
W20260709 12:27:08.278362  6433 leader_election.cc:343] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:08.280112  6433 leader_election.cc:343] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.280714  6433 leader_election.cc:304] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:08.281777  6664 raft_consensus.cc:2749] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:08.295280  6658 raft_consensus.cc:515] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:08.296769  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a169e2c10443e48edd3a33ce51cf78" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
W20260709 12:27:08.302578  6581 leader_election.cc:343] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.300338  6678 raft_consensus.cc:493] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.299052  6655 tablet_bootstrap.cc:492] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:08.304219  6655 ts_tablet_manager.cc:1403] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.012s
I20260709 12:27:08.303704  6678 raft_consensus.cc:515] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.308352  6655 raft_consensus.cc:359] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.309387  6655 raft_consensus.cc:385] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.308599  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:08.309846  6655 raft_consensus.cc:740] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
W20260709 12:27:08.311497  6582 leader_election.cc:343] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.313773  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a169e2c10443e48edd3a33ce51cf78" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:08.314330  6542 raft_consensus.cc:3060] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.314764  6658 leader_election.cc:290] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117)
I20260709 12:27:08.315078  6659 tablet_bootstrap.cc:492] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.315642  6659 ts_tablet_manager.cc:1403] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.122s	user 0.035s	sys 0.066s
I20260709 12:27:08.315614  6655 consensus_queue.cc:260] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.316293  6657 tablet_bootstrap.cc:492] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.316958  6657 ts_tablet_manager.cc:1403] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.125s	user 0.045s	sys 0.064s
I20260709 12:27:08.323160  6655 ts_tablet_manager.cc:1434] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:27:08.324363  6655 tablet_bootstrap.cc:492] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:08.324509  6659 raft_consensus.cc:359] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.325314  6659 raft_consensus.cc:385] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.324996  6657 raft_consensus.cc:359] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.325671  6659 raft_consensus.cc:740] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.326031  6657 raft_consensus.cc:385] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.326436  6657 raft_consensus.cc:740] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.326617  6659 consensus_queue.cc:260] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.327353  6657 consensus_queue.cc:260] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.331465  6655 tablet_bootstrap.cc:654] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.331761  6659 ts_tablet_manager.cc:1434] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:27:08.331807  6657 ts_tablet_manager.cc:1434] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:27:08.333006  6659 tablet_bootstrap.cc:492] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.333149  6657 tablet_bootstrap.cc:492] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:08.340639  6657 tablet_bootstrap.cc:654] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.346868  6663 raft_consensus.cc:493] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.349131  6663 raft_consensus.cc:515] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.353303  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.354221  6467 raft_consensus.cc:2468] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
W20260709 12:27:08.355697  6413 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:08.356499  6657 tablet_bootstrap.cc:492] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.356485  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a169e2c10443e48edd3a33ce51cf78" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:08.357287  6657 ts_tablet_manager.cc:1403] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
I20260709 12:27:08.358099  6658 raft_consensus.cc:493] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.358294  6581 leader_election.cc:304] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:08.358706  6658 raft_consensus.cc:515] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.359548  6678 leader_election.cc:290] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.360157  6678 raft_consensus.cc:2804] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.360495  6678 raft_consensus.cc:493] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.361125  6658 leader_election.cc:290] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.360884  6657 raft_consensus.cc:359] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.361829  6657 raft_consensus.cc:385] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.362192  6657 raft_consensus.cc:740] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.362926  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:08.363144  6657 consensus_queue.cc:260] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.363720  6542 raft_consensus.cc:2468] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:08.363965  6541 raft_consensus.cc:2468] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:08.365209  6582 leader_election.cc:304] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:08.366117  6658 raft_consensus.cc:2804] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.366717  6658 raft_consensus.cc:697] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:08.367822  6658 consensus_queue.cc:237] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:08.371762  6582 leader_election.cc:304] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:08.360828  6678 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.372851  6663 leader_election.cc:290] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.376892  6657 ts_tablet_manager.cc:1434] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.002s
I20260709 12:27:08.378357  6657 tablet_bootstrap.cc:492] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
W20260709 12:27:08.395768  6581 leader_election.cc:343] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.398075  6659 tablet_bootstrap.cc:654] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.398752  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.399608  6681 raft_consensus.cc:2804] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.400180  6681 raft_consensus.cc:493] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:08.401165  6581 leader_election.cc:343] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.401953  6681 raft_consensus.cc:3060] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.409924  6657 tablet_bootstrap.cc:654] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.417675  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c548eee8a148668dbea3ccd5c48770" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
W20260709 12:27:08.419574  6508 leader_election.cc:343] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.418426  6362 catalog_manager.cc:5697] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 1 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.424186  6678 raft_consensus.cc:515] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.428974  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:08.429867  6467 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.421589  6681 raft_consensus.cc:515] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.438781  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
W20260709 12:27:08.440773  6581 leader_election.cc:343] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.443257  6678 leader_election.cc:290] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.443475  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
W20260709 12:27:08.444905  6582 leader_election.cc:343] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.445309  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:08.445946  6542 raft_consensus.cc:3060] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.449952  6467 raft_consensus.cc:2468] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:08.450309  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c548eee8a148668dbea3ccd5c48770" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.445462  6681 leader_election.cc:290] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.451218  6581 leader_election.cc:304] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:08.424187  6655 tablet_bootstrap.cc:492] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:08.451279  6466 raft_consensus.cc:2468] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:08.452512  6655 ts_tablet_manager.cc:1403] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.128s	user 0.023s	sys 0.043s
I20260709 12:27:08.453316  6681 raft_consensus.cc:2804] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.453678  6507 leader_election.cc:304] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:08.454509  6542 raft_consensus.cc:2468] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:08.453868  6681 raft_consensus.cc:697] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:08.455127  6682 raft_consensus.cc:2804] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.455686  6682 raft_consensus.cc:493] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.456046  6682 raft_consensus.cc:3060] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.456071  6681 consensus_queue.cc:237] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.458070  6655 raft_consensus.cc:359] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.459422  6655 raft_consensus.cc:385] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.459659  6582 leader_election.cc:304] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:08.460714  6655 raft_consensus.cc:740] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.461911  6658 raft_consensus.cc:2804] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.462756  6658 raft_consensus.cc:697] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:08.464834  6658 consensus_queue.cc:237] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.462091  6655 consensus_queue.cc:260] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.470721  6657 tablet_bootstrap.cc:492] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.471422  6657 ts_tablet_manager.cc:1403] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.011s
I20260709 12:27:08.472198  6655 ts_tablet_manager.cc:1434] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:27:08.473640  6655 tablet_bootstrap.cc:492] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:08.475391  6657 raft_consensus.cc:359] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.476402  6657 raft_consensus.cc:385] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.476805  6657 raft_consensus.cc:740] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.478000  6657 consensus_queue.cc:260] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.479600  6678 raft_consensus.cc:493] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.480165  6678 raft_consensus.cc:515] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.480954  6657 ts_tablet_manager.cc:1434] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:27:08.482090  6657 tablet_bootstrap.cc:492] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:08.478077  6682 raft_consensus.cc:515] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.486146  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.486985  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c548eee8a148668dbea3ccd5c48770" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
W20260709 12:27:08.487879  6581 leader_election.cc:343] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.487960  6465 raft_consensus.cc:3060] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.494179  6678 leader_election.cc:290] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.494884  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
W20260709 12:27:08.496429  6582 leader_election.cc:343] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.496891  6582 leader_election.cc:304] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:08.498513  6682 leader_election.cc:290] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.499599  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c548eee8a148668dbea3ccd5c48770" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
W20260709 12:27:08.501272  6508 leader_election.cc:343] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:08.501931  6678 raft_consensus.cc:2749] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:08.502758  6678 raft_consensus.cc:493] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.504165  6657 tablet_bootstrap.cc:654] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.505034  6659 tablet_bootstrap.cc:492] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.505577  6659 ts_tablet_manager.cc:1403] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.173s	user 0.033s	sys 0.017s
I20260709 12:27:08.508796  6659 raft_consensus.cc:359] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.509655  6659 raft_consensus.cc:385] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.509975  6659 raft_consensus.cc:740] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.512338  6678 raft_consensus.cc:515] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.512823  6465 raft_consensus.cc:2468] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 1.
I20260709 12:27:08.514619  6657 tablet_bootstrap.cc:492] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.514904  6678 leader_election.cc:290] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.515357  6657 ts_tablet_manager.cc:1403] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 12:27:08.515779  6659 consensus_queue.cc:260] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.516374  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1edcb23098848989634fe257f90f2da" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:08.514627  6507 leader_election.cc:304] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:08.519536  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1edcb23098848989634fe257f90f2da" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.519505  6657 raft_consensus.cc:359] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.520319  6657 raft_consensus.cc:385] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.520325  6465 raft_consensus.cc:2468] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:08.499619  6655 tablet_bootstrap.cc:654] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.520848  6657 raft_consensus.cc:740] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.521513  6659 ts_tablet_manager.cc:1434] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:27:08.521598  6581 leader_election.cc:304] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:08.523900  6678 raft_consensus.cc:2804] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.524163  6659 tablet_bootstrap.cc:492] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.524268  6678 raft_consensus.cc:493] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.524711  6678 raft_consensus.cc:3060] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.525650  6664 raft_consensus.cc:493] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.526320  6664 raft_consensus.cc:515] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.536635  6664 leader_election.cc:290] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.537251  6682 raft_consensus.cc:493] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.537679  6682 raft_consensus.cc:515] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.539527  6682 leader_election.cc:290] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.530957  6659 tablet_bootstrap.cc:654] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.540701  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee427235b57c475c952cc5a95299e9ff" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:08.541411  6616 raft_consensus.cc:2468] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:08.541878  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee427235b57c475c952cc5a95299e9ff" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:08.521904  6657 consensus_queue.cc:260] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.542773  6508 leader_election.cc:304] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:08.542833  6541 raft_consensus.cc:2468] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 0.
I20260709 12:27:08.544283  6542 raft_consensus.cc:2468] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:08.544698  6657 ts_tablet_manager.cc:1434] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:27:08.545557  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee427235b57c475c952cc5a95299e9ff" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.546255  6465 raft_consensus.cc:2468] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:08.546423  6682 raft_consensus.cc:2804] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.533591  6663 raft_consensus.cc:2804] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.546855  6682 raft_consensus.cc:493] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.547260  6663 raft_consensus.cc:697] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:08.547320  6682 raft_consensus.cc:3060] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.548391  6663 consensus_queue.cc:237] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.532087  6678 raft_consensus.cc:515] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.553042  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee427235b57c475c952cc5a95299e9ff" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:08.553995  6616 raft_consensus.cc:2468] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 0.
I20260709 12:27:08.555907  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1edcb23098848989634fe257f90f2da" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:08.556036  6682 raft_consensus.cc:515] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.556586  6465 raft_consensus.cc:3060] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.556439  6433 leader_election.cc:304] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:08.557663  6664 raft_consensus.cc:2804] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.558048  6664 raft_consensus.cc:493] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.558385  6664 raft_consensus.cc:3060] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.561741  6362 catalog_manager.cc:5697] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 1 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.564039  6362 catalog_manager.cc:5697] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 1 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.566010  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1edcb23098848989634fe257f90f2da" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:08.566265  6664 raft_consensus.cc:515] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.566660  6542 raft_consensus.cc:3060] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.568920  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee427235b57c475c952cc5a95299e9ff" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:08.569693  6541 raft_consensus.cc:2393] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 76b6c969c7684e3e9d66965782eba827 in current term 1: Already voted for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in this term.
I20260709 12:27:08.545790  6657 tablet_bootstrap.cc:492] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:08.572474  6664 leader_election.cc:290] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.572638  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee427235b57c475c952cc5a95299e9ff" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:08.573328  6616 raft_consensus.cc:3060] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.574086  6542 raft_consensus.cc:2468] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:08.575281  6582 leader_election.cc:304] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:08.576128  6681 raft_consensus.cc:2804] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.576728  6681 raft_consensus.cc:697] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:08.577741  6681 consensus_queue.cc:237] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.578922  6655 tablet_bootstrap.cc:492] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:08.579480  6655 ts_tablet_manager.cc:1403] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.024s
I20260709 12:27:08.582932  6655 raft_consensus.cc:359] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.583918  6655 raft_consensus.cc:385] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.584242  6655 raft_consensus.cc:740] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.585026  6655 consensus_queue.cc:260] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.585776  6657 tablet_bootstrap.cc:654] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.586387  6678 leader_election.cc:290] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.588034  6655 ts_tablet_manager.cc:1434] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:08.588728  6465 raft_consensus.cc:2468] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:08.589918  6682 leader_election.cc:290] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.590782  6655 tablet_bootstrap.cc:492] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:08.591822  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee427235b57c475c952cc5a95299e9ff" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:08.597359  6659 tablet_bootstrap.cc:492] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.597980  6659 ts_tablet_manager.cc:1403] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.004s
I20260709 12:27:08.598284  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee427235b57c475c952cc5a95299e9ff" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:08.599133  6465 raft_consensus.cc:2393] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 19db5d1e1f444c508c3ec347c2a5f6fa in current term 1: Already voted for candidate 76b6c969c7684e3e9d66965782eba827 in this term.
I20260709 12:27:08.599295  6655 tablet_bootstrap.cc:654] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.600292  6507 leader_election.cc:304] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa; no voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:08.601496  6663 raft_consensus.cc:2749] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:08.601505  6363 catalog_manager.cc:5697] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 1 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.587132  6616 raft_consensus.cc:2468] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 1.
I20260709 12:27:08.607954  6433 leader_election.cc:304] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:08.608889  6664 raft_consensus.cc:2804] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.616046  6664 raft_consensus.cc:697] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:08.616997  6664 consensus_queue.cc:237] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.626888  6362 catalog_manager.cc:5697] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 1 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.631107  6655 tablet_bootstrap.cc:492] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:08.631706  6655 ts_tablet_manager.cc:1403] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.014s
I20260709 12:27:08.633394  6363 catalog_manager.cc:5697] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.634357  6655 raft_consensus.cc:359] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.635073  6655 raft_consensus.cc:385] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.634706  6659 raft_consensus.cc:359] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.635377  6655 raft_consensus.cc:740] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.635488  6659 raft_consensus.cc:385] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.635782  6659 raft_consensus.cc:740] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.636106  6655 consensus_queue.cc:260] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.640527  6659 consensus_queue.cc:260] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.639305  6657 tablet_bootstrap.cc:492] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.642184  6657 ts_tablet_manager.cc:1403] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.000s
I20260709 12:27:08.643064  6655 ts_tablet_manager.cc:1434] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 12:27:08.644148  6655 tablet_bootstrap.cc:492] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:08.644924  6657 raft_consensus.cc:359] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.645648  6657 raft_consensus.cc:385] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.645908  6657 raft_consensus.cc:740] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.648296  6659 ts_tablet_manager.cc:1434] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.004s
I20260709 12:27:08.649480  6659 tablet_bootstrap.cc:492] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.650353  6655 tablet_bootstrap.cc:654] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.656653  6657 consensus_queue.cc:260] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.658289  6655 tablet_bootstrap.cc:492] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:08.658813  6655 ts_tablet_manager.cc:1403] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 12:27:08.661545  6655 raft_consensus.cc:359] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.662207  6655 raft_consensus.cc:385] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.662586  6655 raft_consensus.cc:740] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.663486  6655 consensus_queue.cc:260] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.664830  6657 ts_tablet_manager.cc:1434] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:27:08.665037  6659 tablet_bootstrap.cc:654] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.665977  6655 ts_tablet_manager.cc:1434] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:27:08.669498  6657 tablet_bootstrap.cc:492] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:08.671036  6663 raft_consensus.cc:493] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.671586  6663 raft_consensus.cc:515] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.674336  6663 leader_election.cc:290] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.674718  6657 tablet_bootstrap.cc:654] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.675048  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.675915  6465 raft_consensus.cc:2393] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19db5d1e1f444c508c3ec347c2a5f6fa in current term 1: Already voted for candidate 510083e48ed24112abbc856dd2fd7b8c in this term.
I20260709 12:27:08.677657  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:08.678936  6508 leader_election.cc:304] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa; no voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:08.679739  6659 tablet_bootstrap.cc:492] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.680112  6663 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.680632  6659 ts_tablet_manager.cc:1403] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.003s
I20260709 12:27:08.684759  6657 tablet_bootstrap.cc:492] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:08.684614  6659 raft_consensus.cc:359] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.685298  6657 ts_tablet_manager.cc:1403] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:27:08.685326  6659 raft_consensus.cc:385] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.685540  6682 raft_consensus.cc:493] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.685938  6659 raft_consensus.cc:740] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.686266  6682 raft_consensus.cc:515] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.686784  6659 consensus_queue.cc:260] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.689214  6659 ts_tablet_manager.cc:1434] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:27:08.689795  6663 raft_consensus.cc:2749] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:08.690218  6659 tablet_bootstrap.cc:492] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.690022  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b3686687434dbeac488ccfec19892e" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:08.691167  6616 raft_consensus.cc:2468] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:08.691345  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b3686687434dbeac488ccfec19892e" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.692047  6465 raft_consensus.cc:2468] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:08.691917  6657 raft_consensus.cc:359] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.692684  6657 raft_consensus.cc:385] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.692961  6657 raft_consensus.cc:740] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.693677  6657 consensus_queue.cc:260] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.694769  6508 leader_election.cc:304] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:08.695820  6657 ts_tablet_manager.cc:1434] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:27:08.696491  6697 raft_consensus.cc:2804] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.696895  6697 raft_consensus.cc:493] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.697216  6697 raft_consensus.cc:3060] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.697320  6659 tablet_bootstrap.cc:654] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.699877  6682 leader_election.cc:290] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.709646  6659 tablet_bootstrap.cc:492] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.709311  6697 raft_consensus.cc:515] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.710171  6659 ts_tablet_manager.cc:1403] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:27:08.711535  6697 leader_election.cc:290] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.712224  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b3686687434dbeac488ccfec19892e" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:08.712863  6465 raft_consensus.cc:3060] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.712997  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b3686687434dbeac488ccfec19892e" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:08.712986  6659 raft_consensus.cc:359] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.713804  6616 raft_consensus.cc:3060] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.713891  6659 raft_consensus.cc:385] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.714264  6659 raft_consensus.cc:740] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.714977  6659 consensus_queue.cc:260] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.716989  6659 ts_tablet_manager.cc:1434] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:08.717131  6681 raft_consensus.cc:493] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.717635  6681 raft_consensus.cc:515] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.718187  6659 tablet_bootstrap.cc:492] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:08.719837  6681 leader_election.cc:290] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.720523  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:08.721263  6466 raft_consensus.cc:2468] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:08.722872  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:08.723551  6542 raft_consensus.cc:2468] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:08.724113  6465 raft_consensus.cc:2468] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 1.
I20260709 12:27:08.724501  6659 tablet_bootstrap.cc:654] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:08.725100  6581 leader_election.cc:304] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:08.725226  6507 leader_election.cc:304] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:08.726650  6681 raft_consensus.cc:2804] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.727095  6681 raft_consensus.cc:493] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.727520  6681 raft_consensus.cc:3060] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.729305  6659 tablet_bootstrap.cc:492] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:08.729864  6659 ts_tablet_manager.cc:1403] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:27:08.732735  6616 raft_consensus.cc:2468] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 1.
I20260709 12:27:08.732470  6659 raft_consensus.cc:359] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:08.733341  6659 raft_consensus.cc:385] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:08.733398  6697 raft_consensus.cc:2804] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.734107  6697 raft_consensus.cc:697] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:08.734858  6697 consensus_queue.cc:237] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.735250  6681 raft_consensus.cc:515] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.733697  6659 raft_consensus.cc:740] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:08.738593  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:08.738278  6659 consensus_queue.cc:260] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:08.739259  6542 raft_consensus.cc:3060] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.740819  6659 ts_tablet_manager.cc:1434] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:08.738229  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:08.741359  6465 raft_consensus.cc:3060] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.748459  6465 raft_consensus.cc:2468] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:08.749243  6542 raft_consensus.cc:2468] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:08.749714  6581 leader_election.cc:304] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:08.750605  6678 raft_consensus.cc:2804] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.751068  6678 raft_consensus.cc:697] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:08.752111  6681 leader_election.cc:290] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:08.752036  6678 consensus_queue.cc:237] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.760454  6364 catalog_manager.cc:5697] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 1 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.761152  6362 catalog_manager.cc:5697] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 1 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.765413  6465 raft_consensus.cc:3060] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.774204  6678 consensus_queue.cc:1048] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:08.785943  6681 consensus_queue.cc:1048] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:08.911504  6681 consensus_queue.cc:1048] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:08.923393  6681 consensus_queue.cc:1048] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:08.942848  6664 raft_consensus.cc:493] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.943406  6664 raft_consensus.cc:515] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.945137  6664 leader_election.cc:290] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.945971  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:08.946125  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:08.946648  6542 raft_consensus.cc:2468] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 0.
I20260709 12:27:08.946833  6616 raft_consensus.cc:2468] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 0.
I20260709 12:27:08.947865  6433 leader_election.cc:304] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:08.948638  6664 raft_consensus.cc:2804] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:08.948956  6664 raft_consensus.cc:493] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.949229  6664 raft_consensus.cc:3060] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.954293  6664 raft_consensus.cc:515] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.955994  6664 leader_election.cc:290] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:08.956777  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:08.957351  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:08.957376  6542 raft_consensus.cc:3060] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.957926  6616 raft_consensus.cc:3060] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:08.961635  6681 consensus_queue.cc:1048] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:08.964433  6616 raft_consensus.cc:2468] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 1.
I20260709 12:27:08.964265  6542 raft_consensus.cc:2468] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 1.
I20260709 12:27:08.965682  6433 leader_election.cc:304] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:08.966523  6664 raft_consensus.cc:2804] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:08.967072  6664 raft_consensus.cc:697] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:08.967933  6664 consensus_queue.cc:237] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:08.974844  6685 consensus_queue.cc:1048] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:08.984699  6364 catalog_manager.cc:5697] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.040148  6664 raft_consensus.cc:493] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.040727  6664 raft_consensus.cc:515] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.042500  6664 leader_election.cc:290] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:09.043532  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:09.043841  6616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:09.044246  6541 raft_consensus.cc:2393] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76b6c969c7684e3e9d66965782eba827 in current term 1: Already voted for candidate 510083e48ed24112abbc856dd2fd7b8c in this term.
I20260709 12:27:09.045403  6433 leader_election.cc:304] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:09.046036  6664 raft_consensus.cc:3060] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:09.050901  6664 raft_consensus.cc:2749] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:09.056008  6658 consensus_queue.cc:1048] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:09.065274  6616 raft_consensus.cc:3060] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:09.067447  6681 consensus_queue.cc:1048] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:09.074400  6697 consensus_queue.cc:1048] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:09.089255  6697 consensus_queue.cc:1048] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:09.105939  6616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73a169e2c10443e48edd3a33ce51cf78"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
mode: GRACEFUL
new_leader_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:27:09.106544  6616 raft_consensus.cc:606] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Received request to transfer leadership to TS 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:09.111785  6616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
mode: GRACEFUL
new_leader_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:27:09.112277  6616 raft_consensus.cc:606] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Received request to transfer leadership to TS 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:09.117040  6616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
mode: GRACEFUL
new_leader_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:27:09.117520  6616 raft_consensus.cc:606] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Received request to transfer leadership to TS 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:09.124541  6616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
mode: GRACEFUL
new_leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:27:09.125020  6616 raft_consensus.cc:606] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Received request to transfer leadership to TS 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:09.135841  6664 consensus_queue.cc:1048] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:09.142335  6465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0"
dest_uuid: "76b6c969c7684e3e9d66965782eba827"
mode: GRACEFUL
new_leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:38704
I20260709 12:27:09.142936  6465 raft_consensus.cc:606] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Received request to transfer leadership to TS 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:09.149053  6700 consensus_queue.cc:1048] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:09.151623  6616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1edcb23098848989634fe257f90f2da"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
mode: GRACEFUL
new_leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:27:09.152335  6616 raft_consensus.cc:606] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Received request to transfer leadership to TS 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:09.171363  6541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60b3686687434dbeac488ccfec19892e"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
mode: GRACEFUL
new_leader_uuid: "510083e48ed24112abbc856dd2fd7b8c"
 from {username='slave'} at 127.0.0.1:54232
I20260709 12:27:09.171896  6541 raft_consensus.cc:606] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Received request to transfer leadership to TS 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:09.172708  6658 consensus_queue.cc:1048] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:09.182739  6678 consensus_queue.cc:1048] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:09.191578  6697 consensus_queue.cc:1048] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:09.192690  6678 raft_consensus.cc:993] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c: : Instructing follower 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:09.193289  6681 raft_consensus.cc:1081] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Signalling peer 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:09.194852  6541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:54216
I20260709 12:27:09.195477  6541 raft_consensus.cc:493] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.195824  6541 raft_consensus.cc:3060] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.199702  6663 raft_consensus.cc:993] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa: : Instructing follower 510083e48ed24112abbc856dd2fd7b8c to start an election
I20260709 12:27:09.200206  6663 raft_consensus.cc:1081] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Signalling peer 510083e48ed24112abbc856dd2fd7b8c to start an election
I20260709 12:27:09.202150  6615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60b3686687434dbeac488ccfec19892e"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
 from {username='slave'} at 127.0.0.1:34934
I20260709 12:27:09.202695  6615 raft_consensus.cc:493] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.203083  6615 raft_consensus.cc:3060] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.203608  6541 raft_consensus.cc:515] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.206000  6541 leader_election.cc:290] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:09.207056  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:09.207726  6465 raft_consensus.cc:3060] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.208635  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c95cc7f731047ea9cb6080ab8e16a10" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:09.209324  6614 raft_consensus.cc:3055] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.209618  6614 raft_consensus.cc:740] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:09.209669  6663 consensus_queue.cc:1048] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:09.210489  6614 consensus_queue.cc:260] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.210628  6615 raft_consensus.cc:515] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.211884  6614 raft_consensus.cc:3060] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.212237  6616 raft_consensus.cc:1240] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Rejecting Update request from peer 19db5d1e1f444c508c3ec347c2a5f6fa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:09.215583  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b3686687434dbeac488ccfec19892e" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:09.216262  6663 consensus_queue.cc:1059] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:09.218641  6615 leader_election.cc:290] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:09.219645  6663 raft_consensus.cc:3055] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.220033  6663 raft_consensus.cc:740] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:09.220238  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b3686687434dbeac488ccfec19892e" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:09.220873  6614 raft_consensus.cc:2468] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:09.220903  6663 consensus_queue.cc:260] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.222155  6508 leader_election.cc:304] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:09.222406  6465 raft_consensus.cc:2468] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:09.222807  6663 raft_consensus.cc:3060] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.223979  6697 raft_consensus.cc:2804] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.224509  6697 raft_consensus.cc:697] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:09.225337  6697 consensus_queue.cc:237] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.238965  6541 raft_consensus.cc:2468] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 2.
I20260709 12:27:09.241058  6582 leader_election.cc:304] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:09.241950  6681 raft_consensus.cc:2804] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.241233  6362 catalog_manager.cc:5697] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 1 to 2, leader changed from 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195) to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 2 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.242444  6681 raft_consensus.cc:697] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 2 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:09.243355  6681 consensus_queue.cc:237] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.250998  6364 catalog_manager.cc:5697] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 1 to 2, leader changed from 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194) to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 2 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:09.347106  6658 raft_consensus.cc:993] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c: : Instructing follower 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:09.347656  6681 raft_consensus.cc:1081] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Signalling peer 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:09.349023  6466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73a169e2c10443e48edd3a33ce51cf78"
dest_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:38684
I20260709 12:27:09.349532  6466 raft_consensus.cc:493] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.349828  6466 raft_consensus.cc:3060] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.355216  6466 raft_consensus.cc:515] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:09.357290  6466 leader_election.cc:290] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Requested vote from peers 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:09.358361  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a169e2c10443e48edd3a33ce51cf78" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:09.358950  6614 raft_consensus.cc:3055] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.359280  6614 raft_consensus.cc:740] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:09.360143  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a169e2c10443e48edd3a33ce51cf78" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:09.360082  6614 consensus_queue.cc:260] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:09.360618  6658 raft_consensus.cc:993] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c: : Instructing follower 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:09.360792  6541 raft_consensus.cc:3060] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.361169  6658 raft_consensus.cc:1081] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Signalling peer 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:09.361439  6614 raft_consensus.cc:3060] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.363191  6465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f"
dest_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:38684
I20260709 12:27:09.363941  6465 raft_consensus.cc:493] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.364313  6465 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.368448  6541 raft_consensus.cc:2468] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:09.368553  6614 raft_consensus.cc:2468] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:09.369922  6433 leader_election.cc:304] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:09.370765  6700 raft_consensus.cc:2804] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.371289  6700 raft_consensus.cc:697] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:09.372107  6700 consensus_queue.cc:237] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } }
I20260709 12:27:09.372517  6465 raft_consensus.cc:515] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.374716  6465 leader_election.cc:290] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:09.376242  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:09.376324  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:09.377013  6614 raft_consensus.cc:3055] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.377063  6541 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.377533  6614 raft_consensus.cc:740] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:09.378419  6614 consensus_queue.cc:260] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.378860  6364 catalog_manager.cc:5697] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 1 to 2, leader changed from 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195) to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:09.379730  6614 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.384516  6541 raft_consensus.cc:2468] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:09.386898  6614 raft_consensus.cc:2468] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:09.387090  6433 leader_election.cc:304] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:09.387945  6700 raft_consensus.cc:2804] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.388427  6700 raft_consensus.cc:697] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:09.389093  6700 consensus_queue.cc:237] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.395324  6364 catalog_manager.cc:5697] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 1 to 2, leader changed from 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195) to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.484833  6658 raft_consensus.cc:993] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c: : Instructing follower 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:09.485355  6681 raft_consensus.cc:1081] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Signalling peer 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:09.486953  6465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e"
dest_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:38684
I20260709 12:27:09.487449  6465 raft_consensus.cc:493] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.487735  6465 raft_consensus.cc:3060] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.492818  6465 raft_consensus.cc:515] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.494760  6465 leader_election.cc:290] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:09.495708  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:09.496243  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeef2dad4b144c7480d88beec114f37e" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:09.496510  6541 raft_consensus.cc:3060] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.496968  6614 raft_consensus.cc:3055] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.497370  6614 raft_consensus.cc:740] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:09.498379  6614 consensus_queue.cc:260] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.499855  6614 raft_consensus.cc:3060] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.501225  6700 consensus_queue.cc:1048] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:09.504927  6541 raft_consensus.cc:2468] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:09.506738  6433 leader_election.cc:304] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:09.507696  6700 raft_consensus.cc:2804] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.508255  6700 raft_consensus.cc:697] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:09.508286  6614 raft_consensus.cc:2468] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:09.509323  6700 consensus_queue.cc:237] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.519629  6664 consensus_queue.cc:1048] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:09.524099  6362 catalog_manager.cc:5697] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 1 to 2, leader changed from 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195) to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.528155  6700 raft_consensus.cc:993] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827: : Instructing follower 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:09.528674  6664 raft_consensus.cc:1081] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Signalling peer 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:09.530107  6541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:54228
I20260709 12:27:09.530658  6541 raft_consensus.cc:493] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.531032  6541 raft_consensus.cc:3060] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.537173  6541 raft_consensus.cc:515] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.539255  6541 leader_election.cc:290] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:09.540102  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:09.540730  6465 raft_consensus.cc:3055] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.541045  6465 raft_consensus.cc:740] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:09.540768  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72780ab2095944258925f9d2d3225fe0" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:09.541641  6615 raft_consensus.cc:3060] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.541846  6465 consensus_queue.cc:260] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.543054  6465 raft_consensus.cc:3060] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.549731  6615 raft_consensus.cc:2468] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:09.549996  6465 raft_consensus.cc:2468] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:09.551046  6508 leader_election.cc:304] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:09.551888  6663 raft_consensus.cc:2804] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.552315  6663 raft_consensus.cc:697] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:09.553128  6663 consensus_queue.cc:237] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.559051  6362 catalog_manager.cc:5697] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 1 to 2, leader changed from 76b6c969c7684e3e9d66965782eba827 (127.29.131.193) to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 2 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.593274  6658 raft_consensus.cc:993] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c: : Instructing follower 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:09.593730  6681 raft_consensus.cc:1081] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Signalling peer 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:09.595086  6541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1edcb23098848989634fe257f90f2da"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:54216
I20260709 12:27:09.595640  6541 raft_consensus.cc:493] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.595952  6541 raft_consensus.cc:3060] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.601711  6541 raft_consensus.cc:515] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.603886  6541 leader_election.cc:290] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:09.604763  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1edcb23098848989634fe257f90f2da" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:09.605460  6465 raft_consensus.cc:3060] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.607321  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1edcb23098848989634fe257f90f2da" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:09.607996  6615 raft_consensus.cc:3055] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.608283  6615 raft_consensus.cc:740] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:09.609014  6615 consensus_queue.cc:260] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.610001  6615 raft_consensus.cc:3060] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.611629  6465 raft_consensus.cc:2468] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:09.612762  6507 leader_election.cc:304] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:09.613487  6663 raft_consensus.cc:2804] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.613996  6663 raft_consensus.cc:697] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:09.614850  6663 consensus_queue.cc:237] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:09.616051  6615 raft_consensus.cc:2468] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:09.622248  6465 raft_consensus.cc:3060] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.622006  6362 catalog_manager.cc:5697] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 1 to 2, leader changed from 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195) to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 2 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.628685  6465 raft_consensus.cc:1275] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 510083e48ed24112abbc856dd2fd7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.630126  6681 consensus_queue.cc:1048] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.638001  6541 raft_consensus.cc:1275] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Refusing update from remote peer 510083e48ed24112abbc856dd2fd7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.639561  6678 consensus_queue.cc:1048] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.788484  6541 raft_consensus.cc:1275] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.789742  6664 consensus_queue.cc:1048] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.797003  6615 raft_consensus.cc:1275] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.799849  6700 consensus_queue.cc:1048] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.819067  6615 raft_consensus.cc:1275] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.820473  6663 consensus_queue.cc:1048] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.827884  6465 raft_consensus.cc:1275] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.829392  6697 consensus_queue.cc:1048] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.964879  6541 raft_consensus.cc:1275] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.966213  6700 consensus_queue.cc:1048] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.975396  6615 raft_consensus.cc:1275] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.979298  6615 raft_consensus.cc:1275] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.980242  6742 consensus_queue.cc:1048] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.981912  6541 raft_consensus.cc:1275] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.983662  6742 consensus_queue.cc:1048] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.984355  6738 consensus_queue.cc:1048] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.007381  6614 raft_consensus.cc:1275] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.008965  6697 consensus_queue.cc:1048] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.014950  6465 raft_consensus.cc:1275] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.016238  6697 consensus_queue.cc:1048] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.024981  6615 raft_consensus.cc:1275] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.030153  6697 consensus_queue.cc:1048] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.038151  6465 raft_consensus.cc:1275] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.039665  6682 consensus_queue.cc:1048] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:12.209025  6362 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39662:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:12.211951  6362 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:12.267360  6457 tablet_service.cc:1511] Processing CreateTablet for tablet 23e1bc6b09fb45e186d3b564f8bc0fa3 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:12.268349  6526 tablet_service.cc:1511] Processing CreateTablet for tablet 23e1bc6b09fb45e186d3b564f8bc0fa3 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:12.269450  6457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e1bc6b09fb45e186d3b564f8bc0fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.270310  6526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e1bc6b09fb45e186d3b564f8bc0fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.270447  6605 tablet_service.cc:1511] Processing CreateTablet for tablet 23e1bc6b09fb45e186d3b564f8bc0fa3 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:12.272181  6605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e1bc6b09fb45e186d3b564f8bc0fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.276993  6456 tablet_service.cc:1511] Processing CreateTablet for tablet 6135ffcb6abd47d7a5c6c1022abc4d33 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:12.278419  6530 tablet_service.cc:1511] Processing CreateTablet for tablet 6135ffcb6abd47d7a5c6c1022abc4d33 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:12.279822  6530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6135ffcb6abd47d7a5c6c1022abc4d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.280318  6449 tablet_service.cc:1511] Processing CreateTablet for tablet bd32f484f5b041d29f774e4efcefeda1 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:12.280702  6451 tablet_service.cc:1511] Processing CreateTablet for tablet dca3415672474d868e6cf1a4046f9e1f (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:12.284574  6525 tablet_service.cc:1511] Processing CreateTablet for tablet dca3415672474d868e6cf1a4046f9e1f (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:12.286119  6525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca3415672474d868e6cf1a4046f9e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.288884  6454 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea1cd786ab14a438d7b0c5c05402ae7 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:12.291456  6524 tablet_service.cc:1511] Processing CreateTablet for tablet bd32f484f5b041d29f774e4efcefeda1 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:12.292924  6524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd32f484f5b041d29f774e4efcefeda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.295993  6452 tablet_service.cc:1511] Processing CreateTablet for tablet 452483d8575148d8a4a44087afda65ba (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:12.296512  6528 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea1cd786ab14a438d7b0c5c05402ae7 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:12.297910  6528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea1cd786ab14a438d7b0c5c05402ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.299661  6450 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2089da4bf94582b0c521e3a7479853 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:12.301455  6600 tablet_service.cc:1511] Processing CreateTablet for tablet dca3415672474d868e6cf1a4046f9e1f (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:12.302103  6603 tablet_service.cc:1511] Processing CreateTablet for tablet bd32f484f5b041d29f774e4efcefeda1 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:12.302340  6602 tablet_service.cc:1511] Processing CreateTablet for tablet 6135ffcb6abd47d7a5c6c1022abc4d33 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:12.302870  6600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca3415672474d868e6cf1a4046f9e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.303983  6602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6135ffcb6abd47d7a5c6c1022abc4d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.305657  6455 tablet_service.cc:1511] Processing CreateTablet for tablet 5d85eb8399f5499da2447bf576c5f2e3 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:12.307399  6603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd32f484f5b041d29f774e4efcefeda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.308605  6601 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea1cd786ab14a438d7b0c5c05402ae7 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:12.310052  6601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea1cd786ab14a438d7b0c5c05402ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.278468  6456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6135ffcb6abd47d7a5c6c1022abc4d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.313469  6453 tablet_service.cc:1511] Processing CreateTablet for tablet 0feb8917d07c43b9840447cdb98c31d4 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:12.314839  6453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feb8917d07c43b9840447cdb98c31d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.315653  6451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca3415672474d868e6cf1a4046f9e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.316540  6455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d85eb8399f5499da2447bf576c5f2e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.318125  6449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd32f484f5b041d29f774e4efcefeda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.319062  6454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea1cd786ab14a438d7b0c5c05402ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.321092  6450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2089da4bf94582b0c521e3a7479853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.322686  6452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452483d8575148d8a4a44087afda65ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.328514  6604 tablet_service.cc:1511] Processing CreateTablet for tablet 452483d8575148d8a4a44087afda65ba (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:12.330504  6604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452483d8575148d8a4a44087afda65ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.332958  6531 tablet_service.cc:1511] Processing CreateTablet for tablet 5d85eb8399f5499da2447bf576c5f2e3 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:12.334779  6531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d85eb8399f5499da2447bf576c5f2e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.328508  6529 tablet_service.cc:1511] Processing CreateTablet for tablet 452483d8575148d8a4a44087afda65ba (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:12.337162  6529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452483d8575148d8a4a44087afda65ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.330988  6532 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2089da4bf94582b0c521e3a7479853 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:12.341220  6532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2089da4bf94582b0c521e3a7479853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.345129  6527 tablet_service.cc:1511] Processing CreateTablet for tablet 0feb8917d07c43b9840447cdb98c31d4 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:12.346527  6527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feb8917d07c43b9840447cdb98c31d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.368983  6606 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2089da4bf94582b0c521e3a7479853 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:12.369472  6599 tablet_service.cc:1511] Processing CreateTablet for tablet 5d85eb8399f5499da2447bf576c5f2e3 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:12.370985  6606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2089da4bf94582b0c521e3a7479853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.372056  6758 tablet_bootstrap.cc:492] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:12.375633  6599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d85eb8399f5499da2447bf576c5f2e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.376631  6598 tablet_service.cc:1511] Processing CreateTablet for tablet 0feb8917d07c43b9840447cdb98c31d4 (DEFAULT_TABLE table=soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:12.378026  6598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feb8917d07c43b9840447cdb98c31d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.381801  6758 tablet_bootstrap.cc:654] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:12.402895  6413 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:12.481958  6760 tablet_bootstrap.cc:492] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:12.502642  6760 tablet_bootstrap.cc:654] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.527333  6761 tablet_bootstrap.cc:492] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.528240  6758 tablet_bootstrap.cc:492] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:12.528815  6758 ts_tablet_manager.cc:1403] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.157s	user 0.043s	sys 0.053s
I20260709 12:27:12.532215  6758 raft_consensus.cc:359] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.535109  6761 tablet_bootstrap.cc:654] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.533113  6758 raft_consensus.cc:385] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.537714  6758 raft_consensus.cc:740] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.538686  6758 consensus_queue.cc:260] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.539505  6760 tablet_bootstrap.cc:492] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:12.540158  6760 ts_tablet_manager.cc:1403] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.017s
I20260709 12:27:12.541496  6758 ts_tablet_manager.cc:1434] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:12.542659  6758 tablet_bootstrap.cc:492] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:12.544566  6760 raft_consensus.cc:359] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.545454  6760 raft_consensus.cc:385] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.545816  6760 raft_consensus.cc:740] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.546826  6760 consensus_queue.cc:260] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.549825  6760 ts_tablet_manager.cc:1434] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:12.550877  6760 tablet_bootstrap.cc:492] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:12.555399  6761 tablet_bootstrap.cc:492] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:12.556069  6761 ts_tablet_manager.cc:1403] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.004s
I20260709 12:27:12.558539  6760 tablet_bootstrap.cc:654] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.559356  6761 raft_consensus.cc:359] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.560235  6761 raft_consensus.cc:385] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.560539  6761 raft_consensus.cc:740] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.561323  6761 consensus_queue.cc:260] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.564227  6760 tablet_bootstrap.cc:492] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:12.564332  6761 ts_tablet_manager.cc:1434] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:27:12.564957  6760 ts_tablet_manager.cc:1403] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:27:12.565590  6761 tablet_bootstrap.cc:492] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.568266  6760 raft_consensus.cc:359] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.569024  6760 raft_consensus.cc:385] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.569408  6760 raft_consensus.cc:740] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.570195  6760 consensus_queue.cc:260] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.572594  6760 ts_tablet_manager.cc:1434] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:12.572916  6761 tablet_bootstrap.cc:654] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.573712  6760 tablet_bootstrap.cc:492] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:12.581146  6760 tablet_bootstrap.cc:654] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.591615  6758 tablet_bootstrap.cc:654] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.614530  6761 tablet_bootstrap.cc:492] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:12.615301  6761 ts_tablet_manager.cc:1403] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.011s
I20260709 12:27:12.624222  6758 tablet_bootstrap.cc:492] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:12.624315  6761 raft_consensus.cc:359] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.624912  6758 ts_tablet_manager.cc:1403] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.022s
I20260709 12:27:12.625267  6760 tablet_bootstrap.cc:492] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:12.625258  6761 raft_consensus.cc:385] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.625803  6761 raft_consensus.cc:740] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.625957  6760 ts_tablet_manager.cc:1403] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.052s	user 0.029s	sys 0.020s
I20260709 12:27:12.626606  6761 consensus_queue.cc:260] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.628576  6758 raft_consensus.cc:359] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.629087  6761 ts_tablet_manager.cc:1434] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:12.629467  6758 raft_consensus.cc:385] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.629195  6760 raft_consensus.cc:359] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.629868  6758 raft_consensus.cc:740] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.630050  6760 raft_consensus.cc:385] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.630275  6761 tablet_bootstrap.cc:492] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.630421  6760 raft_consensus.cc:740] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.630851  6758 consensus_queue.cc:260] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.631242  6760 consensus_queue.cc:260] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.633787  6760 ts_tablet_manager.cc:1434] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:12.637717  6761 tablet_bootstrap.cc:654] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.641074  6758 ts_tablet_manager.cc:1434] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:27:12.648419  6760 tablet_bootstrap.cc:492] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:12.648483  6758 tablet_bootstrap.cc:492] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:12.659549  6760 tablet_bootstrap.cc:654] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.659698  6758 tablet_bootstrap.cc:654] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.663074  6761 tablet_bootstrap.cc:492] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:12.663687  6761 ts_tablet_manager.cc:1403] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.011s
I20260709 12:27:12.666015  6760 tablet_bootstrap.cc:492] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:12.666554  6760 ts_tablet_manager.cc:1403] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.018s	user 0.001s	sys 0.013s
I20260709 12:27:12.666759  6761 raft_consensus.cc:359] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.667562  6761 raft_consensus.cc:385] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.667872  6761 raft_consensus.cc:740] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.668640  6761 consensus_queue.cc:260] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.669200  6758 tablet_bootstrap.cc:492] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:12.669842  6758 ts_tablet_manager.cc:1403] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.008s
I20260709 12:27:12.669697  6760 raft_consensus.cc:359] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.670475  6760 raft_consensus.cc:385] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.670774  6760 raft_consensus.cc:740] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.671128  6761 ts_tablet_manager.cc:1434] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:27:12.671576  6760 consensus_queue.cc:260] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.672194  6761 tablet_bootstrap.cc:492] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.673074  6758 raft_consensus.cc:359] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.673817  6758 raft_consensus.cc:385] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.674080  6758 raft_consensus.cc:740] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.674943  6758 consensus_queue.cc:260] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.679440  6761 tablet_bootstrap.cc:654] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.681862  6760 ts_tablet_manager.cc:1434] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:27:12.683722  6758 ts_tablet_manager.cc:1434] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:27:12.684834  6758 tablet_bootstrap.cc:492] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:12.691567  6758 tablet_bootstrap.cc:654] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.692227  6760 tablet_bootstrap.cc:492] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:12.697811  6761 tablet_bootstrap.cc:492] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:12.698364  6761 ts_tablet_manager.cc:1403] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 12:27:12.698660  6758 tablet_bootstrap.cc:492] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:12.699158  6758 ts_tablet_manager.cc:1403] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 12:27:12.702219  6761 raft_consensus.cc:359] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.702667  6758 raft_consensus.cc:359] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.703431  6761 raft_consensus.cc:385] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.703656  6737 raft_consensus.cc:493] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.704002  6761 raft_consensus.cc:740] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.704461  6737 raft_consensus.cc:515] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.703631  6758 raft_consensus.cc:385] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.706319  6758 raft_consensus.cc:740] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.706497  6760 tablet_bootstrap.cc:654] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.707024  6758 consensus_queue.cc:260] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.708076  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e1bc6b09fb45e186d3b564f8bc0fa3" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:12.705266  6761 consensus_queue.cc:260] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.708966  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e1bc6b09fb45e186d3b564f8bc0fa3" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:12.709395  6737 leader_election.cc:290] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:12.708833  6542 raft_consensus.cc:2468] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 0.
I20260709 12:27:12.711443  6433 leader_election.cc:304] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
W20260709 12:27:12.712646  6433 leader_election.cc:343] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.712957  6758 ts_tablet_manager.cc:1434] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:27:12.713806  6737 raft_consensus.cc:2804] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:12.714037  6758 tablet_bootstrap.cc:492] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:12.714375  6737 raft_consensus.cc:493] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.714875  6737 raft_consensus.cc:3060] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.725135  6761 ts_tablet_manager.cc:1434] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.005s
I20260709 12:27:12.726608  6761 tablet_bootstrap.cc:492] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.728868  6758 tablet_bootstrap.cc:654] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.733825  6760 tablet_bootstrap.cc:492] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:12.733465  6737 raft_consensus.cc:515] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.734354  6760 ts_tablet_manager.cc:1403] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.014s
I20260709 12:27:12.735728  6737 leader_election.cc:290] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:12.737011  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e1bc6b09fb45e186d3b564f8bc0fa3" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:12.737421  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e1bc6b09fb45e186d3b564f8bc0fa3" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:12.740168  6542 raft_consensus.cc:3060] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:12.740906  6433 leader_election.cc:343] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.738996  6760 raft_consensus.cc:359] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.741581  6760 raft_consensus.cc:385] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.741951  6760 raft_consensus.cc:740] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.742707  6760 consensus_queue.cc:260] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.745103  6760 ts_tablet_manager.cc:1434] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:27:12.746104  6760 tablet_bootstrap.cc:492] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:12.753023  6760 tablet_bootstrap.cc:654] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.757109  6542 raft_consensus.cc:2468] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 1.
I20260709 12:27:12.759025  6758 tablet_bootstrap.cc:492] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:12.758942  6433 leader_election.cc:304] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:12.759667  6758 ts_tablet_manager.cc:1403] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.019s
I20260709 12:27:12.760398  6766 raft_consensus.cc:2804] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:12.763656  6758 raft_consensus.cc:359] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.764715  6758 raft_consensus.cc:385] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.765094  6758 raft_consensus.cc:740] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.766158  6758 consensus_queue.cc:260] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.767817  6766 raft_consensus.cc:697] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:12.768911  6766 consensus_queue.cc:237] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.739511  6761 tablet_bootstrap.cc:654] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.773402  6758 ts_tablet_manager.cc:1434] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:27:12.774879  6758 tablet_bootstrap.cc:492] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:12.781751  6761 tablet_bootstrap.cc:492] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:12.782305  6761 ts_tablet_manager.cc:1403] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.056s	user 0.002s	sys 0.010s
I20260709 12:27:12.785578  6761 raft_consensus.cc:359] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.786161  6758 tablet_bootstrap.cc:654] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.786311  6761 raft_consensus.cc:385] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.786737  6761 raft_consensus.cc:740] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.786013  6362 catalog_manager.cc:5697] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:12.787559  6761 consensus_queue.cc:260] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.789971  6761 ts_tablet_manager.cc:1434] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:27:12.791118  6761 tablet_bootstrap.cc:492] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.798149  6761 tablet_bootstrap.cc:654] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.799331  6760 tablet_bootstrap.cc:492] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:12.799902  6760 ts_tablet_manager.cc:1403] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.010s
I20260709 12:27:12.803292  6760 raft_consensus.cc:359] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.803771  6758 tablet_bootstrap.cc:492] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:12.804009  6760 raft_consensus.cc:385] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.804340  6758 ts_tablet_manager.cc:1403] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.011s
I20260709 12:27:12.807510  6758 raft_consensus.cc:359] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.808283  6758 raft_consensus.cc:385] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.808566  6758 raft_consensus.cc:740] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.809613  6678 raft_consensus.cc:493] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.809324  6758 consensus_queue.cc:260] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.807678  6663 raft_consensus.cc:493] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.810150  6678 raft_consensus.cc:515] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.804359  6760 raft_consensus.cc:740] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.810554  6663 raft_consensus.cc:515] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.811882  6760 consensus_queue.cc:260] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.814411  6760 ts_tablet_manager.cc:1434] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:27:12.814131  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452483d8575148d8a4a44087afda65ba" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:12.815438  6760 tablet_bootstrap.cc:492] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:12.814198  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:12.816548  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452483d8575148d8a4a44087afda65ba" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:12.816843  6614 raft_consensus.cc:2468] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:12.817399  6465 raft_consensus.cc:2468] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:12.818413  6508 leader_election.cc:304] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
W20260709 12:27:12.819319  6582 leader_election.cc:343] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.820039  6769 raft_consensus.cc:2804] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:12.820307  6766 raft_consensus.cc:493] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.820453  6769 raft_consensus.cc:493] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.820853  6769 raft_consensus.cc:3060] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.820950  6581 leader_election.cc:304] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:12.822922  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:12.824208  6678 leader_election.cc:290] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:12.824855  6663 leader_election.cc:290] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:12.820845  6766 raft_consensus.cc:515] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
W20260709 12:27:12.824414  6507 leader_election.cc:343] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.825342  6678 raft_consensus.cc:2804] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:12.832084  6678 raft_consensus.cc:493] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.832484  6678 raft_consensus.cc:3060] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.824956  6760 tablet_bootstrap.cc:654] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.838179  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:12.839051  6766 leader_election.cc:290] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:12.839967  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
W20260709 12:27:12.842120  6433 leader_election.cc:343] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.840888  6614 raft_consensus.cc:2468] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 0.
I20260709 12:27:12.844530  6433 leader_election.cc:304] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:12.844518  6769 raft_consensus.cc:515] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.847776  6766 raft_consensus.cc:2804] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:12.848450  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:12.853037  6766 raft_consensus.cc:493] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.853490  6766 raft_consensus.cc:3060] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:12.854761  6507 leader_election.cc:343] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.858192  6758 ts_tablet_manager.cc:1434] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.054s	user 0.014s	sys 0.035s
I20260709 12:27:12.859375  6758 tablet_bootstrap.cc:492] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:12.865478  6769 leader_election.cc:290] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:12.866027  6758 tablet_bootstrap.cc:654] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.867249  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:12.869635  6614 raft_consensus.cc:3060] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.868891  6761 tablet_bootstrap.cc:492] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:12.871523  6761 ts_tablet_manager.cc:1403] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.003s
I20260709 12:27:12.871135  6678 raft_consensus.cc:515] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.875866  6761 raft_consensus.cc:359] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.876799  6761 raft_consensus.cc:385] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.877185  6761 raft_consensus.cc:740] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.877372  6614 raft_consensus.cc:2468] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 1.
I20260709 12:27:12.878129  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452483d8575148d8a4a44087afda65ba" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:12.878722  6465 raft_consensus.cc:3060] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.878937  6508 leader_election.cc:304] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:12.880216  6769 raft_consensus.cc:2804] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:12.881417  6769 raft_consensus.cc:697] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:12.880894  6761 consensus_queue.cc:260] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.882694  6769 consensus_queue.cc:237] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.884212  6761 ts_tablet_manager.cc:1434] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:27:12.885692  6761 tablet_bootstrap.cc:492] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.885748  6465 raft_consensus.cc:2468] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:12.887343  6581 leader_election.cc:304] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:12.888530  6785 raft_consensus.cc:2804] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:12.890179  6785 raft_consensus.cc:697] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:12.891515  6785 consensus_queue.cc:237] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.893296  6758 tablet_bootstrap.cc:492] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:12.893846  6758 ts_tablet_manager.cc:1403] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 12:27:12.898801  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452483d8575148d8a4a44087afda65ba" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:12.899498  6758 raft_consensus.cc:359] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.900439  6758 raft_consensus.cc:385] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:12.900779  6582 leader_election.cc:343] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.901787  6678 leader_election.cc:290] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:12.902973  6766 raft_consensus.cc:515] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.905102  6761 tablet_bootstrap.cc:654] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.907150  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:12.907543  6760 tablet_bootstrap.cc:492] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:12.908113  6760 ts_tablet_manager.cc:1403] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.046s
W20260709 12:27:12.909014  6433 leader_election.cc:343] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.900841  6758 raft_consensus.cc:740] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.910585  6758 consensus_queue.cc:260] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.911545  6760 raft_consensus.cc:359] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.915282  6760 raft_consensus.cc:385] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.915678  6760 raft_consensus.cc:740] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.916754  6761 tablet_bootstrap.cc:492] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:12.917383  6761 ts_tablet_manager.cc:1403] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.005s
I20260709 12:27:12.916680  6760 consensus_queue.cc:260] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.918349  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:12.918867  6758 ts_tablet_manager.cc:1434] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 12:27:12.919608  6760 ts_tablet_manager.cc:1434] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 12:27:12.918968  6614 raft_consensus.cc:3060] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.920024  6758 tablet_bootstrap.cc:492] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:12.920480  6761 raft_consensus.cc:359] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.921226  6761 raft_consensus.cc:385] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.921514  6761 raft_consensus.cc:740] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.922274  6761 consensus_queue.cc:260] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.924754  6785 raft_consensus.cc:493] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.924768  6761 ts_tablet_manager.cc:1434] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:12.924983  6760 tablet_bootstrap.cc:492] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:12.925400  6785 raft_consensus.cc:515] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.926087  6761 tablet_bootstrap.cc:492] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.928201  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:12.928828  6465 raft_consensus.cc:2468] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:12.930125  6581 leader_election.cc:304] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:12.930977  6678 raft_consensus.cc:2804] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:12.931391  6678 raft_consensus.cc:493] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.931725  6678 raft_consensus.cc:3060] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.932235  6760 tablet_bootstrap.cc:654] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.932113  6364 catalog_manager.cc:5697] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 1 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:12.933024  6761 tablet_bootstrap.cc:654] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.934183  6663 raft_consensus.cc:493] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.934664  6663 raft_consensus.cc:515] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.940927  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:12.941545  6761 tablet_bootstrap.cc:492] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:12.942056  6761 ts_tablet_manager.cc:1403] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
W20260709 12:27:12.942646  6582 leader_election.cc:343] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.943543  6785 leader_election.cc:290] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:12.943617  6663 leader_election.cc:290] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:12.941193  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452483d8575148d8a4a44087afda65ba" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:12.944898  6761 raft_consensus.cc:359] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.945616  6761 raft_consensus.cc:385] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.945896  6761 raft_consensus.cc:740] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.946622  6761 consensus_queue.cc:260] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.946537  6678 raft_consensus.cc:515] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.949824  6760 tablet_bootstrap.cc:492] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:12.950130  6761 ts_tablet_manager.cc:1434] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:12.951133  6761 tablet_bootstrap.cc:492] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa: Bootstrap starting.
I20260709 12:27:12.951097  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:12.951855  6466 raft_consensus.cc:3060] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.946686  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452483d8575148d8a4a44087afda65ba" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:12.955858  6465 raft_consensus.cc:2393] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19db5d1e1f444c508c3ec347c2a5f6fa in current term 1: Already voted for candidate 510083e48ed24112abbc856dd2fd7b8c in this term.
I20260709 12:27:12.957309  6507 leader_election.cc:304] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa; no voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:12.958045  6761 tablet_bootstrap.cc:654] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.958482  6663 raft_consensus.cc:3060] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.960336  6737 raft_consensus.cc:493] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.961962  6760 ts_tablet_manager.cc:1403] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.008s
I20260709 12:27:12.960865  6737 raft_consensus.cc:515] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.965268  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
W20260709 12:27:12.967268  6582 leader_election.cc:343] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:12.968091  6678 leader_election.cc:290] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:12.973353  6678 raft_consensus.cc:493] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.974078  6678 raft_consensus.cc:515] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.918473  6766 leader_election.cc:290] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:12.980073  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135ffcb6abd47d7a5c6c1022abc4d33" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:12.984205  6737 leader_election.cc:290] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:12.984604  6542 raft_consensus.cc:2468] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 0.
I20260709 12:27:12.980372  6466 raft_consensus.cc:2468] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:12.980724  6758 tablet_bootstrap.cc:654] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.985544  6760 raft_consensus.cc:359] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.986342  6760 raft_consensus.cc:385] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.986577  6760 raft_consensus.cc:740] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.986742  6581 leader_election.cc:304] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:12.987639  6785 raft_consensus.cc:2804] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:12.987283  6760 consensus_queue.cc:260] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.988157  6785 raft_consensus.cc:697] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:12.990100  6785 consensus_queue.cc:237] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.990485  6663 raft_consensus.cc:2749] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:12.992518  6770 raft_consensus.cc:493] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.992498  6614 raft_consensus.cc:2468] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 1.
I20260709 12:27:12.994068  6770 raft_consensus.cc:515] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:12.999553  6760 ts_tablet_manager.cc:1434] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.010s
I20260709 12:27:13.000957  6760 tablet_bootstrap.cc:492] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827: Bootstrap starting.
I20260709 12:27:13.005059  6678 leader_election.cc:290] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:13.005092  6770 leader_election.cc:290] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.005287  6364 catalog_manager.cc:5697] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 1 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.008009  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:13.008668  6466 raft_consensus.cc:2468] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:13.006505  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:13.009631  6542 raft_consensus.cc:2468] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 0.
I20260709 12:27:13.010339  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:13.010604  6581 leader_election.cc:304] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:13.011047  6614 raft_consensus.cc:2468] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:13.012193  6508 leader_election.cc:304] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:13.013031  6770 raft_consensus.cc:2804] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.013145  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135ffcb6abd47d7a5c6c1022abc4d33" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:13.013422  6770 raft_consensus.cc:493] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.013811  6770 raft_consensus.cc:3060] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.017565  6362 catalog_manager.cc:5697] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 1 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.019042  6678 raft_consensus.cc:2804] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.022516  6678 raft_consensus.cc:493] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.022863  6678 raft_consensus.cc:3060] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.024067  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:13.024334  6433 leader_election.cc:304] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:13.024855  6466 raft_consensus.cc:2468] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:13.025260  6779 raft_consensus.cc:2804] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.025705  6779 raft_consensus.cc:493] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.025622  6433 leader_election.cc:304] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:13.026180  6779 raft_consensus.cc:3060] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.019167  6663 raft_consensus.cc:493] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.027127  6766 raft_consensus.cc:2804] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.027715  6766 raft_consensus.cc:697] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:13.027674  6663 raft_consensus.cc:515] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.031118  6663 leader_election.cc:290] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.032245  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd32f484f5b041d29f774e4efcefeda1" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:13.028776  6766 consensus_queue.cc:237] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.037258  6614 raft_consensus.cc:2468] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:13.034937  6678 raft_consensus.cc:515] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.039829  6508 leader_election.cc:304] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:13.040134  6761 tablet_bootstrap.cc:492] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa: No bootstrap required, opened a new log
I20260709 12:27:13.040618  6761 ts_tablet_manager.cc:1403] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.027s
I20260709 12:27:13.043650  6758 tablet_bootstrap.cc:492] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:13.043756  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:13.044451  6758 ts_tablet_manager.cc:1403] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.001s
I20260709 12:27:13.044855  6678 leader_election.cc:290] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:13.046330  6770 raft_consensus.cc:515] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.047391  6542 raft_consensus.cc:2393] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 510083e48ed24112abbc856dd2fd7b8c in current term 1: Already voted for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in this term.
I20260709 12:27:13.048434  6770 leader_election.cc:290] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.048827  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:13.049031  6770 raft_consensus.cc:2804] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.049510  6770 raft_consensus.cc:493] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.049932  6770 raft_consensus.cc:3060] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.052758  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.049444  6466 raft_consensus.cc:3060] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.053637  6614 raft_consensus.cc:2393] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 19db5d1e1f444c508c3ec347c2a5f6fa in current term 1: Already voted for candidate 510083e48ed24112abbc856dd2fd7b8c in this term.
I20260709 12:27:13.054028  6779 raft_consensus.cc:515] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.056587  6770 raft_consensus.cc:515] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.057569  6779 leader_election.cc:290] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.057857  6760 tablet_bootstrap.cc:654] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:13.026906  6433 leader_election.cc:343] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.059588  6769 raft_consensus.cc:493] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.062005  6761 raft_consensus.cc:359] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.063330  6761 raft_consensus.cc:385] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.063652  6761 raft_consensus.cc:740] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.064360  6761 consensus_queue.cc:260] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.065690  6769 raft_consensus.cc:515] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.067728  6761 ts_tablet_manager.cc:1434] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:27:13.066215  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd32f484f5b041d29f774e4efcefeda1" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.069610  6614 raft_consensus.cc:3060] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.070197  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:13.070981  6615 raft_consensus.cc:2393] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19db5d1e1f444c508c3ec347c2a5f6fa in current term 1: Already voted for candidate 76b6c969c7684e3e9d66965782eba827 in this term.
I20260709 12:27:13.063426  6770 leader_election.cc:290] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.069077  6769 leader_election.cc:290] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.074133  6466 raft_consensus.cc:2468] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 1.
I20260709 12:27:13.076836  6581 leader_election.cc:304] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:13.078040  6678 raft_consensus.cc:2804] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.078503  6678 raft_consensus.cc:697] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:13.078611  6363 catalog_manager.cc:5697] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.079394  6678 consensus_queue.cc:237] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.074993  6758 raft_consensus.cc:359] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.082897  6758 raft_consensus.cc:385] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:13.072554  6433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.131.195:35135, user_credentials={real_user=slave}} blocked reactor thread for 45675us
I20260709 12:27:13.083303  6758 raft_consensus.cc:740] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.085740  6758 consensus_queue.cc:260] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.091161  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135ffcb6abd47d7a5c6c1022abc4d33" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.091874  6615 raft_consensus.cc:3060] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.094805  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135ffcb6abd47d7a5c6c1022abc4d33" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:13.095703  6542 raft_consensus.cc:3060] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.100099  6758 ts_tablet_manager.cc:1434] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:27:13.101065  6758 tablet_bootstrap.cc:492] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c: Bootstrap starting.
I20260709 12:27:13.102846  6614 raft_consensus.cc:2468] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 1.
I20260709 12:27:13.106950  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:13.107760  6465 raft_consensus.cc:2393] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 19db5d1e1f444c508c3ec347c2a5f6fa in current term 1: Already voted for candidate 510083e48ed24112abbc856dd2fd7b8c in this term.
I20260709 12:27:13.108983  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd32f484f5b041d29f774e4efcefeda1" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:13.109504  6465 raft_consensus.cc:3060] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.107016  6760 tablet_bootstrap.cc:492] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827: No bootstrap required, opened a new log
I20260709 12:27:13.110690  6760 ts_tablet_manager.cc:1403] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827: Time spent bootstrapping tablet: real 0.110s	user 0.020s	sys 0.009s
I20260709 12:27:13.110023  6769 raft_consensus.cc:493] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.112440  6769 raft_consensus.cc:515] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.116343  6363 catalog_manager.cc:5697] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 1 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.117321  6507 leader_election.cc:304] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa; no voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:13.118036  6463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2089da4bf94582b0c521e3a7479853" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:13.117663  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:13.120522  6463 raft_consensus.cc:2468] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 0.
I20260709 12:27:13.121381  6663 raft_consensus.cc:2749] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.103145  6615 raft_consensus.cc:2468] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 1.
I20260709 12:27:13.122473  6507 leader_election.cc:304] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa; no voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:13.126318  6663 raft_consensus.cc:3060] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.129212  6760 raft_consensus.cc:359] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.130592  6760 raft_consensus.cc:385] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.130908  6760 raft_consensus.cc:740] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.131426  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd32f484f5b041d29f774e4efcefeda1" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:13.125480  6465 raft_consensus.cc:2468] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 1.
I20260709 12:27:13.136605  6542 raft_consensus.cc:2468] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 1.
I20260709 12:27:13.140609  6433 leader_election.cc:304] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:13.131704  6760 consensus_queue.cc:260] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.141757  6766 raft_consensus.cc:2804] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.142329  6766 raft_consensus.cc:697] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:13.143149  6760 ts_tablet_manager.cc:1434] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:27:13.143095  6766 consensus_queue.cc:237] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.144560  6758 tablet_bootstrap.cc:654] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.144872  6769 leader_election.cc:290] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.148468  6508 leader_election.cc:304] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:13.148808  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2089da4bf94582b0c521e3a7479853" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:13.154295  6804 raft_consensus.cc:2804] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:13.154709  6508 leader_election.cc:343] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.152993  6663 raft_consensus.cc:2749] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.155055  6804 raft_consensus.cc:697] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:13.156513  6804 consensus_queue.cc:237] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.159446  6507 leader_election.cc:304] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:13.163592  6805 raft_consensus.cc:2804] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.164043  6805 raft_consensus.cc:493] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.164474  6805 raft_consensus.cc:3060] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.174924  6805 raft_consensus.cc:515] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.182498  6363 catalog_manager.cc:5697] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 1 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.183995  6758 tablet_bootstrap.cc:492] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c: No bootstrap required, opened a new log
I20260709 12:27:13.184271  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2089da4bf94582b0c521e3a7479853" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:13.184549  6758 ts_tablet_manager.cc:1403] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.018s
I20260709 12:27:13.184904  6465 raft_consensus.cc:3060] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.184661  6362 catalog_manager.cc:5697] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 1 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.187445  6758 raft_consensus.cc:359] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.188055  6758 raft_consensus.cc:385] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.188313  6758 raft_consensus.cc:740] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.188968  6758 consensus_queue.cc:260] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.192206  6465 raft_consensus.cc:2468] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 1.
I20260709 12:27:13.192409  6758 ts_tablet_manager.cc:1434] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:27:13.193431  6507 leader_election.cc:304] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:13.194243  6804 raft_consensus.cc:2804] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.194681  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2089da4bf94582b0c521e3a7479853" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.194684  6804 raft_consensus.cc:697] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:13.195335  6615 raft_consensus.cc:3060] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.197168  6804 consensus_queue.cc:237] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.199411  6805 leader_election.cc:290] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.201923  6615 raft_consensus.cc:2468] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 1.
I20260709 12:27:13.206565  6363 catalog_manager.cc:5697] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 1 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.227284  6804 raft_consensus.cc:493] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.227774  6804 raft_consensus.cc:515] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.229305  6804 leader_election.cc:290] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.230090  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b6c969c7684e3e9d66965782eba827" is_pre_election: true
I20260709 12:27:13.230278  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:13.230768  6465 raft_consensus.cc:2393] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19db5d1e1f444c508c3ec347c2a5f6fa in current term 1: Already voted for candidate 510083e48ed24112abbc856dd2fd7b8c in this term.
I20260709 12:27:13.231688  6507 leader_election.cc:304] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa; no voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:13.232337  6804 raft_consensus.cc:3060] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.237807  6804 raft_consensus.cc:2749] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.241657  6615 raft_consensus.cc:3060] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.247725  6766 consensus_queue.cc:1048] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.260921  6766 consensus_queue.cc:1048] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.279731  6615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
mode: GRACEFUL
new_leader_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:27:13.280350  6615 raft_consensus.cc:606] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Received request to transfer leadership to TS 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:13.286494  6541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd32f484f5b041d29f774e4efcefeda1"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
mode: GRACEFUL
new_leader_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:54232
I20260709 12:27:13.287133  6541 raft_consensus.cc:606] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Received request to transfer leadership to TS 76b6c969c7684e3e9d66965782eba827
I20260709 12:27:13.292641  6465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7"
dest_uuid: "76b6c969c7684e3e9d66965782eba827"
mode: GRACEFUL
new_leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:38704
I20260709 12:27:13.293118  6465 raft_consensus.cc:606] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Received request to transfer leadership to TS 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:13.297068  6678 consensus_queue.cc:1048] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.298385  6615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "452483d8575148d8a4a44087afda65ba"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
mode: GRACEFUL
new_leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:27:13.299091  6615 raft_consensus.cc:606] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Received request to transfer leadership to TS 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:13.308900  6678 consensus_queue.cc:1048] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.310945  6615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
mode: GRACEFUL
new_leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:27:13.311643  6615 raft_consensus.cc:606] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Received request to transfer leadership to TS 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:13.320664  6542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
mode: GRACEFUL
new_leader_uuid: "510083e48ed24112abbc856dd2fd7b8c"
 from {username='slave'} at 127.0.0.1:54232
I20260709 12:27:13.321272  6542 raft_consensus.cc:606] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Received request to transfer leadership to TS 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:13.321931  6678 raft_consensus.cc:993] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c: : Instructing follower 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:13.322439  6678 raft_consensus.cc:1081] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Signalling peer 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:13.324715  6542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "452483d8575148d8a4a44087afda65ba"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:54216
I20260709 12:27:13.325314  6542 raft_consensus.cc:493] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.325652  6542 raft_consensus.cc:3060] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.331818  6542 raft_consensus.cc:515] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.333508  6542 leader_election.cc:290] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.334417  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452483d8575148d8a4a44087afda65ba" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:13.334697  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452483d8575148d8a4a44087afda65ba" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.335034  6465 raft_consensus.cc:3060] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.335330  6615 raft_consensus.cc:3055] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.335723  6615 raft_consensus.cc:740] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:13.336491  6615 consensus_queue.cc:260] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.337538  6615 raft_consensus.cc:3060] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.341305  6465 raft_consensus.cc:2468] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:13.342338  6507 leader_election.cc:304] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:13.343031  6804 raft_consensus.cc:2804] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.343533  6615 raft_consensus.cc:2468] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:13.343530  6804 raft_consensus.cc:697] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:13.344734  6804 consensus_queue.cc:237] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.351804  6766 raft_consensus.cc:493] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.351357  6362 catalog_manager.cc:5697] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 1 to 2, leader changed from 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195) to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 2 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.352394  6766 raft_consensus.cc:515] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.354458  6766 leader_election.cc:290] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.355335  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" is_pre_election: true
I20260709 12:27:13.355841  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510083e48ed24112abbc856dd2fd7b8c" is_pre_election: true
I20260709 12:27:13.356675  6615 raft_consensus.cc:2393] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76b6c969c7684e3e9d66965782eba827 in current term 1: Already voted for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in this term.
I20260709 12:27:13.357625  6433 leader_election.cc:304] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:13.358321  6766 raft_consensus.cc:3060] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.364616  6766 raft_consensus.cc:2749] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.407564  6804 consensus_queue.cc:1048] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.414774  6805 raft_consensus.cc:993] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa: : Instructing follower 510083e48ed24112abbc856dd2fd7b8c to start an election
I20260709 12:27:13.415323  6805 raft_consensus.cc:1081] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Signalling peer 510083e48ed24112abbc856dd2fd7b8c to start an election
I20260709 12:27:13.421092  6770 consensus_queue.cc:1048] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.425020  6615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
 from {username='slave'} at 127.0.0.1:34934
I20260709 12:27:13.425729  6615 raft_consensus.cc:493] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.426184  6615 raft_consensus.cc:3060] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.434383  6615 raft_consensus.cc:515] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.436190  6615 leader_election.cc:290] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:13.437822  6542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:13.438366  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb8917d07c43b9840447cdb98c31d4" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:13.438405  6542 raft_consensus.cc:3055] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.439025  6465 raft_consensus.cc:3060] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.439090  6542 raft_consensus.cc:740] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:13.440057  6542 consensus_queue.cc:260] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.441175  6542 raft_consensus.cc:3060] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.445547  6465 raft_consensus.cc:2468] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 2.
I20260709 12:27:13.446539  6581 leader_election.cc:304] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:13.446687  6542 raft_consensus.cc:2468] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 2.
I20260709 12:27:13.447445  6787 raft_consensus.cc:2804] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.448009  6787 raft_consensus.cc:697] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 2 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:13.448925  6787 consensus_queue.cc:237] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.455615  6364 catalog_manager.cc:5697] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 1 to 2, leader changed from 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194) to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 2 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.501843  6787 consensus_queue.cc:1048] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.508867  6678 raft_consensus.cc:993] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c: : Instructing follower 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:13.509418  6785 raft_consensus.cc:1081] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Signalling peer 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:13.511334  6465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f"
dest_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:38684
I20260709 12:27:13.511940  6465 raft_consensus.cc:493] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.512351  6465 raft_consensus.cc:3060] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.512053  6678 consensus_queue.cc:1048] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:13.518723  6678 consensus_queue.cc:1048] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.520339  6465 raft_consensus.cc:515] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.523825  6466 raft_consensus.cc:1240] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Rejecting Update request from peer 510083e48ed24112abbc856dd2fd7b8c for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:13.526595  6540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:13.527199  6615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca3415672474d868e6cf1a4046f9e1f" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.527884  6615 raft_consensus.cc:3055] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.528221  6615 raft_consensus.cc:740] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:13.529165  6678 raft_consensus.cc:993] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c: : Instructing follower 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:13.529024  6615 consensus_queue.cc:260] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.529831  6787 raft_consensus.cc:1081] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Signalling peer 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:13.530014  6615 raft_consensus.cc:3060] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.538928  6615 raft_consensus.cc:2468] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:13.539884  6540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:54216
W20260709 12:27:13.539616  6678 consensus_queue.cc:1175] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "76b6c969c7684e3e9d66965782eba827" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 510083e48ed24112abbc856dd2fd7b8c for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:13.539641  6785 consensus_queue.cc:1048] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:13.540866  6540 raft_consensus.cc:493] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.541404  6540 raft_consensus.cc:3060] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.544284  6433 leader_election.cc:304] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 19db5d1e1f444c508c3ec347c2a5f6fa
I20260709 12:27:13.545300  6465 leader_election.cc:290] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.546344  6797 raft_consensus.cc:2804] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.546917  6797 raft_consensus.cc:697] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:13.548493  6797 consensus_queue.cc:237] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.553427  6540 raft_consensus.cc:515] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.554615  6541 raft_consensus.cc:1240] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Rejecting Update request from peer 510083e48ed24112abbc856dd2fd7b8c for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:13.556947  6540 leader_election.cc:290] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.558486  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.559132  6614 raft_consensus.cc:3055] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.559480  6614 raft_consensus.cc:740] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:13.560334  6614 consensus_queue.cc:260] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.560839  6823 consensus_queue.cc:1048] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:13.561389  6614 raft_consensus.cc:3060] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.564388  6465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d85eb8399f5499da2447bf576c5f2e3" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:13.565034  6465 raft_consensus.cc:3060] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.573246  6770 consensus_queue.cc:1048] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:13.575284  6465 raft_consensus.cc:2468] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:13.573760  6614 raft_consensus.cc:2468] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:13.578976  6508 leader_election.cc:304] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:13.584806  6770 raft_consensus.cc:2804] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.584513  6362 catalog_manager.cc:5697] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 1 to 2, leader changed from 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195) to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.585556  6770 raft_consensus.cc:697] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:13.586299  6797 consensus_queue.cc:1048] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.586486  6770 consensus_queue.cc:237] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.591600  6770 consensus_queue.cc:1048] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.593694  6797 raft_consensus.cc:993] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: : Instructing follower 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:13.594259  6797 raft_consensus.cc:1081] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Signalling peer 19db5d1e1f444c508c3ec347c2a5f6fa to start an election
I20260709 12:27:13.602129  6541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
 from {username='slave'} at 127.0.0.1:54228
I20260709 12:27:13.602900  6541 raft_consensus.cc:493] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.603417  6541 raft_consensus.cc:3060] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.610198  6797 consensus_queue.cc:1048] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.614729  6769 raft_consensus.cc:993] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa: : Instructing follower 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:13.609833  6362 catalog_manager.cc:5697] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 1 to 2, leader changed from 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195) to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 2 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.621390  6769 raft_consensus.cc:1081] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Signalling peer 76b6c969c7684e3e9d66965782eba827 to start an election
I20260709 12:27:13.629633  6465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd32f484f5b041d29f774e4efcefeda1"
dest_uuid: "76b6c969c7684e3e9d66965782eba827"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:27:13.630401  6465 raft_consensus.cc:493] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.630846  6465 raft_consensus.cc:3060] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.636624  6541 raft_consensus.cc:515] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.639992  6465 raft_consensus.cc:515] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.640206  6466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:13.640969  6466 raft_consensus.cc:3055] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.641327  6466 raft_consensus.cc:740] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:13.642197  6466 consensus_queue.cc:260] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.643658  6541 leader_election.cc:290] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.644316  6614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea1cd786ab14a438d7b0c5c05402ae7" candidate_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.645028  6614 raft_consensus.cc:3060] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.648242  6466 raft_consensus.cc:3060] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.652283  6614 raft_consensus.cc:2468] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:13.653302  6823 consensus_queue.cc:1048] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:13.656298  6465 leader_election.cc:290] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Requested vote from peers 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885), 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195:35135)
I20260709 12:27:13.657449  6466 raft_consensus.cc:2468] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db5d1e1f444c508c3ec347c2a5f6fa in term 2.
I20260709 12:27:13.658641  6613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd32f484f5b041d29f774e4efcefeda1" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
I20260709 12:27:13.659415  6613 raft_consensus.cc:3060] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.662684  6540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd32f484f5b041d29f774e4efcefeda1" candidate_uuid: "76b6c969c7684e3e9d66965782eba827" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:13.663410  6540 raft_consensus.cc:3055] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.663775  6540 raft_consensus.cc:740] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:13.664644  6508 leader_election.cc:304] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:13.664712  6540 consensus_queue.cc:260] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.666337  6540 raft_consensus.cc:3060] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.666723  6663 raft_consensus.cc:2804] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.667339  6663 raft_consensus.cc:697] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Becoming Leader. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:13.668286  6663 consensus_queue.cc:237] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.673960  6613 raft_consensus.cc:2468] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:13.675094  6433 leader_election.cc:304] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:13.675843  6823 raft_consensus.cc:2804] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.676281  6823 raft_consensus.cc:697] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Becoming Leader. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:13.677047  6823 consensus_queue.cc:237] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:13.678053  6540 raft_consensus.cc:2468] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76b6c969c7684e3e9d66965782eba827 in term 2.
I20260709 12:27:13.687646  6363 catalog_manager.cc:5697] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 reported cstate change: term changed from 1 to 2, leader changed from 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194) to 76b6c969c7684e3e9d66965782eba827 (127.29.131.193). New cstate: current_term: 2 leader_uuid: "76b6c969c7684e3e9d66965782eba827" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.702811  6362 catalog_manager.cc:5697] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa reported cstate change: term changed from 1 to 2, leader changed from 76b6c969c7684e3e9d66965782eba827 (127.29.131.193) to 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194). New cstate: current_term: 2 leader_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.739008  6663 consensus_queue.cc:1048] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.750219  6466 raft_consensus.cc:1275] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.751396  6663 consensus_queue.cc:1048] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.751758  6804 consensus_queue.cc:1048] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.760771  6613 raft_consensus.cc:1275] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.762308  6804 consensus_queue.cc:1048] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.968101  6541 raft_consensus.cc:1275] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Refusing update from remote peer 510083e48ed24112abbc856dd2fd7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.969507  6678 consensus_queue.cc:1048] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.977178  6466 raft_consensus.cc:1275] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 510083e48ed24112abbc856dd2fd7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.980362  6787 consensus_queue.cc:1048] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.986107  6613 raft_consensus.cc:1275] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.987676  6766 consensus_queue.cc:1048] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.996475  6541 raft_consensus.cc:3060] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.002656  6541 raft_consensus.cc:1275] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.003901  6797 consensus_queue.cc:1048] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.109357  6466 raft_consensus.cc:1275] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.110487  6663 consensus_queue.cc:1048] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.118196  6613 raft_consensus.cc:1275] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.119835  6663 consensus_queue.cc:1048] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.129290  6613 raft_consensus.cc:1275] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.130565  6779 consensus_queue.cc:1048] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.139336  6541 raft_consensus.cc:1275] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Refusing update from remote peer 76b6c969c7684e3e9d66965782eba827: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.141129  6779 consensus_queue.cc:1048] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.170944  6613 raft_consensus.cc:1275] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.172173  6663 consensus_queue.cc:1048] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.179931  6466 raft_consensus.cc:1275] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 19db5d1e1f444c508c3ec347c2a5f6fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.181524  6770 consensus_queue.cc:1048] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.330832  6364 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39662:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:16.350977  6364 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39662:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:16.392271 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:16.472124  6871 tablet.cc:1724] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:16.504747  6850 log.cc:927] Time spent T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
W20260709 12:27:16.521864  6508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.195:35135, user_credentials={real_user=slave}} blocked reactor thread for 47599.3us
I20260709 12:27:16.527422  6873 tablet.cc:1724] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.599341  6871 tablet.cc:1724] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.628037  6887 tablet.cc:1724] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.614967  6884 tablet.cc:1724] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:16.650442  6883 log.cc:927] Time spent T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:27:16.682260  6888 log.cc:927] Time spent T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:27:16.670578  6873 tablet.cc:1724] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.658054  6893 tablet.cc:1724] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.689380  6881 tablet.cc:1724] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.690651  6884 tablet.cc:1724] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.712168  6541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8c548eee8a148668dbea3ccd5c48770"
dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
mode: GRACEFUL
new_leader_uuid: "510083e48ed24112abbc856dd2fd7b8c"
 from {username='slave'} at 127.0.0.1:34176
I20260709 12:27:16.712802  6541 raft_consensus.cc:606] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Received request to transfer leadership to TS 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:16.719841  6871 tablet.cc:1724] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.730219  6891 tablet.cc:1724] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.762074  6899 tablet.cc:1724] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.775777  6898 tablet.cc:1724] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.753512  6896 tablet.cc:1724] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.792991  6897 tablet.cc:1724] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:16.795650  6433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.131.194:33885, user_credentials={real_user=slave}} blocked reactor thread for 53648.1us
I20260709 12:27:16.805636  6872 raft_consensus.cc:993] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa: : Instructing follower 510083e48ed24112abbc856dd2fd7b8c to start an election
I20260709 12:27:16.806217  6872 raft_consensus.cc:1081] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Signalling peer 510083e48ed24112abbc856dd2fd7b8c to start an election
I20260709 12:27:16.809967  6612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8c548eee8a148668dbea3ccd5c48770"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
 from {username='slave'} at 127.0.0.1:34934
I20260709 12:27:16.810524  6612 raft_consensus.cc:493] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.810933  6612 raft_consensus.cc:3060] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.815348  6873 tablet.cc:1724] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.818363  6887 tablet.cc:1724] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.823278  6467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f"
dest_uuid: "76b6c969c7684e3e9d66965782eba827"
mode: GRACEFUL
new_leader_uuid: "510083e48ed24112abbc856dd2fd7b8c"
 from {username='slave'} at 127.0.0.1:59736
I20260709 12:27:16.823990  6467 raft_consensus.cc:606] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Received request to transfer leadership to TS 510083e48ed24112abbc856dd2fd7b8c
I20260709 12:27:16.823900  6612 raft_consensus.cc:515] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:16.825834 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:16.826489 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:16.826853  6612 leader_election.cc:290] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 2 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:16.827665  6538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c548eee8a148668dbea3ccd5c48770" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:16.829478  6538 raft_consensus.cc:3055] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:16.827983  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c548eee8a148668dbea3ccd5c48770" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:16.829793  6538 raft_consensus.cc:740] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19db5d1e1f444c508c3ec347c2a5f6fa, State: Running, Role: LEADER
I20260709 12:27:16.830090  6467 raft_consensus.cc:3060] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.830616  6538 consensus_queue.cc:260] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:16.832957  6538 raft_consensus.cc:3060] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.838011  6467 raft_consensus.cc:2468] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 2.
I20260709 12:27:16.828207  6891 tablet.cc:1724] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.839577  6581 leader_election.cc:304] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510083e48ed24112abbc856dd2fd7b8c, 76b6c969c7684e3e9d66965782eba827; no voters: 
I20260709 12:27:16.841199  6833 raft_consensus.cc:2804] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.841652  6833 raft_consensus.cc:697] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 2 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:16.842494  6833 consensus_queue.cc:237] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:16.844835  6896 tablet.cc:1724] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.853107  6893 tablet.cc:1724] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.856767  6884 tablet.cc:1724] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.858983  6897 tablet.cc:1724] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.864332  6881 tablet.cc:1724] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.856859  6871 tablet.cc:1724] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.873344  6538 raft_consensus.cc:2468] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 2.
I20260709 12:27:16.880740  6899 tablet.cc:1724] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.913069  6881 tablet.cc:1724] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.923060  6873 tablet.cc:1724] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:16.932979  6362 catalog_manager.cc:5697] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 1 to 2, leader changed from 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194) to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 2 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:16.943449  6364 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c: soft_deleted_table [id=b8402770f6494aaeaca62a92e9477f14] alter complete (version 1)
I20260709 12:27:17.075057  6903 raft_consensus.cc:993] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827: : Instructing follower 510083e48ed24112abbc856dd2fd7b8c to start an election
I20260709 12:27:17.075663  6835 raft_consensus.cc:1081] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Signalling peer 510083e48ed24112abbc856dd2fd7b8c to start an election
I20260709 12:27:17.077126  6612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f"
dest_uuid: "510083e48ed24112abbc856dd2fd7b8c"
 from {username='slave'} at 127.0.0.1:34922
I20260709 12:27:17.077685  6612 raft_consensus.cc:493] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.077975  6612 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.082830  6612 raft_consensus.cc:515] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:17.084474  6612 leader_election.cc:290] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 3 election: Requested vote from peers 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117), 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885)
I20260709 12:27:17.085232  6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76b6c969c7684e3e9d66965782eba827"
I20260709 12:27:17.085525  6541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faec8446c0bc4b6e9864452fa653bf7f" candidate_uuid: "510083e48ed24112abbc856dd2fd7b8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa"
I20260709 12:27:17.085913  6467 raft_consensus.cc:3055] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:17.086071  6541 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.086264  6467 raft_consensus.cc:740] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 76b6c969c7684e3e9d66965782eba827, State: Running, Role: LEADER
I20260709 12:27:17.087122  6467 consensus_queue.cc:260] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:17.088438  6467 raft_consensus.cc:3060] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.093143  6541 raft_consensus.cc:2468] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 3.
I20260709 12:27:17.094426  6582 leader_election.cc:304] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db5d1e1f444c508c3ec347c2a5f6fa, 510083e48ed24112abbc856dd2fd7b8c; no voters: 
I20260709 12:27:17.095476  6875 raft_consensus.cc:2804] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:17.095515  6467 raft_consensus.cc:2468] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510083e48ed24112abbc856dd2fd7b8c in term 3.
I20260709 12:27:17.095957  6875 raft_consensus.cc:697] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 3 LEADER]: Becoming Leader. State: Replica: 510083e48ed24112abbc856dd2fd7b8c, State: Running, Role: LEADER
I20260709 12:27:17.096885  6875 consensus_queue.cc:237] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } }
I20260709 12:27:17.105003  6363 catalog_manager.cc:5697] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c reported cstate change: term changed from 2 to 3, leader changed from 76b6c969c7684e3e9d66965782eba827 (127.29.131.193) to 510083e48ed24112abbc856dd2fd7b8c (127.29.131.195). New cstate: current_term: 3 leader_uuid: "510083e48ed24112abbc856dd2fd7b8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510083e48ed24112abbc856dd2fd7b8c" member_type: VOTER last_known_addr { host: "127.29.131.195" port: 35135 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:17.273149  6541 raft_consensus.cc:1275] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Refusing update from remote peer 510083e48ed24112abbc856dd2fd7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.274281  6875 consensus_queue.cc:1048] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.284823  6467 raft_consensus.cc:1275] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Refusing update from remote peer 510083e48ed24112abbc856dd2fd7b8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.286201  6875 consensus_queue.cc:1048] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.559412  6467 raft_consensus.cc:1275] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 3 FOLLOWER]: Refusing update from remote peer 510083e48ed24112abbc856dd2fd7b8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:17.560671  6875 consensus_queue.cc:1048] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b6c969c7684e3e9d66965782eba827" member_type: VOTER last_known_addr { host: "127.29.131.193" port: 38117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:17.571632  6541 raft_consensus.cc:1275] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 3 FOLLOWER]: Refusing update from remote peer 510083e48ed24112abbc856dd2fd7b8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:17.573235  6833 consensus_queue.cc:1048] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db5d1e1f444c508c3ec347c2a5f6fa" member_type: VOTER last_known_addr { host: "127.29.131.194" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:17.827768 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:17.835136 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:17.835711 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:18.836792 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:18.842047 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:18.842517 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:27:20.417182  6637 debug-util.cc:398] Leaking SignalData structure 0x7b0800394ca0 after lost signal to thread 30226
W20260709 12:27:20.418210  6637 debug-util.cc:398] Leaking SignalData structure 0x7b0800196100 after lost signal to thread 6399
W20260709 12:27:20.419418  6637 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0860 after lost signal to thread 6491
W20260709 12:27:20.420440  6637 debug-util.cc:398] Leaking SignalData structure 0x7b0800267760 after lost signal to thread 6566
W20260709 12:27:20.421468  6637 debug-util.cc:398] Leaking SignalData structure 0x7b08002958a0 after lost signal to thread 6640
I20260709 12:27:20.503424 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:20.510131 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:20.510623 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:21.512144 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:21.528573 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:21.529078 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:22.530282 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.537288 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:22.537928 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:23.538940 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:23.544999 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:23.545506 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:24.546403 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:24.551519 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:24.551950 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:25.552974 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:25.557804 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:25.558175 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:26.559072 30223 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:26.564249 30223 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:26.564690 30223 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:27.625093 30223 tablet_server.cc:179] TabletServer@127.29.131.193:0 shutting down...
W20260709 12:27:27.660259  6507 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 12:27:27.669247  6507 consensus_peers.cc:597] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.688397 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:27.689368 30223 tablet_replica.cc:333] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.690279 30223 raft_consensus.cc:2243] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.691453 30223 raft_consensus.cc:2272] T dca3415672474d868e6cf1a4046f9e1f P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.694154 30223 tablet_replica.cc:333] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.694905 30223 raft_consensus.cc:2243] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.695572 30223 raft_consensus.cc:2272] T 4c2089da4bf94582b0c521e3a7479853 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.698081 30223 tablet_replica.cc:333] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.698761 30223 raft_consensus.cc:2243] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.699579 30223 raft_consensus.cc:2272] T 5d85eb8399f5499da2447bf576c5f2e3 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.702399 30223 tablet_replica.cc:333] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.702940 30223 raft_consensus.cc:2243] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.703897 30223 raft_consensus.cc:2272] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.706398 30223 tablet_replica.cc:333] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.707185 30223 raft_consensus.cc:2243] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.707893 30223 raft_consensus.cc:2272] T 60b3686687434dbeac488ccfec19892e P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.710958 30223 tablet_replica.cc:333] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.711776 30223 raft_consensus.cc:2243] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.712376 30223 raft_consensus.cc:2272] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.714956 30223 tablet_replica.cc:333] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.715564 30223 raft_consensus.cc:2243] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.716044 30223 raft_consensus.cc:2272] T d1edcb23098848989634fe257f90f2da P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.718330 30223 tablet_replica.cc:333] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.718922 30223 raft_consensus.cc:2243] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.719892 30223 raft_consensus.cc:2272] T bd32f484f5b041d29f774e4efcefeda1 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.722438 30223 tablet_replica.cc:333] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.723028 30223 raft_consensus.cc:2243] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.723524 30223 raft_consensus.cc:2272] T faec8446c0bc4b6e9864452fa653bf7f P 76b6c969c7684e3e9d66965782eba827 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.725904 30223 tablet_replica.cc:333] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.726683 30223 raft_consensus.cc:2243] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.727658 30223 raft_consensus.cc:2272] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.730124 30223 tablet_replica.cc:333] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.730756 30223 raft_consensus.cc:2243] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.731706 30223 raft_consensus.cc:2272] T 73a169e2c10443e48edd3a33ce51cf78 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.734126 30223 tablet_replica.cc:333] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.734686 30223 raft_consensus.cc:2243] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.735185 30223 raft_consensus.cc:2272] T 6c95cc7f731047ea9cb6080ab8e16a10 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.737560 30223 tablet_replica.cc:333] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.738240 30223 raft_consensus.cc:2243] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.738736 30223 raft_consensus.cc:2272] T 72780ab2095944258925f9d2d3225fe0 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.741155 30223 tablet_replica.cc:333] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.741839 30223 raft_consensus.cc:2243] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.742369 30223 raft_consensus.cc:2272] T 452483d8575148d8a4a44087afda65ba P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.744822 30223 tablet_replica.cc:333] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.745402 30223 raft_consensus.cc:2243] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.746469 30223 raft_consensus.cc:2272] T ee427235b57c475c952cc5a95299e9ff P 76b6c969c7684e3e9d66965782eba827 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.749099 30223 tablet_replica.cc:333] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.749619 30223 raft_consensus.cc:2243] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.750108 30223 raft_consensus.cc:2272] T 0feb8917d07c43b9840447cdb98c31d4 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.752599 30223 tablet_replica.cc:333] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.753050 30223 raft_consensus.cc:2243] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.753917 30223 raft_consensus.cc:2272] T aeef2dad4b144c7480d88beec114f37e P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.756197 30223 tablet_replica.cc:333] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827: stopping tablet replica
I20260709 12:27:27.756669 30223 raft_consensus.cc:2243] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.757067 30223 raft_consensus.cc:2272] T c8c548eee8a148668dbea3ccd5c48770 P 76b6c969c7684e3e9d66965782eba827 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.762223  6507 consensus_peers.cc:597] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.769368  6581 consensus_peers.cc:597] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.809516 30223 tablet_server.cc:196] TabletServer@127.29.131.193:0 shutdown complete.
W20260709 12:27:27.818811  6507 consensus_peers.cc:597] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:38117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.861346  6507 consensus_peers.cc:597] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:38117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.863914  6581 consensus_peers.cc:597] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:38117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.864656 30223 tablet_server.cc:179] TabletServer@127.29.131.194:0 shutting down...
W20260709 12:27:27.876003  6507 consensus_peers.cc:597] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:38117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.905181 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:27.905915 30223 tablet_replica.cc:333] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.906876 30223 raft_consensus.cc:2243] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.907553 30223 raft_consensus.cc:2272] T dca3415672474d868e6cf1a4046f9e1f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.909994 30223 tablet_replica.cc:333] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.910605 30223 raft_consensus.cc:2243] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.911578 30223 raft_consensus.cc:2272] T 5d85eb8399f5499da2447bf576c5f2e3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.913869 30223 tablet_replica.cc:333] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.914485 30223 raft_consensus.cc:2243] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.915351 30223 raft_consensus.cc:2272] T 4c2089da4bf94582b0c521e3a7479853 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.917426 30223 tablet_replica.cc:333] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.917954 30223 raft_consensus.cc:2243] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.918401 30223 raft_consensus.cc:2272] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.920523 30223 tablet_replica.cc:333] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.921026 30223 raft_consensus.cc:2243] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.921952 30223 raft_consensus.cc:2272] T d1edcb23098848989634fe257f90f2da P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.924070 30223 tablet_replica.cc:333] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.924595 30223 raft_consensus.cc:2243] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.925071 30223 raft_consensus.cc:2272] T bd32f484f5b041d29f774e4efcefeda1 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.927109 30223 tablet_replica.cc:333] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.927723 30223 raft_consensus.cc:2243] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.928215 30223 raft_consensus.cc:2272] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.930339 30223 tablet_replica.cc:333] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.930976 30223 raft_consensus.cc:2243] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.931432 30223 raft_consensus.cc:2272] T faec8446c0bc4b6e9864452fa653bf7f P 19db5d1e1f444c508c3ec347c2a5f6fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.933706 30223 tablet_replica.cc:333] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.934348 30223 raft_consensus.cc:2243] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.935501 30223 raft_consensus.cc:2272] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.937914  6582 consensus_peers.cc:597] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c -> Peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Couldn't send request to peer 19db5d1e1f444c508c3ec347c2a5f6fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.938493 30223 tablet_replica.cc:333] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.939178 30223 raft_consensus.cc:2243] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.939760 30223 raft_consensus.cc:2272] T 60b3686687434dbeac488ccfec19892e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.942375 30223 tablet_replica.cc:333] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.943022 30223 raft_consensus.cc:2243] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.943611 30223 raft_consensus.cc:2272] T 73a169e2c10443e48edd3a33ce51cf78 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.946808 30223 tablet_replica.cc:333] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
W20260709 12:27:27.947485  6581 consensus_peers.cc:597] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:38117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.947682 30223 raft_consensus.cc:2243] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.948926 30223 raft_consensus.cc:2272] T 6c95cc7f731047ea9cb6080ab8e16a10 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.951148 30223 tablet_replica.cc:333] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.951828 30223 raft_consensus.cc:2243] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.952636 30223 raft_consensus.cc:2272] T 72780ab2095944258925f9d2d3225fe0 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.954883 30223 tablet_replica.cc:333] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.955492 30223 raft_consensus.cc:2243] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.956327 30223 raft_consensus.cc:2272] T 452483d8575148d8a4a44087afda65ba P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.958454 30223 tablet_replica.cc:333] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.958950 30223 raft_consensus.cc:2243] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.959407 30223 raft_consensus.cc:2272] T ee427235b57c475c952cc5a95299e9ff P 19db5d1e1f444c508c3ec347c2a5f6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.961609 30223 tablet_replica.cc:333] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.962111 30223 raft_consensus.cc:2243] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.962543 30223 raft_consensus.cc:2272] T 0feb8917d07c43b9840447cdb98c31d4 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.964600 30223 tablet_replica.cc:333] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.965062 30223 raft_consensus.cc:2243] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.965476 30223 raft_consensus.cc:2272] T aeef2dad4b144c7480d88beec114f37e P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.967531 30223 tablet_replica.cc:333] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa: stopping tablet replica
I20260709 12:27:27.967989 30223 raft_consensus.cc:2243] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.968380 30223 raft_consensus.cc:2272] T c8c548eee8a148668dbea3ccd5c48770 P 19db5d1e1f444c508c3ec347c2a5f6fa [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.998121  6581 consensus_peers.cc:597] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c -> Peer 76b6c969c7684e3e9d66965782eba827 (127.29.131.193:38117): Couldn't send request to peer 76b6c969c7684e3e9d66965782eba827. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.193:38117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.012527  6582 consensus_peers.cc:597] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c -> Peer 19db5d1e1f444c508c3ec347c2a5f6fa (127.29.131.194:33885): Couldn't send request to peer 19db5d1e1f444c508c3ec347c2a5f6fa. Status: Network error: Client connection negotiation failed: client connection to 127.29.131.194:33885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.012835 30223 tablet_server.cc:196] TabletServer@127.29.131.194:0 shutdown complete.
I20260709 12:27:28.055260 30223 tablet_server.cc:179] TabletServer@127.29.131.195:0 shutting down...
I20260709 12:27:28.085983 30223 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:28.086825 30223 tablet_replica.cc:333] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.088030 30223 raft_consensus.cc:2243] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.088797 30223 raft_consensus.cc:2272] T 4c2089da4bf94582b0c521e3a7479853 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.091068 30223 tablet_replica.cc:333] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.091745 30223 raft_consensus.cc:2243] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.092238 30223 raft_consensus.cc:2272] T 6135ffcb6abd47d7a5c6c1022abc4d33 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.094379 30223 tablet_replica.cc:333] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.094938 30223 raft_consensus.cc:2243] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.095466 30223 raft_consensus.cc:2272] T dca3415672474d868e6cf1a4046f9e1f P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.097671 30223 tablet_replica.cc:333] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.098163 30223 raft_consensus.cc:2243] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.098587 30223 raft_consensus.cc:2272] T d1edcb23098848989634fe257f90f2da P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.100785 30223 tablet_replica.cc:333] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.101305 30223 raft_consensus.cc:2243] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.101732 30223 raft_consensus.cc:2272] T 6c95cc7f731047ea9cb6080ab8e16a10 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.103883 30223 tablet_replica.cc:333] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.104403 30223 raft_consensus.cc:2243] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.104826 30223 raft_consensus.cc:2272] T 72780ab2095944258925f9d2d3225fe0 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.106715 30223 tablet_replica.cc:333] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.107193 30223 raft_consensus.cc:2243] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.107714 30223 raft_consensus.cc:2272] T 452483d8575148d8a4a44087afda65ba P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.109695 30223 tablet_replica.cc:333] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.110414 30223 raft_consensus.cc:2243] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.110857 30223 raft_consensus.cc:2272] T ee427235b57c475c952cc5a95299e9ff P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.113025 30223 tablet_replica.cc:333] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.113543 30223 raft_consensus.cc:2243] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.114043 30223 raft_consensus.cc:2272] T 5d85eb8399f5499da2447bf576c5f2e3 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.116115 30223 tablet_replica.cc:333] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.116593 30223 raft_consensus.cc:2243] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.117019 30223 raft_consensus.cc:2272] T 3ea1cd786ab14a438d7b0c5c05402ae7 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.118979 30223 tablet_replica.cc:333] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.119557 30223 raft_consensus.cc:2243] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.120390 30223 raft_consensus.cc:2272] T 60b3686687434dbeac488ccfec19892e P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.122485 30223 tablet_replica.cc:333] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.123077 30223 raft_consensus.cc:2243] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.123559 30223 raft_consensus.cc:2272] T 73a169e2c10443e48edd3a33ce51cf78 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.125537 30223 tablet_replica.cc:333] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.126086 30223 raft_consensus.cc:2243] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.126538 30223 raft_consensus.cc:2272] T 23e1bc6b09fb45e186d3b564f8bc0fa3 P 510083e48ed24112abbc856dd2fd7b8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.128623 30223 tablet_replica.cc:333] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.129139 30223 raft_consensus.cc:2243] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.129652 30223 raft_consensus.cc:2272] T bd32f484f5b041d29f774e4efcefeda1 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.131680 30223 tablet_replica.cc:333] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.132184 30223 raft_consensus.cc:2243] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.133004 30223 raft_consensus.cc:2272] T faec8446c0bc4b6e9864452fa653bf7f P 510083e48ed24112abbc856dd2fd7b8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.135113 30223 tablet_replica.cc:333] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.135628 30223 raft_consensus.cc:2243] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.136461 30223 raft_consensus.cc:2272] T c8c548eee8a148668dbea3ccd5c48770 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.138660 30223 tablet_replica.cc:333] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.139319 30223 raft_consensus.cc:2243] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.140169 30223 raft_consensus.cc:2272] T 0feb8917d07c43b9840447cdb98c31d4 P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.142258 30223 tablet_replica.cc:333] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c: stopping tablet replica
I20260709 12:27:28.142752 30223 raft_consensus.cc:2243] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.143196 30223 raft_consensus.cc:2272] T aeef2dad4b144c7480d88beec114f37e P 510083e48ed24112abbc856dd2fd7b8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.202287 30223 tablet_server.cc:196] TabletServer@127.29.131.195:0 shutdown complete.
I20260709 12:27:28.239179 30223 master.cc:562] Master@127.29.131.254:37723 shutting down...
I20260709 12:27:28.265933 30223 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.266619 30223 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.266981 30223 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2fc6fc1c22094b3986b443b8f6a6980c: stopping tablet replica
I20260709 12:27:28.288476 30223 master.cc:584] Master@127.29.131.254:37723 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21133 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41500 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (325597 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:27:28.347572 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2262 messages since previous log ~32 seconds ago
I20260709 12:27:28.347858 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2262 messages since previous log ~32 seconds ago
I20260709 12:27:28.348057 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2260 messages since previous log ~32 seconds ago
I20260709 12:27:28.348279 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:27:28.348500 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:27:28.348804 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~92 seconds ago
I20260709 12:27:28.349040 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~140 seconds ago
I20260709 12:27:28.349442 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:27:28.350113 30223 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
